• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A Study of Barrier-free Communication Systems Using Virtual Reality Technology for Deaf People

Research Project

Project/Area Number 15300189
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Rehabilitation science/Welfare engineering
Research InstitutionThe University of Tokyo

Principal Investigator

INO Shuichi  The University of Tokyo, Research Center for Advanced Science and Technology, Associate Professor, 先端科学技術研究センター, 助教授 (70250511)

Co-Investigator(Kenkyū-buntansha) IFUKUBE Tohru  The University of Tokyo, Research Center for Advanced Science and Technology, Professor, 先端科学技術研究センター, 教授 (70002102)
SUZUKI Yasuo  Sapporo Medical University, School of medicine, Associate Professor, 医学部, 助教授 (40221329)
KUROKI Hayato  The University of Tokyo, Research Center for Advanced Science and Technology, Specially Appointed Research Associate, 先端科学技術研究センター, 科学技術振興特任教員(特任助手) (00345159)
FUKUSHIMA Satoshi  The University of Tokyo, Research Center for Advanced Science and Technology, Associate Professor, 先端科学技術研究センター, 助教授 (50285079)
中野 聡子  東京大学, 先端科学技術研究センター, 科学技術振興特任教員 (20359665)
Project Period (FY) 2003 – 2005
Project Status Completed (Fiscal Year 2005)
Budget Amount *help
¥14,000,000 (Direct Cost: ¥14,000,000)
Fiscal Year 2005: ¥4,600,000 (Direct Cost: ¥4,600,000)
Fiscal Year 2004: ¥4,900,000 (Direct Cost: ¥4,900,000)
Fiscal Year 2003: ¥4,500,000 (Direct Cost: ¥4,500,000)
KeywordsHearing Disability / Barrier-Free Information / Virtual Reality / Sensory Substitute / Caption / Head-Mounted Display / human Influence / Tactile Display / 聴覚障害者支援 / 音声認識 / ノンバーバル情報 / 触感 / 皮膚力学モデル
Research Abstract

In this research project, we developed three types of barrier-free communication system for people with hearing disability. These systems employ the recent technology such as a sensory display in virtual reality and a wearable PC in human interface technology. Specifically the results of this project are described in the following paragraphs.
1.A portable automatic note-taking system has been designed to allow face-to-face communication between deaf and hearing people. This system is mainly composed of a lightweight optical see-through HMD, a wearable PC and speech recognition software. To confirm a margin of safety of the VR display system, human influences were examined neuro-ophthalmologically. It was found that visual load by the VR display for a long time affected ocular accommodation and pupillary movement in healthy subjects.
2.Our compact tactile aid utilizes a multi-channel vibrotactile display. To assist deaf people at speech reading, this tactile communication device converts … More voice information into vibrotactile stimulation on a fingertip. We investigate here biomechanical characteristics of fingerpad skin to generate adequate tactile stimulus for voice communication and design a broadband vibrotactile display composed of small piezoelectric bimorph actuators. From the results of psychophysical experiments, it was suggested that our tactile aid should allow to present voice quality of a speaker on the fingertip.
3.A real-time captioning system was developed for public communication at a meeting or the lectures of a school. This system consists of a LCD projector instead of the MHD of the above note-taking system, a simultaneous respeaking operator to respond more flexibly to various speakers, and a device for superimposing the images of a speaker and a caption on a large screen. Furthermore we examined the optimal spatiotemporal parameters of superimposing the images of a speaker and a caption to improve communication accuracy for deaf users. This system is now available at an international meeting and the lectures of some universities in Japan. Less

Report

(4 results)
  • 2005 Annual Research Report   Final Research Report Summary
  • 2004 Annual Research Report
  • 2003 Annual Research Report
  • Research Products

    (55 results)

All 2006 2005 2004 2003 Other

All Journal Article (41 results) Book (7 results) Publications (7 results)

  • [Journal Article] 聴覚障害者のための音声同時字幕システムの遠隔地運用の結果とその評価2006

    • Author(s)
      黒木速人, 井野秀一, 中野聡子, 堀耕太郎, 伊福部達
    • Journal Title

      ヒューマンインタフェース学会論文誌 (印刷中)

    • NAID

      10017535159

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] 音声認識技術を利用した字幕呈示システムの現状と課題-音声言語と文字言語の性質の違いに焦点をあてて-2006

    • Author(s)
      中野聡子, 牧原功, 金澤貴之, 菊池真里, 黒木速人, 井野秀一, 伊福部達, 福島智
    • Journal Title

      群馬大学教育実践研究 23

      Pages: 251-259

    • NAID

      40015267127

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] 音声認識技術を活用した字幕呈示システムの開発研究及び運用における諸課題-利用者の観点を中心に-2006

    • Author(s)
      福島智, 中野聡子, 金澤貴之, 黒木速人, 井野秀一, 伊福部達
    • Journal Title

      群馬大学教育学部紀要(人文・社会科学編) 55

      Pages: 189-196

    • NAID

      120000912820

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] バリアフリーを創出する学際的な科学技術としての福祉工学2006

    • Author(s)
      井野秀一
    • Journal Title

      知的障害福祉研究 「さぽーと」 53・3

      Pages: 50-58

    • NAID

      40007249871

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Results and its evaluation of a real-time speech-to-caption system for the hearing impaired applied to an operation for a remote place2006

    • Author(s)
      H.Kuroki, S.Ino, S.Nakano, K.Hori, T.Ifukube
    • Journal Title

      The transactions of Human Interface Society (in press)

    • NAID

      10017535159

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Actual condition and issues of a caption system using automatic speech recognition technology2006

    • Author(s)
      S.Nakano, I.Makihara, T.Kanazawa, M.Kikuchi, H.Kuroki, S.Ino, T.Ifukube, S.Fukushima
    • Journal Title

      Research in Educational Plactice and Development, Gunma University 23

      Pages: 251-259

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Some issues to study developing and practicing the real time captioning system using automatic speech recognition technology2006

    • Author(s)
      S.Fukushima, S.Nakano, T.Kanazawa, H.Kuroki, S.Ino, T.Ifukube
    • Journal Title

      Bulletin of the Faculty of Education, Gunma University 55

      Pages: 189-196

    • NAID

      120000912820

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Rehabilitation Engineering as interdisciplinary technology to new-create barrier-free society2006

    • Author(s)
      S.Ino
    • Journal Title

      Journal of Japanese Association on Intellectual Disability (SUPPORT) 53-3

      Pages: 50-58

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] バリアフリーを創出する学際的な科学技術としての福祉工学2006

    • Author(s)
      井野秀一
    • Journal Title

      知的障害福祉研究「さぽーと」 53・3

      Pages: 50-58

    • NAID

      40007249871

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 映像負荷と近見反応時の瞳孔運動2005

    • Author(s)
      鈴木康夫, 松田泰輔
    • Journal Title

      神経眼科 22・3

      Pages: 368-375

    • NAID

      10018960443

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] A study of clinical assessment of left unilateral spatial neglect using ahead mounted display system in rehabilitation engineering technology2005

    • Author(s)
      T.Tanaka, S.Sugihara, H.Nara, S.Ino, T.Ifukube
    • Journal Title

      Journal of NeuroEngineering and Rehabilitation 2・31

      Pages: 1-9

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Gain of Human Torsional Optokinetic Nystagmus Depends on Horizontal Display2005

    • Author(s)
      N.Washio, Y.Suzuki, M.Sawa, K.Ohtsuka
    • Journal Title

      Investigate Ophthalmology and Visual Science 46・1

      Pages: 133-136

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Clinical application of head mounted display system for left unilateral spatial neglect2005

    • Author(s)
      T.Tanaka, H.Nara, S.Ino, T.Ifukube
    • Journal Title

      The Japanese Journal of Ergonomics 41.4

      Pages: 213-217

    • NAID

      10019042157

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 視覚障害者への音声提示における最適・最高速度2005

    • Author(s)
      浅川智恵子, 高木啓伸, 井野秀一, 伊福部達
    • Journal Title

      ヒューマンインタフェース学会論文誌 7・1

      Pages: 105-111

    • NAID

      10014479377

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Effects of viewing with a visual display on pupillary movements during near response2005

    • Author(s)
      Y.Suzuki, Y.Matsuda
    • Journal Title

      Neuro-ophthalmology Japan 22-3

      Pages: 368-375

    • NAID

      10018960443

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A study of clinical assessment of left unilateral spatial neglect using a head mounted display system in rehabilitation engineering technology2005

    • Author(s)
      T.Tanaka, S.Sugihara, H.Nara, S.Ino, T.Ifukube
    • Journal Title

      Journal of Neuro Engineering and Rehabilitation 2-31

      Pages: 1-9

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Gain of Human Torsional Optokinetic Nystagmus Depends on Horizontal Display2005

    • Author(s)
      N.Washio, Y.Suzuki, M.Sawa, K.Ohtsuka
    • Journal Title

      Investigate Ophthalmology and Visual Science 46-1

      Pages: 133-136

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Clinical application of head mounted display system for left unilateral spatial neglect2005

    • Author(s)
      T.Tanaka, H.Nara, S.Ino, T.Ifukube
    • Journal Title

      The Japanese Journal of Ergonomics 41-4

      Pages: 213-217

    • NAID

      10019042157

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] The optimal and maximum listening rates in presenting speech information to the blind2005

    • Author(s)
      C.Asakawa, H.Takagi, S.Ino, T.Ifukube
    • Journal Title

      The transactions of Human Interface Society 7-1

      Pages: 105-111

    • NAID

      10014479377

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A study of clinical assessment of left unilateral spatial neglect using a head mounted display system (HMD) in rehabilitation engineering technology2005

    • Author(s)
      T.Tanaka, S.Sugihara, H.Nara, S.Ino, T.Ifukube
    • Journal Title

      Journal of NeuroEngineering and Rehabilitation 2・31

      Pages: 1-9

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Clinical application of head mounted display system for left unilateral spatial neglect2005

    • Author(s)
      T.Tanaka, H.Nara, S.Ino, T.Ifukube
    • Journal Title

      The Japanese Journal of Ergonomics 41・4

      Pages: 213-217

    • NAID

      10019042157

    • Related Report
      2005 Annual Research Report
  • [Journal Article] ピンマトリクス型触覚ディスプレイによる触感提示を利用した情報伝達の研究2005

    • Author(s)
      本間健, 井野秀一, 黒木速人, 泉隆, 伊福部達
    • Journal Title

      日本機械学会 ロボディクス・メカトロニクス講演会2005講演概要集 (CD-ROM)

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 聴覚障害者のための音声同時字幕システムおけるノンバーバル情報の呈示方法2005

    • Author(s)
      黒木速人, 井野秀一, 中野聡子, 堀耕太郎, 伊福部達
    • Journal Title

      日本音響学会 聴覚研究会資料 35・4

      Pages: 231-236

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 音声字幕化システムのための聴覚障害者におけるノンバーバル情報の呈示方法2005

    • Author(s)
      黒木速人, 井野秀一, 中野聡子, 堀耕太郎, 伊福部達
    • Journal Title

      ヒューマンインタフェース学会 ヒューマンインタフェースシンポジウム2005論文集 (CD-ROM)

      Pages: 665-670

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 視覚と聴覚の情報バリアフリーのための福祉工学技術2005

    • Author(s)
      井野秀一, 黒木速人, 伊福部達
    • Journal Title

      計測自動制御学会 第20回生体・生理シンポジウム論文集

      Pages: 245-248

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 聴覚障害者の情報保障を目的とした音声同時字幕システムに関する研究2005

    • Author(s)
      井野秀一, 黒木速人, 中野聡子, 堀耕太郎, 伊福部達
    • Journal Title

      計測自動制御学 第6回システムインテクグレーション部門講演会論文集 (CD-ROM)

      Pages: 779-780

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 聴覚障害者のための音声字幕化システムにおけるノンバーバル情報の呈示方法2005

    • Author(s)
      黒木速人, 井野秀一, 中野聡子, 堀耕太郎, 伊福部達
    • Journal Title

      ヒューマン・インタフェース・シンポジウム2004論文集

      Pages: 329-332

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 情報バリアフリー支援技術2005

    • Author(s)
      井野秀一, 伊福部達
    • Journal Title

      日本機械学会2004年次大会講演資料集

      Pages: 236-237

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 広帯域振動刺激による触感提示を利用した情報伝達に関する基礎研究2005

    • Author(s)
      本間健, 井野秀一, 黒木速人, 泉隆, 伊福部達
    • Journal Title

      電子情報通信学会技術研究報告(HCS) (印刷中)

    • NAID

      110003271831

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 指先皮膚の機械特性を考慮した触覚ディスプレイ用圧電アクチュエータの製作2004

    • Author(s)
      本間健, 井野秀一, 泉隆, 黒木速人, 伊福部達
    • Journal Title

      日本バーチャルリアリティ学会論文誌 9.3

      Pages: 249-258

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] TAJODA : Proposed Tactile and Jog-Dial Interface for the Blind2004

    • Author(s)
      C.Asakawa, H.Takagi, S.Ino, T.Ifukube
    • Journal Title

      IEICE Transactions on Information and Systems E87-D・6

      Pages: 1045-1014

    • NAID

      110003214014

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary 2004 Annual Research Report
  • [Journal Article] Effects of an Eyeglass-free 3D-Display on Human Visual System2004

    • Author(s)
      Y.Suzuki, Y.Onda, S.Katada, S.Ino, T.Ifukube
    • Journal Title

      Japanese Journal of Ophthalmology 48・1

      Pages: 1-6

    • NAID

      10012208632

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Development of a piezoelectric actuator for tactile display based on mechanical characteristics of fingerpad surface2004

    • Author(s)
      T.Homma, S.Ino, T.Izumi, H.Kuroki, T.Ifukube
    • Journal Title

      Transactions of the Virtual Reality Society of Japan 9-3

      Pages: 249-258

    • NAID

      110008746940

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] TAJODA : Proposed Tactile and Jog-Dial Interface for the Blind2004

    • Author(s)
      C.Asakawa, H.Takagi, S.Ino, T.Ifukube
    • Journal Title

      IEICE Transactions on Information and Systems E87-D-6

      Pages: 1045-1014

    • NAID

      110003214014

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Effects of an Eyeglass-free 3D-Display on Human Visual System2004

    • Author(s)
      Y.Suzuki, Y.Onda, S.Katada, S.Ino, T.Ifukube
    • Journal Title

      Japanese Journal of Ophthalmology 48-1

      Pages: 1-6

    • NAID

      10012208632

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 指先皮膚の機械特性を考慮した触覚ディスプレイ用圧電アクチュエータの製作2004

    • Author(s)
      本間健, 井野秀一, 泉隆, 黒木速人, 伊福部達
    • Journal Title

      日本バーチャルリアリティ学会論文誌 9・3

      Pages: 249-258

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Development of a piezoelectric actuator for presentation of various tactile stimulation patterns to fingerpad skin2004

    • Author(s)
      T.Homma, S.Ino, H.Kuroki, T.Izumi, T.Ifukube
    • Journal Title

      Proceedings of the 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society

      Pages: 4960-4963

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Measurement of Mechanical Characteristics of a Fingerpad Surface in the Design of a Tactile Display2003

    • Author(s)
      T.Homma, S.Ino, T.Izumi, H.Kuroki, T.Ifukube
    • Journal Title

      ournal of Robotics and Mechatronics 15・2

      Pages: 153-163

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 情報バリアフリーとVR-聴覚障害者のコミュニケーション支援技術-2003

    • Author(s)
      井野秀一
    • Journal Title

      日本バーチャルリアリティ学会誌 8・2

      Pages: 70-75

    • NAID

      10013974413

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Measurement of Mechanical Characteristics of a Fingerpad Surface in the Design of a Tactile Display2003

    • Author(s)
      T.Homma, S.Ino, T.Izumi, H.Kuroki, T.Ifukube
    • Journal Title

      Journal of Robotics and Mechatronics 15-2

      Pages: 153-163

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Barrier-free Information and VR - Communication Aids for Persons with hearing Disability -2003

    • Author(s)
      S.Ino
    • Journal Title

      Journal of the Virtual Reality Society of Japan 8-2

      Pages: 70-75

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Book] Medical Electronic Devices II2006

    • Author(s)
      H.Yamagata, T.Izumi, S.Ino, T.Ifukube, et al.
    • Publisher
      Corona Publishing Co., Ltd.(in press)
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Book] 医用機器II2006

    • Author(s)
      山形仁, 泉隆, 井野秀一, 伊福部達, 大川井宏明, 仁田新一, 本村信篤, 森一生, 山家智之, 吉澤誠
    • Publisher
      コロナ社(印刷中)
    • Related Report
      2005 Annual Research Report
  • [Book] いま,この研究がおもしろい(岩波書店編集部編)2005

    • Author(s)
      伊福部達, 他
    • Total Pages
      244
    • Publisher
      岩波書店
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Book] Attractive Studies in Japan2005

    • Author(s)
      T.Ifukube, et al.
    • Total Pages
      244
    • Publisher
      Iwanami Shoten
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Book] 福祉工学の挑戦-身体機能を支援する科学とビジネス-2004

    • Author(s)
      伊福部達
    • Total Pages
      210
    • Publisher
      中央公論新社
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Book] Challenge of Assistive Technology2004

    • Author(s)
      T.Ifukube
    • Total Pages
      210
    • Publisher
      Chuokoron-shinsya, Inc.
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Book] 福祉工学への挑戦 -身体機能を支援する科学とビジネス-2004

    • Author(s)
      伊福部達
    • Total Pages
      210
    • Publisher
      中央公論新社
    • Related Report
      2004 Annual Research Report
  • [Publications] 井野 秀一: "情報バリアフリーとVR-聴覚障害者のコミュニケーション支援技術-"日本バーチャルリアリティ学会誌. 8・2. 70-75 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] T.Homma: "Measurement of Mechanical Characteristics of a Fingerpad Surface in the Design of a Tactile Display"Journal of Robotics and Mechatronics. 15・2. 153-163 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Y.Suzuki: "Effects of an Eyeglass-free 3D Display on Human Visual System"Japanese Journal of Ophthalmology. 48・1. 1-6 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] 井野秀一: "聴覚障害者の会議参加支援を目的としたリアルタイム音声字幕化システムの設計"生体生理工学シンポジウム2003論文集. 221-224 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 中野聡子: "視機能低下シミュレーションによる手話の視認性(2)-手話単語を中心に-"ヒューマンインタフェースシンポジウム2003論文集. 591-594 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] C.Asakawa: "TAJODA : Proposed Tactile and Jog-Dial Interface for the Blind"IEICE Transactions on Information and Systems. (in press). (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] 伊福部 達: "スペクトル解析ハンドブック([14.1発声系][15.3.2聴覚系][15.3.3発声系])"朝倉書店. 621 (2004)

    • Related Report
      2003 Annual Research Report

URL: 

Published: 2003-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi