• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Tactile and auditory augmentations based on the mechanism of perceptions acquired by visually impaired people

Research Project

Project/Area Number 20H04561
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 90150:Medical assistive technology-related
Research InstitutionThe University of Tokyo

Principal Investigator

Ifukube Tohru  東京大学, 先端科学技術研究センター, 名誉教授 (70002102)

Co-Investigator(Kenkyū-buntansha) 大河内 直之  東京大学, 先端科学技術研究センター, 特任研究員 (30361679)
坂尻 正次  筑波技術大学, 保健科学部, 教授 (70412963)
三浦 貴大  国立研究開発法人産業技術総合研究所, 情報・人間工学領域, 主任研究員 (80637075)
Project Period (FY) 2020-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥17,680,000 (Direct Cost: ¥13,600,000、Indirect Cost: ¥4,080,000)
Fiscal Year 2022: ¥5,070,000 (Direct Cost: ¥3,900,000、Indirect Cost: ¥1,170,000)
Fiscal Year 2021: ¥5,070,000 (Direct Cost: ¥3,900,000、Indirect Cost: ¥1,170,000)
Fiscal Year 2020: ¥7,540,000 (Direct Cost: ¥5,800,000、Indirect Cost: ¥1,740,000)
Keywords視覚障害 / 触覚特性 / 聴覚特性 / 質感知覚 / 感覚代行 / 感覚拡張 / クロスモーダル / バーチャルリアリティ / 感覚提示 / 視覚障害者 / 聴覚情報処理 / 触覚情報処理 / テクスチャー / 質感 / 触覚 / 聴覚
Outline of Research at the Start

本研究では、視覚障害者に特有な触覚・聴覚で知覚される質感のメカニズム解明とその提示・感覚拡張手法の導出を目的とし、新しい感覚代行手法の提案につなげていく。具体的には、触覚・聴覚単独の場合と、双方が同時提示される場合での質感知覚について、以下の3項目を遂行する。
(A)視覚障害者への質感知覚に関する聞き取り/アンケート調査
(B)触覚・聴覚提示する実験システムの設計・開発
(C)システムを用いた質感知覚の実験的解析・評価
一連の結果を基に、視覚障害者への質感提示・感覚拡張手法を提案・設計する。

Outline of Final Research Achievements

In order to develop effective sensory substitution and reinforcement methods for the visually impaired, we investigated tactile and auditory "textures" by the visually impaired and developed a prototype tactile device that presents textures. First, with the cooperation of 151 visually impaired persons, we determined (A) how they use auditory and tactile information in everyday life situations.
Based on the results, we designed a prototype of (B) a tactile and auditory display system. For the tactile display, we developed a device (Tactule-64) that displays various tactile textures by placing 64 vibrating pins in a 10 mm x 10 mm area.
Furthermore, (C) we applied it to a tactile controller (TactCon) and demonstrated its usefulness through games, and proposed a new visual substitution/enhancement method that enables tactile texture presentation.

Academic Significance and Societal Importance of the Research Achievements

先天的な視覚障害者に加えて、高齢者の増加とともに失明に至る人たちも増えている。代表者らは、視覚障害者のための感覚代行を設計する上で、環境や文字・画像の情報を符号化して伝えるだけでなく、環境、物体、音声の持つ「質感」を提示する重要を示してきた。
本研究では、触覚や聴覚を通して視覚的なイメージを惹起させる感覚代行・拡張手法を設計するために、質感をどのように知覚しているかを調べ、質感を提示できるシステムを試作した。その成果は、視覚障害者の支援に活かされるとともに、バーチャルリアリティ(VR)や各種ゲームなどのICT産業へも貢献することから、研究の社会的意義は高い。

Report

(4 results)
  • 2023 Final Research Report ( PDF )
  • 2022 Annual Research Report
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • Research Products

    (22 results)

All 2024 2023 2021 2020 Other

All Journal Article (9 results) (of which Peer Reviewed: 5 results,  Open Access: 7 results) Presentation (11 results) (of which Int'l Joint Research: 8 results,  Invited: 1 results) Book (1 results) Remarks (1 results)

  • [Journal Article] Examining How Interaural Differences Owing to Head Rotation during Walking Improve the Distance of Auditory Obstacle Perceptions among Individuals with Visual Impairment: A Case Study in Small-Scale Blind Group2024

    • Author(s)
      Miura T, Okochi N, Mats,uo M, Yabu K, Katagiri A, Yasu K, Sakajiri M, Ifukube T
    • Journal Title

      Life 2024

      Volume: 14(3) Issue: 3 Pages: 356-356

    • DOI

      10.3390/life14030356

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Learning Processes of Touchscreen Gesture Interaction in Older Adults and Children2023

    • Author(s)
      Miura T, Yabu K, Kobayashi M, Hiyama A, Hirose M, Ifukube T
    • Journal Title

      Lecture Notes in Computer Science

      Volume: 14055 Pages: 125-139

    • DOI

      10.1007/978-3-031-48041-6_10

    • ISBN
      9783031480409, 9783031480416
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Binaural Listening with Head Rotation Helps Persons with Blindness Perceive Narrow Obstacles.2023

    • Author(s)
      Miura T, Okochi N, Suzuki J, Ifukube T
    • Journal Title

      International Journal of Environmental Research and Public Health

      Volume: 20(8) Issue: 8 Pages: 5573-5573

    • DOI

      10.3390/ijerph20085573

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] ウェアラブルな構音障害支援デバイスにおける制御インタフェースと音声補完の検討2023

    • Author(s)
      藪謙一郎, 田中敏明, 伊福部達
    • Journal Title

      日本音響学会研究発表会講演論文集(CD-ROM)

      Volume: CD-ROM2023 Pages: 685-686

    • Related Report
      2022 Annual Research Report
  • [Journal Article] 伝音性難聴のある成人による軟骨伝導型振動子の装着位置の検討2023

    • Author(s)
      安啓一, 中津智貴, 平賀瑠美, 坂尻正次, 三浦貴大, 藪謙一郎, 伊福部達
    • Journal Title

      日本音響学会研究発表会講演論文集(CD-ROM)

      Volume: CD-ROM2023 Pages: 1615-1616

    • Related Report
      2022 Annual Research Report
  • [Journal Article] 感覚代行研究(複合感覚の特性, コミュニケーションのための代行技術, 産業化への道, 他)2023

    • Author(s)
      伊福部 達
    • Journal Title

      感覚代行研究の資料 (Web公開資料集), 感覚代行研究会制作

      Volume: 1

    • Related Report
      2022 Annual Research Report
    • Open Access
  • [Journal Article] Auditory perceptual world in people with visual impairments: Sensory substitution and sound-based assistive technology2021

    • Author(s)
      三浦 貴大
    • Journal Title

      THE JOURNAL OF THE ACOUSTICAL SOCIETY OF JAPAN

      Volume: 77 Issue: 3 Pages: 199-207

    • DOI

      10.20697/jasj.77.3_199

    • NAID

      130008013947

    • ISSN
      0369-4232, 2432-2040
    • Year and Date
      2021-03-01
    • Related Report
      2020 Annual Research Report
    • Open Access
  • [Journal Article] Inclusive action game presenting real-time multimodal presentations for sighted and blind persons2021

    • Author(s)
      Masaki Matsuo, Takahiro Miura, Ken-ichiro Yabu, Atsushi Katagiri, Masatsugu Sakajiri, Junji Onishi, Takeshi Kurata, Tohru Ifukube
    • Journal Title

      ICMI '21: Proceedings of the 2021 International Conference on Multimodal Interaction

      Volume: 2021 Pages: 62-70

    • DOI

      10.1145/3462244.3479912

    • Related Report
      2021 Annual Research Report 2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] GAME: Game As a Measurement Environment: Scheme to Evaluate Interfaces and Game Contents Based on Test Theories2020

    • Author(s)
      Miura Takahiro, Matsuo Masaki, Yabu Ken-ichiro, Katagiri Atsushi, Sakajiri Masatsugu, Onishi Junji, Kurata Takeshi, Ifukube Tohru
    • Journal Title

      Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

      Volume: 4 Issue: 4 Pages: 1-30

    • DOI

      10.1145/3432702

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] Learning Processes of Touchscreen Gesture Interaction in Older Adults and Children.2023

    • Author(s)
      Miura T, Yabu K, Kobayashi M, Hiyama A, Hirose M, Ifukube T
    • Organizer
      International Conference on. Human-Computer Interaction, Copenhagen, Denmark,
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] ウェアラブルな構音障害支援デバイスにおける制御インタフェースと音声補完の検討2023

    • Author(s)
      藪謙一郎, 田中敏明, 伊福部達
    • Organizer
      日本音響学会第151回(2024年春季)研究発表会
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 伝音性難聴のある成人による軟骨伝導型振動子の装着位置の検討2023

    • Author(s)
      安啓一, 中津智貴, 平賀瑠美, 坂尻正次, 三浦貴大, 藪謙一郎, 伊福部達
    • Organizer
      日本音響学会第 150 回(2023 年秋季)研究発表会
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 高齢社会を豊かにする技術とシステム -JSTのプロジェクトを例に-2023

    • Author(s)
      伊福部 達
    • Organizer
      基調講演資料「ジェロンテック×AI/DXフォーラム」 AOSデータ
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 高齢社会を豊かにするテクノロジーを求めて. 第12話:JSTプロジェクトの始動2023

    • Author(s)
      伊福部 達
    • Organizer
      Bitis ブログ資料
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] GAME: Game As a Measurement Environment: Scheme to Evaluate Interfaces and Game Contents Based on Test Theories2021

    • Author(s)
      Takahiro Miura, Masaki Matsuo, Ken-ichiro Yabu, Atsushi Katagiri, Masatsugu Sakajiri, Junji Onishi, Takeshi Kurata, Tohru Ifukube
    • Organizer
      ACM UbiComp 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 視覚障害者が音で見る世界と人間拡張への応用2021

    • Author(s)
      三浦 貴大
    • Organizer
      HCGシンポジウム2021
    • Related Report
      2021 Annual Research Report 2020 Annual Research Report
    • Invited
  • [Presentation] インクルーシブな開発体制によるアクセシブルアクションRPGの開発~視覚障害者・晴眼者の共同作業に着目して~2021

    • Author(s)
      松尾政輝, 三浦貴大, 藪謙一郎, 片桐淳, 坂尻正次, 大西淳児, 蔵田武志, 伊福部達
    • Organizer
      HCGシンポジウム2021
    • Related Report
      2021 Annual Research Report
  • [Presentation] 音バリアフリーの観点から視覚障害・聴覚障害者のオンライン会議ツールの利用状況を考察する2021

    • Author(s)
      坂尻正次
    • Organizer
      日本音響学会2021年春季研究発表会
    • Related Report
      2021 Annual Research Report
  • [Presentation] GAME: Game As a Measurement Environment: Scheme to Evaluate Interfaces and Game Contents Based on Test Theories.2021

    • Author(s)
      Miura Takahiro、Matsuo Masaki、Yabu Ken-ichiro、Katagiri Atsushi、Sakajiri Masatsugu、Onishi Junji、Kurata Takeshi、Ifukube Tohru
    • Organizer
      ACM UbiComp 2021
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Inclusive Action Game Presenting Real-time Multimodal Presentations for Sighted and Blind Persons.2021

    • Author(s)
      Matsuo Masaki、Miura Takahiro、Yabu Ken-ichiro、Katagiri Atsushi、Sakajiri Masatsugu、Onishi Junji、Kurata Takeshi、Ifukube Tohru
    • Organizer
      2021 International Conference on Multimodal Interaction (ICMI ’21)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Book] シリーズ超高齢社会のデザイン ジェロンテクノロジー 高齢社会を支える情報通信技術の展開2021

    • Author(s)
      廣瀬 通孝、伊福部 達
    • Total Pages
      256
    • Publisher
      東京大学出版会
    • ISBN
      9784130343145
    • Related Report
      2021 Annual Research Report
  • [Remarks] 伊福部研究室

    • URL

      https://www.human.iog.u-tokyo.ac.jp/

    • Related Report
      2021 Annual Research Report

URL: 

Published: 2020-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi