• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Study on a personal digital assistance for the visually impaired using tactile and virtual sound interface

Research Project

Project/Area Number 15500063
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Media informatics/Database
Research InstitutionShinshu University

Principal Investigator

ITOH Kazunori  Shinshu University, Engineering, Associate Professor, 工学部, 助教授 (30043045)

Project Period (FY) 2003 – 2004
Project Status Completed (Fiscal Year 2004)
Budget Amount *help
¥3,300,000 (Direct Cost: ¥3,300,000)
Fiscal Year 2004: ¥700,000 (Direct Cost: ¥700,000)
Fiscal Year 2003: ¥2,600,000 (Direct Cost: ¥2,600,000)
KeywordsVirtual sound screen / HRTF / Tablet / Tactile input guide / PDA for the visually impaired / Sound localization
Research Abstract

PC interfaces are created based on GUIs which use a pointing device. However it is very hard for those who have visual disabilities to use. The reason that visually impaired persons use PCs is mainly to use the Internet, to access a newspaper publishing company on the Web to read the latest articles of a newspaper, and to contact friends using E-mail. However, these tasks can be done by using a screen reader, e.g.. In order to use the Internet, a new PC which processes a lot of information at high speed is desired. Generally they are GUI machines like Windows, so visually impaired persons will also use a GUI PC. The GUI layout plays an important role in the expression of information or the operation of the PC, but a screen reader which reads characters sequentially does not take into account the GUI layout at all. Many visually impaired users have a desire to recognize the layout.
In this study, we show how to use a new localized sound system as a support system to recognize the layout … More of GUI objects. These localized sounds that correspond to the GUI objects are created using by HRTFs in the median plane and interaural differences between both ears in the horizontal plane. The filtering is due to reflections and diffractions from the human torso, head and pinna, and is described by HRTFs. Binaural synthesis works extremely well when the listener's own HRTFs are used to synthesize the sound localization cues. The computational simulation is made by means of binaural synthesis using HRTFs and sound presented by headphones. We found that the sound obtained by sampling in the vertical direction using white noise from a sound source near the pinna was easy to locate. As a simple model of a GUI layout, a 25 button layout with a localized sound added to each button is proposed, and the effectiveness of the localized sounds for grasping the position of the buttons is examined. After much consideration, we found that the virtual sound screen could be applied to recognize the layout of GUI objects in addition to leading a mouse cursor. Also, we examine whether or not a visually impaired person can make a formal basic figure by himself. The patterns that we treat in this report are restricted to a collection of lines. In order to make formal patterns, we prepared an acrylic pen input guide and put it on a tablet. This guide has a 9 by 9 lattice of holes which correspond to 9 by 9 localized sounds on a 2-dimensional virtual sound screen. Using this guide and a stylus pen, the visually impaired can make a pattern. The input pattern is checked and corrected by hearing the localized sound. Experiments show that the subjects can input simple patterns correctly. Less

Report

(3 results)
  • 2004 Annual Research Report   Final Research Report Summary
  • 2003 Annual Research Report
  • Research Products

    (11 results)

All 2005 2004 2003 Other

All Journal Article (9 results) Publications (2 results)

  • [Journal Article] タブレット入力と仮想音響出力を有する視覚障害者用図形伝達システムにおけるペン入力ガイドの改良2005

    • Author(s)
      杉本雅彦
    • Journal Title

      電子情報通信学会技術研究報告 104,751

      Pages: 13-18

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] タブレット入力と仮想音響出力を有する視覚障害者用図形伝達システムにおけるペン入力ガイドの改良2005

    • Author(s)
      杉本雅彦
    • Journal Title

      電子情報通信学会技術報告 104,751

      Pages: 13-18

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Simple Pattern Creation Using a Pen Input Guide and Sound Localization for the Visually Impaired2004

    • Author(s)
      Masahiko Sugimoto
    • Journal Title

      Computers Helping People with Special Needs, Proceedings of 9th International Conference, ICCHP 2004

      Pages: 745-752

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] 正中面の頭部伝達関数と水平面の両耳間差を用いた視覚障害者用聴覚ディスプレイ2004

    • Author(s)
      伊東一典
    • Journal Title

      ヒューマンインタフェースシンポジウム2004論文集

      Pages: 307-312

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] 正中面の音像定位におけるHRTFの左右差の検討2004

    • Author(s)
      藤澤森茂
    • Journal Title

      電子情報通信学会技術研究報告 104,379

      Pages: 37-42

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] ペン入力ガイドと音響スクリーンを利用した視覚障害者による簡易図形パターンの作成2004

    • Author(s)
      杉本雅彦
    • Journal Title

      ヒューマンインタフェースシンポジウム2004論文集

      Pages: 307-312

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 正中面の音像定位におけるHRTFの左右差の検討2004

    • Author(s)
      藤澤森茂
    • Journal Title

      電子情報通信学会技術報告 104,379

      Pages: 37-42

    • Related Report
      2004 Annual Research Report
  • [Journal Article] GUI Objects Represented by New Localized Sounds using HRTF2003

    • Author(s)
      Kazunori Itoh
    • Journal Title

      Universal Access in HCI : Proceedings of HCI International 2003 4

      Pages: 1285-1289

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 正中面における近距離音源によるHRTFの検討と視覚障害者用聴覚表示への応用2003

    • Author(s)
      藤澤森茂
    • Journal Title

      電子情報通信学会技術研究報告 103,397

      Pages: 49-54

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Publications] Kazunori Itoh: "GUI Objects Represented by New Localized Sounds using HRTF"Universal Access in HCI : Proceedings of HCI International 2003. 4. 1286-1289 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 藤澤森茂: "正中面における近距離音源によるHRTFの検討と視覚障害者用聴覚表示への応用"電子情報通信学会技術研究報告. 103, 397. 49-54 (2003)

    • Related Report
      2003 Annual Research Report

URL: 

Published: 2003-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi