• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on development of technologies to reduce the barrier of visual information for aimed to assist learning of visually impaired students

Research Project

Project/Area Number 18H01058
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 09070:Educational technology-related
Research InstitutionToyama Prefectural University

Principal Investigator

Takagi Noboru  富山県立大学, 工学部, 教授 (50236197)

Co-Investigator(Kenkyū-buntansha) 荒木 智行  広島工業大学, 工学部, 教授 (20257413)
鈴木 貴  広島工業大学, 工学部, 教授 (40289260)
Project Period (FY) 2018-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥13,910,000 (Direct Cost: ¥10,700,000、Indirect Cost: ¥3,210,000)
Fiscal Year 2020: ¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000)
Fiscal Year 2019: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Fiscal Year 2018: ¥8,320,000 (Direct Cost: ¥6,400,000、Indirect Cost: ¥1,920,000)
Keywords福祉情報工学 / アクセシビリティ / 視覚障害者 / 学習支援 / 応用情報 / パターン認識 / 教育工学 / アシスティブ・テクノロジー / 障害者支援 / 特殊教育工学 / 視覚障がい者 / 学習支援システム / 特別支援教育 / インクルージョンと共生社会 / 応用情報学 / 触図 / 音響システム
Outline of Final Research Achievements

It is essential to use visual information when studying the STEM subjects in order to construct understanding physics phenomena etc., but it is difficult for blind people to access such visual information. Therefore, we have studied the following research issues. The first issue was the development of line drawing pattern recognition, in which we have developed a recognition method as an elementary technology for automatically generating tactile graphics from printed/handwritten drawings. Next, we have developed an audio assisted tactile graphics systems using smartphones, which enables blind people to access tactile graphics easily. Third, we have prototyped a speaker array system which consists of 64 loud speakers arranged on a rectangle. We have then conducted a basic experiment to clarify how accurately a moving sound of a line-drawing/object-movement could be recognized. The results suggest that blind people could be access visual information using both touch and audition.

Academic Significance and Societal Importance of the Research Achievements

線図形のパターン認識では,畳み込みニューラルネットワーク(CNN)を応用した技術開発を行った.線図形は,CNNが良く応用される一般物体画像と異なり,無地の背景に疎な前景で構成されるため新しいCNNを構築した.更に,視覚障害者でも利用可能な新しいオブジェクト指向型図形図形記述言語を試作した.視覚障害者が視覚情報へアクセスするには,触図の利用がほとんどである.即ち,触覚のみで図へアクセスしなければならない.これに対し,我々は聴覚による視覚情報へのアクセスを検討し,その可能性を示した.以上が学術的意義の概要である.また,視覚障害者の支援を目的とした研究のため社会的意義は大きいと言える.

Report

(4 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • Research Products

    (26 results)

All 2021 2020 2019 2018

All Presentation (26 results) (of which Int'l Joint Research: 12 results,  Invited: 1 results)

  • [Presentation] 深層学習を応用した衣服画像説明分の自動生成手法2021

    • Author(s)
      立野貴梨,高木昇,澤井圭,本吉達郎,増田寛之
    • Organizer
      ライフサポート学会第30回フロンティア講演会
    • Related Report
      2020 Annual Research Report
  • [Presentation] An Object-oriented Graphics Language Available for Blind Users2021

    • Author(s)
      Noboru Takagi, Takashi Suzuki, and Tomoyuki Araki
    • Organizer
      Proceedings of the 4th International Workshop on Digitization and E-Inclusion in Mathematics and Science
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 深層学習を用いたシーンスケッチ画像の認識手法とその有効性検証2020

    • Author(s)
      大嶋健悟,高木昇,澤井圭,増田寛之,本吉達郎
    • Organizer
      日本知能情報ファジィ学会第36回ファジィシステムシンポジウム
    • Related Report
      2020 Annual Research Report
  • [Presentation] 視覚障碍者支援を目的とした衣服画像説明文生成手法2020

    • Author(s)
      立野貴梨,高木昇,澤井圭,増田寛之,本吉達郎
    • Organizer
      日本知能情報ファジィ学会第36回ファジィシステムシンポジウム
    • Related Report
      2020 Annual Research Report
  • [Presentation] 視覚障碍者の視認支援を目的としたスマートフォンでリアルタイム処理可能な画像検索システムの開発2020

    • Author(s)
      大舘直哉,高木昇
    • Organizer
      日本知能情報ファジィ学会第29回北信越支部シンポジウム
    • Related Report
      2020 Annual Research Report
  • [Presentation] Method for Generating Captions for Closing Images to Support Visually Impaired People2020

    • Author(s)
      Kiri Tateno, Noboru Takagi, Kei Sawai, Hiroyuki Masuta, and Tatuo Motoyoshi
    • Organizer
      Proceedings of Joint 11th International Conference on Soft Computing and Intelligent Systems and 21st International Symposium on Advanced Intelligent Systems
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Pattern Recognition Method for Scene Sketch Images Using Deep Learning and It Evaluation2020

    • Author(s)
      Kengo Ochima, Noboru Takagi, Kei Sawai, Hiroyuki Masuta, and Tatsuo Motoyoshi
    • Organizer
      Proceedings of Joint 11th International Conference on Soft Computing and Intelligent Systems and 21st International Symposium on Advanced Intelligent Systems
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 視覚障がい者が利用可能なオブジェクト指向図形描画記述言語の開発について2020

    • Author(s)
      高木昇,鈴木貴,荒木智行
    • Organizer
      情報アクセシビリティをめぐる諸問題に関する研究集会
    • Related Report
      2019 Annual Research Report
  • [Presentation] Image Retrieval Method Executable on Smartphones Using ORB Local Features and Binary Decision Tree2019

    • Author(s)
      Kiri Tateno and Noboru Takagi
    • Organizer
      International Conference on Machine Learning and Cybernetics
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] The Presentation of a Sightseeing Area Information by a Shape Presentation System Using Linear Actuators2019

    • Author(s)
      Tatsuo Motoyoshi and Noboru Takagi
    • Organizer
      International Conference on Machine Learning and Cybernetics
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 視覚障碍者のための触図触察支援システムのユーザインタフェース検討2019

    • Author(s)
      立野貴梨,高木昇,本吉達郎,増田寛之,澤井圭
    • Organizer
      日本知能情報ファジィ学会主催第29回インテリジェント・システム・シンポジウム
    • Related Report
      2019 Annual Research Report
  • [Presentation] 視覚障害者のための音声による触図触察支援システムのユーザインタフェース評価2019

    • Author(s)
      立野貴梨,高木昇,本吉達郎,増田寛之,澤井圭
    • Organizer
      日本知能情報ファジィ学会第35回ファジィシステムシンポジウム
    • Related Report
      2019 Annual Research Report
  • [Presentation] 深層学習を用いたスケッチ画像の識別率向上の検討2019

    • Author(s)
      大嶋健悟,高木昇,本吉達郎,増田寛之,澤井圭
    • Organizer
      日本知能情報ファジィ学会第27回北信越支部シンポジウム
    • Related Report
      2019 Annual Research Report
  • [Presentation] RFIDシステムを用いたタンジブルなプログラミングツールを共有する学びのプロセス2019

    • Author(s)
      本吉達郎,大山才貴,澤井圭,増田寛之,高木昇
    • Organizer
      計測自動制御学会システム・情報部門学術講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] RFIDシステムを用いたタンジブルなプログラミングツールを共有する学びのプロセス2019

    • Author(s)
      大山才貴,本吉達郎,澤井圭,増田寛之,高木昇
    • Organizer
      ヒューマンインタフェースシンポジウム
    • Related Report
      2019 Annual Research Report
  • [Presentation] 視覚障がい児童生徒に投げたボールの運動を仮想触覚体験させるひとつの試み2019

    • Author(s)
      荒木智行,鈴木貴,高木昇
    • Organizer
      日本学術振興会平成30年度科学研究費補助金等による研究集会,情報アクセシビリティをめぐる諸問題に関する研究集会
    • Related Report
      2018 Annual Research Report
  • [Presentation] Development of Audio Tactile Graphics System Using iPhone and Efficiency Evaluation2018

    • Author(s)
      Yuta Hashimoto and Noboru Takagi
    • Organizer
      Proceedings of International Forum on Multimedia and Image Processing, World Automation Congress
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] High Speed Image Retrieval Method Executable on Smartphones: Toward Vision Assistance for Blind People2018

    • Author(s)
      Noboru Takagi and Yuichiro Mori
    • Organizer
      Proceedings of IEEE International Conference on Systems, Man, and Cybernetics
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Development of Audio-Tactile Graphic System Aimed at Facilitating Access to Visual Information for Blind People2018

    • Author(s)
      Yuta Hashimoto and Noboru Takagi
    • Organizer
      Proceedings of IEEE International Conference on Systems, Man, and Cybernetics
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Finger Movements in Blind Individuals While Touching Tactile Graphics2018

    • Author(s)
      Noboru Takagi and Yuichiro Mori
    • Organizer
      Proceedings of Joint 10th International Conference on Soft Computing and Intelligent Systems and 19th International Symposium on Advanced Intelligent Systems
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Development of Audio Tactile Graphics System Using iPhone and Efficacy Evaluation2018

    • Author(s)
      Yuta Hashimoto and Noboru Takagi
    • Organizer
      Proceedings of Joint 10th International Conference on Soft Computing and Intelligent Systems and 19th International Symposium on Advanced Intelligent Systems
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Assistive Technology for the Visually Impaired Based on Image Processing2018

    • Author(s)
      Noboru Takagi
    • Organizer
      World Automation Congress
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Vison Assistance for Blind People Based on Smartphones2018

    • Author(s)
      Noboru Takagi
    • Organizer
      International Conference on Machine Learning and Cybernetics
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 視覚障碍者の作図を支援するシステム開発の研究2018

    • Author(s)
      張放,高木昇
    • Organizer
      日本知能情報ファジィ学会 第34回ファジィシステムシンポジウム
    • Related Report
      2018 Annual Research Report
  • [Presentation] 触図触察動作解析と能率的な触図触察に関する研究2018

    • Author(s)
      橋本勇太,高木昇
    • Organizer
      日本知能情報ファジィ学会 第34回ファジィシステムシンポジウム
    • Related Report
      2018 Annual Research Report
  • [Presentation] 音声による触図触察支援システムのUI検討2018

    • Author(s)
      立野貴梨,高木昇
    • Organizer
      日本知能情報ファジィ学会 第27回北信越支部&第25回人間共生システム研究会
    • Related Report
      2018 Annual Research Report

URL: 

Published: 2018-04-23   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi