• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Assistance for People with Visual Impairment by Recognizing Surrounding Information Using an Omnidirectional Camera

Research Project

Project/Area Number 17H01803
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent robotics
Research InstitutionOsaka Prefecture University

Principal Investigator

Iwamura Masakazu  大阪府立大学, 大学院工学研究科, 准教授 (80361129)

Project Period (FY) 2017-04-01 – 2020-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥17,680,000 (Direct Cost: ¥13,600,000、Indirect Cost: ¥4,080,000)
Fiscal Year 2019: ¥5,590,000 (Direct Cost: ¥4,300,000、Indirect Cost: ¥1,290,000)
Fiscal Year 2018: ¥5,590,000 (Direct Cost: ¥4,300,000、Indirect Cost: ¥1,290,000)
Fiscal Year 2017: ¥6,500,000 (Direct Cost: ¥5,000,000、Indirect Cost: ¥1,500,000)
Keywords視覚障害者 / 全方位カメラ / 視覚情報 / 物体検出 / 捜し物 / 深層学習 / ナビゲーション / 視覚障碍者 / トラッキング / 情報の取捨選択 / 空席検出 / 文字認識 / 物体認識 / 認識 / 検出 / 大規模情景内文字データセット / 情報工学
Outline of Final Research Achievements

In this research, we attempted to extend the conventional assistive system for the visually impaired, which allows a computer to recognize text and objects. The conventional systems have the implicit assumption that the target object or text to be recognized is right in front of the user. However, what a visually impaired person wants to know is not limited to be in front of the person. Therefore, we proposed an assistive system for "looking for something" using an omnidirectional camera as an example of a framework that can recognize objects whose location is unknown to the user. In this context, we confirmed that the omnidirectional camera is easier to use than the conventional smartphone-type camera through experiments with visually impaired people. We also proposed a regularization method called ShakeDrop for deep learning to improve the recognition accuracy of object recognition.

Academic Significance and Societal Importance of the Research Achievements

コンピュータに文字や物体を認識させて視覚障害者の目の代替を目指す試みが盛んになっている。既存の方法は、利用者である視覚障害者が目の前にあるものをスマートフォン付属のカメラで撮影して、それが何であるかを伝えるものが主流である。しかし、視覚障害者が知りたいものは目の前にあるものだけに限らないのではないか。この考えから、周囲が一度に撮影できる全方位カメラを用いたシステムを考案した。しかし、撮影範囲が増えると、認識で得られる情報も増える。時として膨大な認識結果を全て視覚障害者に伝えれば、逆に混乱を招く恐れがある。そこで本研究では、全方位カメラを用いる場合のより良い認識結果の提示方法などを検討した。

Report

(4 results)
  • 2020 Final Research Report ( PDF )
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • 2017 Annual Research Report
  • Research Products

    (11 results)

All 2020 2019 2018 2017

All Presentation (11 results) (of which Int'l Joint Research: 4 results)

  • [Presentation] タッチレスなタッチパネル操作デバイスの提案2020

    • Author(s)
      谷口 善信,岩村 雅一,黄瀬 浩一
    • Organizer
      インタラクション2020
    • Related Report
      2019 Annual Research Report
  • [Presentation] Suitable Camera and Rotation Navigation for People with Visual Impairment on Looking for Something Using Object Detection Technique2020

    • Author(s)
      Masakazu Iwamura, Yoshihiko Inoue, Kazunori Minatani, Koichi Kise
    • Organizer
      17th International Conference on Computers Helping People with Special Needs (ICCHP2020)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 視覚障碍者のための周辺情報選択システム2019

    • Author(s)
      河合隆哲, 岩村雅一, 黄瀬浩一
    • Organizer
      情報処理学会研究報告コンピュータビジョンとイメージメディア(CVIM)
    • Related Report
      2019 Annual Research Report
  • [Presentation] 全方位カメラと認識技術を用いた視覚障碍者支援システム2019

    • Author(s)
      岩村 雅一,南谷 和範,井上 慶彦,程 征,内海 ゆづ子,黄瀬 浩一
    • Organizer
      情報アクセシビリティをめぐる諸問題に関する研究集会
    • Related Report
      2018 Annual Research Report
  • [Presentation] ShakeDrop Regularization2018

    • Author(s)
      Yoshihiro Yamada, Masakazu Iwamura, Koichi Kise
    • Organizer
      Proc. 6th International Conference on Learning Representation (ICLR) Workshop
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] ResNetsに対する新たな正則化手法ShakeDropの提案2018

    • Author(s)
      山田良博, 岩村雅一, 黄瀬浩一
    • Organizer
      第21回画像の認識・理解シンポジウム(MIRU2018)予稿集
    • Related Report
      2018 Annual Research Report
  • [Presentation] 全方位カメラを用いた物体検出とトラッキング -視覚障害者支援システムの実現に向けて-2018

    • Author(s)
      井上 慶彦,岩村 雅一,黄瀬 浩一
    • Organizer
      情報処理学会研究報告コンピュータビジョンとイメージメディア(CVIM)
    • Related Report
      2018 Annual Research Report
  • [Presentation] ShakeDrop Regularization2018

    • Author(s)
      Yoshihiro Yamada, Masakazu Iwamura, Koichi Kise
    • Organizer
      International Conference on Learning Representation Workshop Track
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] ICDAR2017 Robust Reading Challenge on Omnidirectional Video2017

    • Author(s)
      Masakazu Iwamura, Naoyuki Morimoto, Keishi Tainaka, Dena Bazazian, Lluis Gomez, Dimosthenis Karatzas
    • Organizer
      14th IAPR International Conference on Document Analysis and Recognition (ICDAR)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] PyramidNetに対する新たな確率的正則化手法ShakeDropの提案2017

    • Author(s)
      山田 良博, 岩村 雅一, 黄瀬 浩一
    • Organizer
      電子情報通信学会 PRMU研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Deep Pyramidal Residual Networks with Stochastic Depth2017

    • Author(s)
      Yoshihiro Yamada, Masakazu Iwamura, Koichi Kise
    • Organizer
      画像の認識・理解シンポジウム217
    • Related Report
      2017 Annual Research Report

URL: 

Published: 2017-04-28   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi