• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of Smart Terminal with Finger-tracing Reading Function aimed at Eliminating the Digital Divide of Visually Impaired People

Research Project

Project/Area Number 18H03563
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 90150:Medical assistive technology-related
Research InstitutionNational Institute of Technology, Kumamoto College

Principal Investigator

KIYOTA KIMIYASU  熊本高等専門学校, 企画運営部, 教授 (80186353)

Co-Investigator(Kenkyū-buntansha) 石橋 孝昭  熊本高等専門学校, 電子情報システム工学系TEグループ, 准教授 (60455178)
伊藤 和之  国立障害者リハビリテーションセンター(研究所), 自立支援局(研究所併任), 主任教官 (10501091)
藤澤 和子  大和大学, 保健医療学部, 教授 (30739420)
Project Period (FY) 2018-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥12,610,000 (Direct Cost: ¥9,700,000、Indirect Cost: ¥2,910,000)
Fiscal Year 2020: ¥3,510,000 (Direct Cost: ¥2,700,000、Indirect Cost: ¥810,000)
Fiscal Year 2019: ¥2,730,000 (Direct Cost: ¥2,100,000、Indirect Cost: ¥630,000)
Fiscal Year 2018: ¥6,370,000 (Direct Cost: ¥4,900,000、Indirect Cost: ¥1,470,000)
Keywords視覚障碍者 / 中途失明 / デジタルデバイド / スマート端末 / 画面読み上げ機能 / 読書き支援 / タブレット端末 / 音声読み上げ / 読み書き支援技術 / 視覚障害者 / 触読機能
Outline of Final Research Achievements

Since people with intermediate vision impairment were able to read documents before they lost their sight, we thought that if we could create an environment where people could directly trace and read documents displayed on a smart terminal (virtual tactile reading), text documents arranged in two dimensions could be efficiently read diagonally at high speed, even by people with visual impairment. We developed "Touch Talker" system that reads the text on the screen at the bottom of the finger tracing with voice. As a result of a comparison and verification of which of the two systems was faster in finding the desired information, using the developed system or using a digital recording device, five blindfolded sighted subjects were able to find the desired information in less time using the trace reading function, confirming the effectiveness of the proposed method.

Academic Significance and Societal Importance of the Research Achievements

急な疾病や交通事故などが原因で突発的に失明の状態にさらされた視覚障害者は、何を頼りに文書情報を取り扱うことができるだろうか。本研究は、視覚情報を失った障害者が、デジタル録音機等を利用しなくても、「指なぞり」した場所にあるテキスト情報を自動音声で読み上げるスマート端末を実現した。タブレット画面上に表示された膨大なテキスト文書から,任意の画面上を「指なぞり」することにより当該位置にある文章を音声で読み上げる新機能を実装した”Touch Talker"を開発した。この機能の実現により、理療教育機関や鍼灸医療機関に就業を志す点字の修得が困難な中途視覚障害者の「読み書き」を支援することが可能となった。

Report

(4 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • Research Products

    (19 results)

All 2021 2020 2019 2018 Other

All Journal Article (4 results) (of which Peer Reviewed: 4 results) Presentation (12 results) (of which Int'l Joint Research: 6 results) Remarks (2 results) Patent(Industrial Property Rights) (1 results)

  • [Journal Article] 全国KOSEN支援機器開発ネットワーク(KOSEN-ATネット)によるAT技術者教育2020

    • Author(s)
      清田公保、浜克己
    • Journal Title

      日本高専学会誌

      Volume: 第25巻、第1号 Pages: 45-48

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Smartphone Application Program of Obstacle Detection for Visually Impaired People2019

    • Author(s)
      Manabu Shimakawa, Issei Taguchi, Chiharu Okuma、Kimiyasu Kiyota
    • Journal Title

      ICIC Express, Part B: Applications

      Volume: Vol.10, No.3 Pages: 219-226

    • NAID

      40021897094

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Smartphone Application Program of Obstacle Detection for Visually Impaired People2019

    • Author(s)
      Manabu Shimakawa, Issei Taguchi, Chiharu Okuma and Kimiyasu Kiyota
    • Journal Title

      ICIC Express, Part B: Applications

      Volume: Vol.10 Pages: 219-226

    • NAID

      40021897094

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 全国KOSEN支援機器開発ネットワーク(KOSEN-AT)によるAT技術者育成の取組2018

    • Author(s)
      清田公保
    • Journal Title

      情報処理学会、学会誌

      Volume: Vol.59、No.10 Pages: 939-942

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Presentation] Smartphone Apps for Visually Impaired that Detects Obstacles and Obtains those Distances2021

    • Author(s)
      Manabu Shimakawa, Naho Minami, Chiharu Okuma, Kimiyasu Kiyota
    • Organizer
      ICIAE2021
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 中途視覚障害者のデジタルデバイド解消のための 指なぞり音読機能付スマート端末の基本構想2020

    • Author(s)
      清田公保、石橋孝昭、 藤澤和子、伊藤和之
    • Organizer
      日本福祉工学会九州支部大会2021
    • Related Report
      2020 Annual Research Report
  • [Presentation] Development of a Standalone Color Identification Device to Support the Independence of the Visually-Impaired2019

    • Author(s)
      Atsushi Sasaki, Hirotoshi Honma, Hideki Satoh, Kimiyasu Kiyota, Mamoru Sakaki
    • Organizer
      PROCEEDINGS 7th International Conference on Applied Computing and Information Technology (ACIT 2019) ,pp.81-86
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Pen-based Smart Tablet with Finger-tracing Reading for People with Visual Disabilities2019

    • Author(s)
      Kimiyasu Kiyota, Takaaki Ishibashi, Manabu Shimakawa, Hiroshi Kuribayasi, Kazuyuki Itou, Kazuko Fujisawa
    • Organizer
      PROCEEDINGS 7th International Conference on Applied Computing and Information Technology (ACIT 2019) ,pp.87-92
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Remote Controllable Supporting Device for Deaf;blind Person using Handwritten Character2019

    • Author(s)
      Mitsutaka Nakano, Kazuhiro Koshi, Jin Akaishi, Kimiyasu Kiyota
    • Organizer
      PROCEEDINGS 7th International Conference on Applied Computing and Information Technology (ACIT 2019) ,pp.117-122
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Smartphone Apps of Obstacle Detection for Visually Impaired and its Evaluatio2019

    • Author(s)
      Manabu Shimakawa, Kosei Matsushita, Issei Taguchi, Chiharu Okuma, Kimiyasu Kiyota
    • Organizer
      PROCEEDINGS 7th International Conference on Applied Computing and Information Technology (ACIT 2019) ,pp.148-154
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 視覚障害者のための指なぞり読み音声読み上げシステムの開発2019

    • Author(s)
      井銅主税、清田公保、島川学、石橋孝昭、伊藤和之、藤澤和子
    • Organizer
      日本福祉工学会九州支部大会、pp.14-15
    • Related Report
      2019 Annual Research Report
  • [Presentation] ユビキタスコミュニケーションツールとしてのモールス符号再発見2019

    • Author(s)
      西山英治、清田公保
    • Organizer
      日本福祉工学会九州支部大会、pp.22-23
    • Related Report
      2019 Annual Research Report
  • [Presentation] 視覚障害者のための障害物検出スマホアプリとその評価2019

    • Author(s)
      島川学、松下恒星、田口一精、大隈千春清田公保
    • Organizer
      日本福祉工学会九州支部大会、pp.16-17
    • Related Report
      2019 Annual Research Report
  • [Presentation] Smartphone Application Program of Obstacle Detection for Visually Impaired People2018

    • Author(s)
      Manabu Shimakawa, Issei Taguchi, Chiharu Okuma and Kimiyasu Kiyota
    • Organizer
      13th International Conference on Innovative Computing, Information and Congtrol
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 障害物検出のための転移学習を用いた画像認識モデルの作成と検証2018

    • Author(s)
      松下恒星、田口一精、島川学、清田公保
    • Organizer
      第17回電子情報系高専フォーラム
    • Related Report
      2018 Annual Research Report
  • [Presentation] 機械学習を用いた視覚障害者の歩行支援のための周辺状況認識スマホアプリ2018

    • Author(s)
      島川学、松下恒星、田口一精、大隈千春、清田公保
    • Organizer
      第22回日本福祉工学会学術講演会
    • Related Report
      2018 Annual Research Report
  • [Remarks] 高専ATネットワーク

    • URL

      https://en.kosen-at.com/

    • Related Report
      2020 Annual Research Report
  • [Remarks] KOSENの技術を、未来のATに!

    • URL

      http://kosen-at.kumamoto-nct.ac.jp/

    • Related Report
      2019 Annual Research Report
  • [Patent(Industrial Property Rights)] 視線領域推定による意思表示支援システム2020

    • Inventor(s)
      柴里弘毅、清田公保、中島勝幸
    • Industrial Property Rights Holder
      柴里弘毅、清田公保、中島勝幸
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2021-012093
    • Filing Date
      2020
    • Related Report
      2020 Annual Research Report

URL: 

Published: 2018-04-23   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi