2022 Fiscal Year Final Research Report
Research on Web-Based Manual Speech-to-Text Captioning using Mobile Devices for Deaf or Hard of Hearing
| Project/Area Number |
19K02996
|
|---|
| Research Category |
Grant-in-Aid for Scientific Research (C)
|
| Allocation Type | Multi-year Fund |
|---|
| Section | 一般 |
|---|
| Review Section |
Basic Section 09070:Educational technology-related
|
|---|
| Research Institution | Tsukuba University of Technology |
|---|
Principal Investigator |
|
|---|
| Project Period (FY) |
2019-04-01 – 2023-03-31
|
| Keywords | 遠隔情報保障 / 聴覚障害 / 文字通訳 / モバイル端末 / ウェブアプリケーション / 音声認識 |
|---|
| Outline of Final Research Achievements |
I have developed a Web-based system for manual speech-to-text captioning, which is one of information support methods for deaf or hard of hearing (DHH) . Without the need for specialized applications, users and captioners can easily view and generate text caption using only a web browser on a mobile terminal. In addition, by leveraging speech recognition, I have implemented features to support the skills of captioners. Furthermore, a hybrid caption that can insert images into the text caption was implemented, and the user's learning behavior and learning effects were clarified.
As results that were not included in the original plan, we proposed a method for non-professional captioners and a new captioning method for on-demand video content, and examined its effectiveness.
|
| Free Research Field |
ヒューマンインタラクション，知能情報学，教育工学，学習支援システム，通信工学
|
| Academic Significance and Societal Importance of the Research Achievements |
本研究は，文字通訳の専門性や，人材確保とその養成の課題を解決するために，モバイル端末の特性を活かした次世代の文字通訳を提案するものである．提案法をcaptiOnline4として実装し，ウェブブラウザのみでの文字通訳を実現した．ネットワークや情報機器の専門知識が不要となり，誰でもオンライン文字通訳を容易に利用できるようになった．音声認識を活用した文字通訳者間の連絡や，聞き溜めのサポートも可能にした．これらの成果によって，文字通訳者に求められる技能の敷居を下げることができ，先に挙げた課題解決の一助になったと考える．captiOnline4は，令和4年度末で320を超える団体に利用するまでに至った．
|
