Project/Area Number |
18K18517
|
Research Category |
Grant-in-Aid for Challenging Research (Exploratory)
|
Allocation Type | Multi-year Fund |
Review Section |
Medium-sized Section 2:Literature, linguistics, and related fields
|
Research Institution | National Institute of Technology, Toyota College |
Principal Investigator |
KIMURA Tsutomu 豊田工業高等専門学校, 情報工学科, 教授 (80225044)
|
Co-Investigator(Kenkyū-buntansha) |
神田 和幸 国立民族学博物館, 人類基礎理論研究部, 外来研究員 (70132123)
|
Project Period (FY) |
2018-06-29 – 2023-03-31
|
Project Status |
Completed (Fiscal Year 2022)
|
Budget Amount *help |
¥5,200,000 (Direct Cost: ¥4,000,000、Indirect Cost: ¥1,200,000)
Fiscal Year 2020: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2019: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2018: ¥2,600,000 (Direct Cost: ¥2,000,000、Indirect Cost: ¥600,000)
|
Keywords | 手話認識 / 手話辞書 / ディープラーニング / 深層学習 / 手話学習 / 手話文章 / 手話 / 認識 / 辞書 / オンライン |
Outline of Final Research Achievements |
We have developed an online sign language dictionary system with a sign language recognition function. The system is designed to be used through a web browser. When a user performs a sign language gesture using a webcam, the system recognizes it and displays a list of candidate words. When the user clicks on a word, a sample video is played back for confirmation. Currently, the system can recognize 175 words. Furthermore, we are currently developing a sign language learning system by incorporating the sign language word recognition engine developed in this research. These systems will be released to the public in FY2023.
|
Academic Significance and Societal Importance of the Research Achievements |
手話を学習するためには,手話サークルに通うなど,対面で習う必要がある.テレビなどでも学習できるが,自身の手話が相手に伝わるかどうかはわからない.英語学習であれば,音声認識を使ったシステムもあるが,手話にはそれがなかった.本研究は,手話学習者に大いに役立てると考えている.さらに,本研究で開発した手話認識用学習ネットワークは,単語だけでなく,手話文,指文字にも利用できる.今後,手話認識システムの開発にも応用できる.
|