Natural user interface for developmental support of visual-cognitive functions in persons with severe physical and intellectual disabilities

• Project/Area Number: 16H03072
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Educational technology
• Research Institution: Tokyo Gakugei University
• Principal Investigator: KOBAYASHI Iwao 東京学芸大学, 教育実践研究支援センター, 教授 (90305300)
• Research Collaborator: SATO kiwamu ; NUNOKAWA hiroshi ; UCHIDA takahiro ; INADA takemi
• Project Period (FY): 2016-04-01 – 2019-03-31
• Project Status: Completed (Fiscal Year 2018)
• Budget Amount: ¥17,030,000 (Direct Cost: ¥13,100,000、Indirect Cost: ¥3,930,000); Fiscal Year 2018: ¥2,990,000 (Direct Cost: ¥2,300,000、Indirect Cost: ¥690,000); Fiscal Year 2017: ¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000); Fiscal Year 2016: ¥9,880,000 (Direct Cost: ¥7,600,000、Indirect Cost: ¥2,280,000)
• Keywords: 教育工学 / ユーザインタフェース / 重度重複障害 / 認知発達 / 視線計測 / アイトラッカー

Outline of Final Research Achievements

This study examined information systems based on a natural user interface (NUI) including an eye-tracking system to support the development of visual-cognitive functions and activities in persons with severe physical and intellectual disabilities. Research was conducted from two perspectives: educational-psychological examination of user evaluations and educational-technological examination of system structures and programs of learning. In the former, multiple evaluation methods were surveyed from three perspectives. The methods were used for system uses of 10 users. In the latter, implementations and trials were conducted of both low-cost systems and systems with a pacesetting function. Educational effects and possibilities of the systems were confirmed.

Academic Significance and Societal Importance of the Research Achievements

重度重複障害児（者）を対象としたアイトラッカーの教育的活用は国内でも注目を集めてきているが、活用前後の視覚認知や視覚の活用に関する評価は必ずしも十分ではない。本研究により３つの観点による多角的な評価手法が検討され、今後の教育現場での活用が期待される。ローコストのシステムの検討では、教育関係者による導入の負担軽減に配慮したパッケージ教材が作成され、教育現場での実用的な活用の一助となると考えられる。また、先導的なシステムの検討は、より未来的・発展的な技術開発の可能性を示すことができたといえる。

Research Products

• [Journal Article] Calibration-free eye-tracking system in education for students with severe physical and intellectual disabilities (2018)
  • Author(s): Kobayashi, I., Sato, K., Chiba, N., Nunokawa, H., & Uchida, T.
  • Journal Title: Proceedings of 2018 IEEE TALE Volume: ― Pages: 1169-1171
  • DOI: 10.1109/tale.2018.8615194
  • Peer Reviewed / Open Access
• [Journal Article] Educational material kits using a low-cost eye-tracking device for students with severe physical impairments (2018)
  • Author(s): Kobayashi, I.
  • Journal Title: Journal of Applied Research in Intellectual Disabilities Volume: 31(4) Issue: 4 Pages: 629-629
  • DOI: 10.1111/jar.12476
  • Peer Reviewed / Open Access
• [Presentation] Methods of evaluating visual functions and activities of students with severe physical disabilities before and after training using an eye-tracking system (2019)
  • Author(s): Kobayashi, I., Uchida, H., & Inada, T.
  • Organizer: IASSIDD World Congress 2019
  • Int'l Joint Research
• [Presentation] Educational material kits using a low-cost eye-tracking device for students with severe physical impairments (2018)
  • Author(s): Kobayashi, I.
  • Organizer: 5th International IASSIDD Europe Congress
  • Int'l Joint Research
• [Presentation] Calibration-free eye-tracking system in education for students with severe physical and intellectual disabilities (2018)
  • Author(s): Kobayashi, I., Sato, K., Chiba, N., Nunokawa, H., & Uchida, T.
  • Organizer: IEEE TALE 2018
  • Int'l Joint Research
• [Presentation] Educational material kits using a low-cost eye-tracking device for students with severe physical impairments (2018)
  • Author(s): Kobayashi, I.
  • Organizer: The 5th IASSIDD Europe Congress
  • Int'l Joint Research
• [Presentation] ＡＴを利活用した取組～ＡＴ活用委員会での活動～ (2017)
  • Author(s): 稲田健実
  • Organizer: 第63回全国肢体不自由教育研究協議会山口大会