• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of Remote Learning Support System with the Eye-Gaze-Type Robot to Reduce Overload of Long-Term Absent Students

Research Project

Project/Area Number 19H04228
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 62030:Learning support system-related
Research InstitutionEhime University

Principal Investigator

Karita Tomonori  愛媛大学, 教育学部, 教授 (40363189)

Co-Investigator(Kenkyū-buntansha) 穆 盛林  愛媛大学, 理工学研究科(工学系), 講師 (00709818)
柴田 論  愛媛大学, 理工学研究科(工学系), 教授 (10263956)
樫木 暢子  愛媛大学, 教育学部, 教授 (10635858)
山本 智規  愛媛大学, 社会共創学部, 教授 (30380257)
中野 広輔  愛媛大学, 教育学部, 教授 (60735330)
Project Period (FY) 2019-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥17,290,000 (Direct Cost: ¥13,300,000、Indirect Cost: ¥3,990,000)
Fiscal Year 2021: ¥5,460,000 (Direct Cost: ¥4,200,000、Indirect Cost: ¥1,260,000)
Fiscal Year 2020: ¥6,110,000 (Direct Cost: ¥4,700,000、Indirect Cost: ¥1,410,000)
Fiscal Year 2019: ¥5,720,000 (Direct Cost: ¥4,400,000、Indirect Cost: ¥1,320,000)
Keywordsアバターロボット / 遠隔学習支援システム / Kinectセンサー / 教師の指さし動作 / 視線を用いた操作 / Kinect センサー / 長期欠席児 / 視線入力型ロボット / ユーザビリティ / 遠隔操作ロボット / ユーザーアシスト機能 / 視線入力装置 / 生理反応 / 3Dアバター / アクセシビリティ
Outline of Research at the Start

研究代表者らは,視線入力型クライアント端末と遠隔操作ロボットを適用し,不登校や病気を理由に長期欠席状態にある児童生徒(長期欠席児)の遠隔学習支援システム(どこでも教室)の基盤技術を開発した。視線入力型端末は病気療養時にも利用できるバリアフリーな入力方式であるが,既存の視線入力方式ではユーザーが心身の過重負荷を感じることが明らかになった。本研究課題では基盤技術を発展させ,長期欠席児の過重負荷を軽減する視線入力型ロボットによる遠隔学習支援システム(改良版どこでも教室)を開発し,その効果を科学的に評価する。

Outline of Final Research Achievements

We aimed to develop the remote learning support system, which is equipped with functions that reduce the user's overload and enhances the presence of two-way communication, for long absence students and the following results were achieved: 1) We developed a user assist function to reduce the user's operational load by adding an input system triggered by a physiological reaction to the line-of-sight input device. 2) We developed a function to display a 3D avatar on the monitor of a remote-controlled robot, and found factors to make the avatar's movement be like a human. 3) We developed a function to zoom the place pointed by a teacher and revealed the parameters desirable for the students, and the teacher gave a positive evaluation to the function.

Academic Significance and Societal Importance of the Research Achievements

長期欠席児の学習機会を確保するには、①長期欠席児自身が臨場感を感じて、かつ教員も習熟度や理解度等を実感・把握でき、②長期欠席児のプライバシーや心身の過重負荷を考慮してバリアフリーなユーザーインタフェースを有した、双方向コミュニケーション型の遠隔学習支援システムの実現が喫緊の課題である。本研究によって開発された遠隔学習支援システムでは、①長期欠席児の表情と連動した3Dアバターを表示する遠隔操作ロボットを教室に配置し、②ハンズフリー(眼球運動、生理反応)で操作できる機能や授業理解支援の機能(教員の指さし位置を自動拡大)により長期欠席児の過重負荷を軽減することで、長期欠席児の学習機会を補完できる。

Report

(4 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Annual Research Report
  • 2019 Annual Research Report
  • Research Products

    (14 results)

All 2022 2021 2020 2019

All Journal Article (5 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 5 results,  Open Access: 1 results) Presentation (9 results) (of which Int'l Joint Research: 4 results)

  • [Journal Article] Study on Eye-gaze Input Interface based on Deep Learning using Images Obtained by Multiple Cameras2022

    • Author(s)
      Shenglin Mu, Satoru Shibata, Kuo-chun Chiu, Tomonori Yamamoto, Tung-kuan Liu
    • Journal Title

      Computers and Electrical Engineering

      Volume: -

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Eye-Interface System Using Convolutional Neural Networks for People with Physical Disabilities2021

    • Author(s)
      Keiichiro Kubo, Satoru Shibata, Tomonori Karita, Tomonori Yamamoto, Shenglin Mu
    • Journal Title

      EAI/Springer Innovations in Communication and Computing 4th EAI International Conference on Robotic Sensor Networks

      Volume: - Pages: 81-91

    • DOI

      10.1007/978-3-030-70451-3_7

    • ISBN
      9783030704506, 9783030704513
    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 視線入力によるパソコン操作時に直面する「使いにくさ」の評価2020

    • Author(s)
      嚴筵景,苅田知則,八木良広,穆盛林,柴田論
    • Journal Title

      日本福祉工学会誌

      Volume: 22巻 Pages: 7-15

    • NAID

      40022271517

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 教師の指さし動作認識に基づく生徒の遠隔授業参加支援2020

    • Author(s)
      嚴筵景,柴田論,穆盛林,苅田知則,大森孝哉
    • Journal Title

      産業応用工学会論文誌

      Volume: 8巻 Issue: 2 Pages: 250-259

    • DOI

      10.12792/jjiiae.8.2.250

    • NAID

      130007904913

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] 眼鏡着用を考慮した視線方向推定に関する一構成法2019

    • Author(s)
      柴田 論,穆 盛林,嚴 筵景,苅田 知則
    • Journal Title

      日本福祉工学会誌

      Volume: 21 (2) Pages: 47-53

    • NAID

      40022103996

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Presentation] 長期欠席児のための指さし拡大機能を搭載した遠隔授業支援システムのフィールド調査報告2022

    • Author(s)
      戸谷 彰宏・苅田 知則・Von Ralph Dane Marquez Herbuela・柴田 論・穆 盛林・山本 智規
    • Organizer
      第189回ヒューマンインタフェース学会研究会
    • Related Report
      2021 Annual Research Report
  • [Presentation] Kinect camera sensor-based pointing motion recognition with magnification function to increase concentration among children during remote classes.2021

    • Author(s)
      Herbuela, V.R.D.M., Eom, Y., Karita, T., Wada, Y., Shibata, S., Mu, S., Omori, T.
    • Organizer
      4th International Conference on Advanced Research in Education, Teaching, and Learning (ARETL)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Kinect camera sensor-based pointing motion recognition and magnification function to stimulate and maintain the concentration among children during remote classes.2021

    • Author(s)
      Herbuela, V.R.D.M., Eom, Y., Karita, T., Wada, Y., Shibata, S., Mu, S.
    • Organizer
      ICDE Virtual Global Conference Week 2021: Upskilling and upscaling for quality Open, Flexible and Distance Learning (OFDL)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 教師の指さし認識に基づく遠隔授業参加支援2020

    • Author(s)
      樫葉巧,柴田論,穆盛林,嚴筵景,苅田知則
    • Organizer
      電子情報通信学会技術研究報告
    • Related Report
      2020 Annual Research Report
  • [Presentation] 視線入力を用いた全方向移動型アバターロボットの運動生成2020

    • Author(s)
      則安玲音, 柴田 論, 穆 盛林, 苅田知則, 大森孝哉
    • Organizer
      電子情報通信学会技術研究報告
    • Related Report
      2020 Annual Research Report
  • [Presentation] 授業参加のための視線入力によるアバターロボットの操作2020

    • Author(s)
      則安玲音,穆盛林,柴田論
    • Organizer
      令和2年度SICE四国支部学術講演会
    • Related Report
      2020 Annual Research Report
  • [Presentation] 遠隔操作ロボットによる長期欠席児の授業参加支援システム2020

    • Author(s)
      樫葉巧,柴田論,穆盛林
    • Organizer
      令和2年度SICE四国支部学術講演会
    • Related Report
      2020 Annual Research Report
  • [Presentation] Class Participation Support System on an Avatar Robot for Long-term Absent Students2019

    • Author(s)
      Yeonkyung Eom, Koudai Furukawa, Satoru Shibata, Shenglin Mu and Tomonori Karita
    • Organizer
      IEEE 8th Global Conference on Consumer Electronics (GCCE)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Method to Estimate Eye Gaze Direction When Wearing Glasses2019

    • Author(s)
      Yeonkyung Eom, Shenglin Mu, Satoru Shibata, and Tomonori Karita
    • Organizer
      International Conference on Technologies and Applications of Artificial Intelligence (TAAI)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research

URL: 

Published: 2019-04-18   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi