• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Support system of active learning for hearing impaired student by using 360 degree camera

Research Project

Project/Area Number 26350300
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Educational technology
Research InstitutionKinjo College

Principal Investigator

Seto Shuichi  金城大学短期大学部, その他部局等, 教授 (90196973)

Co-Investigator(Renkei-kenkyūsha) KAWABE HIROYUKI  金城大学, 社会福祉学部, 教授 (60249167)
SHIMOMURA YUUKO  金城大学, 社会福祉学部, 教授 (70171006)
NAMBO HIDETAKA  金沢大学, 電子情報学系, 講師 (30322118)
Project Period (FY) 2014-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥3,770,000 (Direct Cost: ¥2,900,000、Indirect Cost: ¥870,000)
Fiscal Year 2016: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2015: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2014: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Keywordsアクティブラーニング / 発話検出 / 聴覚障害学生 / 支援システム / パノラマカメラ
Outline of Final Research Achievements

In this study, we cut out the face of a student sitting on a seat in a hearing impaired student and tried to detect the speaker from the mouth image. Hearing impaired students became possible to participate in active learning class through transparent HMD and found that it is effective for identifying speakers.
The probability that the speaker detection result could be correctly recognized as utterance during utterance from the mouth image by the method of inertia moment was 28.6%, and the probability of misrecognition when not speaking was 16.5%. It is understood that the recognition rate is still low, subjects tend not to speak with a big mouth opened, and there are many misrecognition as there are many laughs and nods etc.
In the future there is a necessity to study HMD which can be used without incongruous feeling even for wearing for a long time, and also to study natural language analysis by speech recognition at the same time

Report

(4 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Research-status Report
  • 2014 Research-status Report
  • Research Products

    (6 results)

All 2016 2015 2014

All Journal Article (2 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 2 results,  Acknowledgement Compliant: 2 results) Presentation (4 results) (of which Int'l Joint Research: 1 results)

  • [Journal Article] Support system of active learning for hearing impaired student by using head mounted display2016

    • Author(s)
      瀬戸就一、川邊弘之、下村有子、南保英孝
    • Journal Title

      Proceedings of the Asia Pacific Industrial Engineering & Management Systems

      Volume: なし

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Support system to active learning for hearing impaired student2015

    • Author(s)
      Shuichi Seto, Hiroyuki Kawabe, Yuko Shimomura, Hiroshi Arai , Hidetaka Nambo
    • Journal Title

      Proceedings of the Asia Pacific Industrial Engineering & Management Systems

      Volume: 無し Pages: 326-329

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] Support system of active learning for hearing impaired student by using head mounted display2016

    • Author(s)
      瀬戸就一、川邊弘之、下村有子、南保英孝
    • Organizer
      Proceedings of the Asia Pacific Industrial Engineering & Management Systems Conference 2016
    • Place of Presentation
      台湾、台北市
    • Year and Date
      2016-12-07
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 聴覚障害学生のための授業参加支援システム -口唇の動きによる話者の決定-2015

    • Author(s)
      瀬戸就一,川辺弘之,下村有子,南保英孝,新井浩
    • Organizer
      2015年日本設備管理学会秋季研究発表大会
    • Place of Presentation
      石川県金沢市
    • Year and Date
      2015-11-26
    • Related Report
      2015 Research-status Report
  • [Presentation] 聴覚障害学生のアクティブラーニング参加支援システム-パノラマカメラによる話者の検出-2014

    • Author(s)
      瀬戸就一、川辺弘之、下村有子、南保英孝
    • Organizer
      大学ICT推進協議会
    • Place of Presentation
      宮城県仙台市
    • Year and Date
      2014-12-10 – 2014-12-12
    • Related Report
      2014 Research-status Report
  • [Presentation] Detection of speaker by a lip motion for hearing impaired student2014

    • Author(s)
      瀬戸就一、川辺弘之、下村有子、南保英孝
    • Organizer
      APIEMS2014
    • Place of Presentation
      Jeju, Republic of Korea
    • Year and Date
      2014-10-12 – 2014-10-15
    • Related Report
      2014 Research-status Report

URL: 

Published: 2014-04-04   Modified: 2018-03-22  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi