• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

The Practical Study of the Real-time Captioning System Using Automatic Speech Recognition Technology in order to Support Students with Hearing Impairment

Research Project

Project/Area Number 16530617
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Special needs education
Research InstitutionThe University of Tokyo

Principal Investigator

FUKUSHIMA Satoshi  The University of Tokyo, Research Center for Advanced Science and Technology, Associate Professor, 先端科学技術研究センター, 助教授 (50285079)

Co-Investigator(Kenkyū-buntansha) IFUKUBE Tohru  The University of Tokyo, Research Center for Advanced Science and Technology, Professor, 先端科学技術研究センター, 教授 (70002102)
INO Shuichi  The University of Tokyo, Research Center for Advanced Science and Technology, Associate Professor, 先端科学技術研究センター, 助教授 (70250511)
KANAZAWA Takayuki  The University of Gunma, Department of special Education, Faculty of Education, Associate Professor, 教育学部, 助教授 (50323324)
MAKIHARA Tsutomu  The University of Gunma, Center for International studies, Associate Professor, 留学生センター, 助教授 (20332562)
KUROKI Hayato  The University of Tokyo, Research Center for Advanced Science and Technology, Specially Appointed Research Associate, 先端科学技術研究センター, 科学技術振興特任教員(特任助手) (00345159)
森 壮也  独立行政法人日本貿易振興機構アジア経済研究所, 開発研究センター, 副主任研究員
Project Period (FY) 2004 – 2005
Project Status Completed (Fiscal Year 2005)
Budget Amount *help
¥3,600,000 (Direct Cost: ¥3,600,000)
Fiscal Year 2005: ¥900,000 (Direct Cost: ¥900,000)
Fiscal Year 2004: ¥2,700,000 (Direct Cost: ¥2,700,000)
Keywordsthe Real-time captioning system / students with a hearing impairment / access service / higher education / support services to remote locations / 中間支援者
Research Abstract

H16
1 Development of the real-time captioning system using automatic speech recognition technology which was adapted for the lecture of a university
(1) We employed the system which is repeated in a remote place and corrected in a classroom so that it might become the system suitable for the lecture of a university.
(2) In the actual employment scene of a system, we recorded the reaction of a middle supporter and a student with hearing impairment on video, and analyzed it.
As a result, it turned out that it is difficult that a middle supporter performs to correct a title and to offer circumference information together.
(3) In order to carry out regular use of the real-time captioning system at a university, we tried use of improvement of a check sheet, a network camera, etc.
2 Examination of the legible title display method
We devised the method of carrying out title presentation that it is easier to understand quickly, when a middle supporter made correction of a title.
H17
1 Analysis of the e … More ase of understanding of a caption 1
(1) About the text including audio incorrect recognition, we classified into what an original meaning tends to guess, and what has a difficult analogy, and analyzed the difference.
(2) We understood it is difficult for the student with hearing impairment to guess the meaning of the sentence including the mistake of the phonemic change.
2 Analysis of the ease of understanding of a caption 2
It was guessed that the grammatical misuses and the omission of the voice element like the intonation etc. of the spoken language caused difficulty.
3 Execution of the repetition work by the intramural staff
In order to plan simplification of a system, and low cost, we built the system by which the staff of a university works as a repetition worker.
4 Development of the program for middle supporter training
We created the work manual for middle supporters, and the manual for practice of repetition work. Moreover, carried out the middle supporter training program, and made evaluation and correction. Less

Report

(3 results)
  • 2005 Annual Research Report   Final Research Report Summary
  • 2004 Annual Research Report
  • Research Products

    (15 results)

All 2006 2005 2004

All Journal Article (15 results)

  • [Journal Article] 音声認識技術を活用した字幕呈示システムの開発研究及び運用における諸課題-利用者の観点を中心に-2006

    • Author(s)
      福島智, 中野聡子, 金澤貴之, 黒木速人, 井野秀一, 伊福部達
    • Journal Title

      群馬大学教育学部紀要 人文・社会科学編 第55巻

      Pages: 179-186

    • NAID

      120000912820

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] 音声認識技術を利用した字幕呈示システムの現状と課題-音声言語と文字言語の性質の違いに焦点をあてて-2006

    • Author(s)
      中野聡子, 牧原功, 金澤貴之, 菊池真里, 黒木速人, 井野秀一, 伊福部達, 福島智
    • Journal Title

      群馬大学教育実践研究 第23号

      Pages: 251-259

    • NAID

      40015267127

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] Some issues to study developing and practicing the Real-time captioning system using automatic speech recognition technology2006

    • Author(s)
      Fukushima, Satoshi, Nakano, Satoko, Kanazawa, Takayuki, Kuroki, Hayato, Ino, Shuichi, Ifukube, Tohru
    • Journal Title

      ANNUAL REPORTS OF THE FACULTY OF EDUCATION GUNMA UNIVERSITY Vol.55

      Pages: 179-186

    • NAID

      120000912820

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Some Issues about the Real-time Captioning System Using Automatic Speech Recognition Technology - Focusing the Difference of the Characteristics between Spoken Language and Written Language -2006

    • Author(s)
      Nakano, Satoko, Makihara, Tsutomu, Kanazawa, Takayuki, Kikuchi, Mari, Kuroki, Hayato, Ino, Shuichi, Ifukube, Tohru, Fukushima, Satoshi
    • Journal Title

      Research in Educational Practice and Development, Gunma University Vol.23,

      Pages: 251-259

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 音声認識技術を活用した高等教育機関における聴覚障害者の情報保障(1)-中間支援者の修正作業に注目して-2005

    • Author(s)
      菊池真里, 金澤貴之, 中野聡子, 黒木速人, 井野秀一, 伊福部達, 福島智
    • Journal Title

      日本特殊教育学会第43回大会論文集

      Pages: 559-559

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] 音声認識技術を活用した高等教育機関における聴覚障害者の情報保障(2)-音声言語と文字言語の性質の違いを中心とした検討-2005

    • Author(s)
      中野聡子, 牧原功, 金澤貴之, 菊池真里, 黒木速人, 井野秀一, 伊福部達, 福島智
    • Journal Title

      日本特殊教育学会第43回大会論文集

      Pages: 556-556

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] the Real-time Captioning System Using Automatic Speech Recognition Technology in order to Support Students with Hearing Impairment 1 - Focusing a middle supporter performances to correct a caption -2005

    • Author(s)
      Kikuchi, Mari, Kanazawa, Takayuki, Nakano, Satoko, Kuroki, Hayato, Ino, Shuichi, Ifukube, Tohru, Fukushima, Satoshi
    • Journal Title

      The 43rd Conference of The Japanese Association of Special Education

      Pages: 559-559

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] the Real-time Captioning System Using Automatic Speech Recognition Technology in order to Support Students with Hearing Impairment 2 - Focusing the Difference of the Characteristics between Spoken Language and Written Language -2005

    • Author(s)
      Nakano, Satoko, Makihara, Tsutomu, Kanazawa, Takayuki, Kikuchi, Mari, Kuroki, Hayato, Ino, Shuichi, Ifukube, Tohru, Fukushima, Satoshi
    • Journal Title

      The 43rd Conference of The Japanese Association of Special Education

      Pages: 556-556

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 音声同時字幕システムを用いた講義保障-音声がすぐに字幕化される-2005

    • Author(s)
      金澤貴之, 菊池真里
    • Journal Title

      聴覚障害児(者)福祉講座講演集 平成16年度

      Pages: 24-27

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 高等教育機関における聴覚障害学生のための遠隔型音声字幕化システムの活用2004

    • Author(s)
      中野聡子, 黒木速人, 井野秀一, 金澤貴之, 菊池真里, 伊福部達
    • Journal Title

      日本特殊教育学会第42回大会論文集

      Pages: 359-359

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 聴覚障害学生の情報保障手段としての音声認識システムの活用-聴覚障害学生のニーズに即したシステムの構築-2004

    • Author(s)
      菊池真里, 金澤貴之, 中野聡子, 黒木速人, 井野秀一, 伊福部達, 堀耕太郎
    • Journal Title

      日本特別ニーズ教育学会第10回記念研究大会発表要旨集

      Pages: 41-42

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] the Real-time Remote Captioning System in order to Support Students with Hearing Impairment in Higher Education2004

    • Author(s)
      Nakano, Satoko, Kuroki, Hayato, Ino, Shuichi, Kanazawa, Takayuki, Kikuchi, Mari, Ifukube, Tohru
    • Journal Title

      The 42nd Conference of The Japanese Association of Special Education

      Pages: 359-359

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] the Possibility of Using Automatic Speech Recognition Technology for Supporting Students with Hearing Impairment2004

    • Author(s)
      Kikuchi, Mari, Kanazawa, Takayuki, Nakano, Satoko, Kuroki, Hayato, Ino, Shuichi, Ifukube, Tohru, Hori, Kohtaro
    • Journal Title

      The 10th Conference of Japanese Society for Study of Special Needs Education

      Pages: 41-42

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 高等教育機関における聴覚障害学生のための遠隔型音声字幕化システムの活用2004

    • Author(s)
      中野聡子, 黒木速人, 井野秀一, 金澤貴之, 菊池真理, 伊福部達
    • Journal Title

      日本特殊教育学会 第42回大会発表論文集 特殊教育と近接領域の融合

      Pages: 359-359

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 聴覚障害学生の情報保障手段としての音声認識システムの活用-聴覚障害学生のニーズに即したシステムの構築-2004

    • Author(s)
      菊池真理, 金澤貴之, 中野聡子, 黒木速人, 井野秀一, 伊福部達, 堀耕太郎
    • Journal Title

      日本特別ニーズ教育学会 第10回記念研究大会 発表要旨集

      Pages: 41-42

    • Related Report
      2004 Annual Research Report

URL: 

Published: 2004-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi