• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of a new human-friendly input method for education by eye movement and hand action

Research Project

Project/Area Number 15300280
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Educational technology
Research InstitutionKagawa University

Principal Investigator

YAMASAKI Toshinori  Kagawa University, Faculty of Engineering, Professor, 工学部, 教授 (10036022)

Co-Investigator(Kenkyū-buntansha) HATTORI Tetsuo  Kagawa University, Faculty of Engineering, Professor, 工学部, 教授 (20218506)
TOMINAGA Hiroyuki  Kagawa University, Faculty of Engineering, Associate Professor, 工学部, 助教授 (80253251)
YAMASHITA Naoko  Kagawa University, Faculty of Education, Associate Professor, 教育学部, 助教授 (30314892)
HAYASHI Toshihiro  Kagawa University, Information Technology Center, Associate Professor, 総合情報基盤センター, 助教授 (90264142)
MATSUBARA Yukihiro  Hiroshima City University, Faculty of Information Sciences, Professor, 情報科学部, 教授 (30219472)
Project Period (FY) 2003 – 2005
Project Status Completed (Fiscal Year 2005)
Budget Amount *help
¥8,100,000 (Direct Cost: ¥8,100,000)
Fiscal Year 2005: ¥1,600,000 (Direct Cost: ¥1,600,000)
Fiscal Year 2004: ¥3,000,000 (Direct Cost: ¥3,000,000)
Fiscal Year 2003: ¥3,500,000 (Direct Cost: ¥3,500,000)
Keywordsuser interface / multimodal input / measurement of eye movement / measurement of hand action / pointing operation / eye camera / stereo camera / video tablet / 視線計測 / 入力機器 / ヒューマンインタフェース / CCDカメラ計測
Research Abstract

Possibility of pointing devices using eye movement - Eye movement information for reading documents and appreciating pictures -
Existing eye cameras are hard to use, because users must fix their heads. In this research, we introduced an improved eye camera which users can move their heads. We measured eye movements for reading documents and appreciating pictures. With regard to reading documents, the eye movement followed the document order. With regard to appreciating pictures, the eye movement concentrated into specific parts and the interesting points of users could be estimated. Through the results, it is revealed that our eye camera can be used as a pointing device which roughly indicates parts.
Measurement of writing letters using a stereo camera - Video tablet -
Computer supported writing exercise systems generally use a pen tablet. However, Tablets with special pens and special pads cannot be used with common writing materials and papers. In this research, we proposed a video tablet and evaluated it. The video tablet gets handwriting data and the process by observing them with a pair of CCD cameras (a stereo camera) on real time. We confirmed that our video tablet could be used for stroke extraction and could apply to writing materials of which the stroke width is changeable such as a brush.
Application to a multimedia style Kanji learning system for international students from Chine
International students from China who learn Japanese can use Kanji. However, Kanji used in both Chine and Japan has subtle differences in pronunciations, meanings, and letter shapes. These differences confuse Chinese students in Japanese learning. In this research, we developed a multimedia style Kanji learning system focusing on the differences of Kanji between Chinese and Japanese. In addition, we tried to adopt our new input method to the system and confirmed its effectiveness.

Report

(4 results)
  • 2005 Annual Research Report   Final Research Report Summary
  • 2004 Annual Research Report
  • 2003 Annual Research Report
  • Research Products

    (47 results)

All 2005 2004 2003 Other

All Journal Article (41 results) Publications (6 results)

  • [Journal Article] DrilLs-M : Multimedia Testing System with Operation-Style Answering-Application to Kanji Letter Shape Learning2005

    • Author(s)
      H.Tominaga, Y.Kinugasa, N.Yamashita, T.Hayashi, T.Yamasaki
    • Journal Title

      Proceedings of International Conference on Computers in Education (ICCE2005)

      Pages: 474-481

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Japanese Learning System for Chinese Native Speakers -Development of Database for Learning Kanji Which Have Difference between Chinese and Japanese -2005

    • Author(s)
      S.Lu, N.Yamashita, H.Tominaga, T.Hayashi, T.Yamasaki
    • Journal Title

      Proceedings of the Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05)

      Pages: 536-537

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Operation-Style Answering in Multimedia Testing System DrilLs-M for Kanji Letter Shape Learning2005

    • Author(s)
      Y.Kinugasa, N.Yamashita, T.Hayashi, H.Tominaga, T.Yamasaki
    • Journal Title

      Proceedings of the Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05)

      Pages: 647-649

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Video Tablet Based on Stereo Camera - Human-Friendly Handwritten Capturing System for Educational Use-2005

    • Author(s)
      M.Moriya, T.Hayashi, H.Tominaga, T.Yamasaki
    • Journal Title

      Proceedings of the Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05)

      Pages: 909-911

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Journal Article] DrilLs-M : Multimedia Testing System with Operation-Style Answering on Pen Tablet for Kanji Letter Shape Learning2005

    • Author(s)
      H.Tominaga, Y.Kinugasa, N.Yamashita, T.Hayashi, T.Yamasaki
    • Journal Title

      Proceedings of World Conference on Educational Multimedia, Hypermedia & Telecommunications (ED-MEDIA2005)

      Pages: 4686-4693

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] GoalPost : LEGO Programming Exercise Support2005

    • Author(s)
      Y.Onishi, H.Tominaga, T.Yamasaki
    • Journal Title

      Proceedings of the 2005 International Conference on Active Media Technology (AMT 2005)

      Pages: 305-306

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Interlude : Game Edutainment Materials for Dynamics Experiment Simulation2005

    • Author(s)
      Y.Hanafusa, H.Tominaga, T.Yamasaki
    • Journal Title

      Proceedings of the 2005 International Conference on Active Media Technology (AMT 2005)

      Pages: 303-304

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] DrilLs-M : Multimedia Testing System with Operation-Style Answering - Application to Kanji Letter Shape Learning2005

    • Author(s)
      H.Tominaga, Y.Kinugasa, N.Yamashita, T.Hayashi, T.Yamasaki
    • Journal Title

      Proceedings of International Conference on Computers in Education (ICCE2005)

      Pages: 474-481

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Japanese Learning System for Chinese Native Speakers - Development of Database for Learning Kanji Which Have Difference between Chinese and Japanese -2005

    • Author(s)
      Sa Lu, N.Yamashita, H.Tominaga, T.Hayashi, T.Yamasaki
    • Journal Title

      Proceedings of the Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05)

      Pages: 536-537

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] DrilLs-M : Multimedia Testing System with Operation-Style Answering on Pen Tablet for Kanji Letter Shape Learning2005

    • Author(s)
      H.Tominaga, Y.Kinugasa, N.Yamashita, T.Hayashi, T.Yamasaki
    • Journal Title

      Proceedings of World Conference on Educational Multimedia, Hypermedia & Telecommunications (ED-MEDIA 2005)

      Pages: 4686-4693

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] GoalPost : LEGO Programming Exercise Support2005

    • Author(s)
      Y.Onishi, H.Tominaga, T.Yamasaki
    • Journal Title

      Proceedings of the 2005 International Conference on Active Media Technology (AMT 2005), Japan

      Pages: 305-306

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] ステレオカメラを用いたビデオタブレットの試作2005

    • Author(s)
      大木, 富永, 林, 山崎
    • Journal Title

      教育システム情報学会30周年記念全国大会講演論文集

      Pages: 355-366

    • Related Report
      2005 Annual Research Report
  • [Journal Article] ステレオカメラを用いたビデオタブレットの試作と性能評価2005

    • Author(s)
      大木, 富永, 林, 山崎
    • Journal Title

      電子情報通信学会技術研究報告 ET2005-72

      Pages: 87-92

    • NAID

      110003486856

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 文書・絵画閲覧時の視線情報計測2005

    • Author(s)
      佐々木, 山崎, 富永, 林
    • Journal Title

      日本教育工学会第21回全国大会講演論文集

      Pages: 193-194

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 文書,絵画閲覧時における視線情報の計測と分析2005

    • Author(s)
      佐々木, 富永, 林, 山崎
    • Journal Title

      電子情報通信学会技術研究報告 ET2005-47

      Pages: 51-56

    • NAID

      110003497107

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Japanese Learning System for Chinese Native Speakers - Development of Database for Learning Kanji Which Have Difference between Chinese and Japanese -2005

    • Author(s)
      S.Lu, N.Yamashita, H.Tominaga, T.Hayashi, T.Yamasaki
    • Journal Title

      Proceedings of the Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05)

      Pages: 536-537

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 中国語と日本語の差異に着目したドリル型日本語学習システムの開発2005

    • Author(s)
      盧, 山下, 富永, 林, 山崎
    • Journal Title

      教育システム情報学会30周年記念全国大会講演論文集

      Pages: 533-534

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 中国語母語話者のための漢字学習ポイントチェッカーの設計と開発2005

    • Author(s)
      盧, 山下, 富永, 林, 山崎
    • Journal Title

      電子情報通信学会技術研究報告 ET2005-44

      Pages: 35-40

    • NAID

      110003497104

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 筆記具の動きを学ぶ体感型書き方学習システム2004

    • Author(s)
      稲見, 富永, 松原, 山崎
    • Journal Title

      電子情報通信学会論文誌(D-I) Vol.J87-D-I,No.12

      Pages: 1128-1135

    • NAID

      110003203299

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Training System for Fair Handwriting of Japanese Characters Based on On-Line Character Recognition2004

    • Author(s)
      T.Yamasaki, N.Inami
    • Journal Title

      Proceedings of World Conference on Educational Multimedia, Hypermedia & Telecommunications (ED-MEDIA 2004)

      Pages: 1692-1698

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A Support System for Japanese Language Teaching Materials Based on a Multimedia Kanji Database2004

    • Author(s)
      N.Yamashita, M.Shimada, H.Tominaga, Y.Matsubara, T.Yamasaki
    • Journal Title

      Proceedings of World Conference on Educational Multimedia, Hypermedia & Telecommunications (ED-MEDIA 2004)

      Pages: 5503-5511

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Pencil Touch Leanrning System for Japanese Handwriting Based on the Haptic Device2004

    • Author(s)
      N.Inami, H.Tominaga, Y.Matsubara, T.Yamasaki
    • Journal Title

      Transactions of the Institute of Electronics, Information, and Communication Engineers(D-I) Vol.J87-D-1, No.12

      Pages: 1128-1135

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 筆記具の動きを学ぶ体感型書き方学習システム2004

    • Author(s)
      稲見, 富永, 松原, 山崎
    • Journal Title

      電子情報通信学会論文誌 Vol.J87-DI・12

      Pages: 1128-1135

    • NAID

      110003203299

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Characters Recognition Using Vector Field and Linear Regression Model2004

    • Author(s)
      T.Izumi, T.Hattori, T.Yamasaki
    • Journal Title

      Proc.IEEE Int.Conf.Information Reuse and Integration (IRI-2004)

      Pages: 408-413

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Characters Recognition Method Based on Vector Field and Simple Linesr Regression Model2004

    • Author(s)
      T.Izumi, T.Hattori, T.Yamasaki
    • Journal Title

      Int.Symp.Communications and Information Technologies (ISCIT-2004)

      Pages: 498-503

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 中国語母語話者のための日本語学習システム-日中同漢字異議語データベース構築-2004

    • Author(s)
      盧, 山下, 林, 山崎
    • Journal Title

      電子情報通信学会教育工学研究会 ET2004-45

      Pages: 51-56

    • Related Report
      2004 Annual Research Report
  • [Journal Article] ヒューマンフレンドリーな教育用手書き文字・図形入力方式の開発-ステレオカメラを利用するビデオタブレット-2004

    • Author(s)
      守屋, 富永, 林, 山崎
    • Journal Title

      電子情報通信学会教育工学研究会 ET2004-47

      Pages: 61-66

    • NAID

      110003206478

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Training System for Fair Handwriting of Japanese Characters Based on On-Line Character Recognition2004

    • Author(s)
      T.Yamasaki, N.Inami
    • Journal Title

      World Conf.Educational Multimedia, Hypermedia & Telecommunications (ED-MEDIA2004)

      Pages: 1692-1698

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Network based training system for handwriting Japanese characters using interactive electric whiteboard2003

    • Author(s)
      N.Inami, N.Yamashita, H.Tominaga, Y.Matsubara, T.Yamasaki
    • Journal Title

      Proceedings of International Conference on Computers in Education (ICCE 2003)

      Pages: 257-264

    • NAID

      110003206831

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Multimedia Japanese language learning system - Applications for the Japanese language proficiency test -2003

    • Author(s)
      M.Shimada, N.Yamashita, H.Tominaga, Y.Matsubara, T.Yamasaki
    • Journal Title

      Proceedings of International Conference on Computers in Education (ICCE 2003)

      Pages: 754-758

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Fill-in type drill-based Web learning system for basic IT education2003

    • Author(s)
      H.Tominaga, H.Hagiwara, Y.Matsubara, T.Yamasaki, Yoneo Yano
    • Journal Title

      Proceedings of International Conference on Computers in Education (ICCE 2003)

      Pages: 764-766

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Eye Tracking Evaluation using Eye Camera for Visual Pointing Interface2003

    • Author(s)
      T.Yamasaki, Y.Matsubara, Emi Sato
    • Journal Title

      Proceedings of International Conference on Computers in Education (ICCE 2003)

      Pages: 790-793

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Development of Japanese Learning System based on the XML Multimedia Kanji Database2003

    • Author(s)
      N.Yamashita, M.Shimada, H.Tominaga, Y.Matsubara, T.Yamasaki
    • Journal Title

      Proceedings of Advanced Learning Technologies, Applications (ALTA 2003)

      Pages: 41-46

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Learning System for Beautiful Japanese Handwriting Based on On-Line Character Recognition2003

    • Author(s)
      N.Inami, H.Tominaga, T.Yamasaki
    • Journal Title

      Proceeding of 2nd Japan-China Workshop on Multidisciplinary Researches in Engineering (JCWMRE 2003)

      Pages: 83-90

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Can a computer catch the human feeling? - Aethetic impression from paintings using the Tone in the HLS Munsell color space -2003

    • Author(s)
      T.Yamasaki, T.Hattori, Y.Matsubara
    • Journal Title

      Proceedings of the Joint Workshop of Cognition, Learning Through Media-Communication for Advanced Learning (JWCL 2003)

      Pages: 231-236

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Language Learning System on the Network - Web-based Training System for Handwriting of Japanese Characters using Int eractive Electronic Whiteboard -2003

    • Author(s)
      T.Yamasaki, N.Inami, N.Yamashita, H.Tominaga, Y.Matsubara
    • Journal Title

      Proceedings of Proceedings of the Joint Workshop of Cognition, Learning Through Media-Communication for Advanced Learning (JWCL 2003)

      Pages: 237-240

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Fill-in type drill-based Web learning system for basic IT education2003

    • Author(s)
      H.Tominaga, Hidekazu Hagiwara, Y.Matsubara, T.Yamasaki, Y.Yano
    • Journal Title

      Proceedings of International Conference on Computers in Education (ICCE 2003)

      Pages: 764-766

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Eye Tracking Evaluation using Eye Camera for Visual Pointing Interface2003

    • Author(s)
      T.Yamasaki, Y.Matsubara, E.Sato
    • Journal Title

      Proceedings of International Conference on Computers in Education (ICCE 2003)

      Pages: 790-793

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Language Learning System on the Network - Web-based Training System for Handwriting of Japanese Characters using Interactive Electronic Whiteboard -2003

    • Author(s)
      T.Yamasaki, N.Inami, N.Yamashita, H.Tominaga, Y.Matsubara
    • Journal Title

      Proceedings of Proceedings of the Joint Workshop of Cognition and Learning Through Media-Communication for Advanced Learning (JWCL 2003)

      Pages: 237-240

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Can a computer catch the human feeling? - Aethetic impression from paintings using the Tone in the HLS Munsell color space -2003

    • Author(s)
      T.Yamasaki, T.Hattori, Y.Matsubara
    • Journal Title

      Proceedings of the Joint Workshop of Cognition and Learning Through Media- Communication for Advanced Learning (JWCL 2003)

      Pages: 231-235

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Development of Japanese Learning System based on the XML Multimedia Kanji Database2003

    • Author(s)
      N.Yamashita, M.Shimada, H.Tominaga, Y.Matsubara, T.Yamasaki
    • Journal Title

      Proceedings of Advanced Learning Technologies and Applications (ALTA 2003)

      Pages: 41-46

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Publications] N.Inami, H.Tominaga, T.Yamasaki: "Learning System for Beautiful Japanese Handwriting Based on On-Line Character Recognition"Proc.Japan-China Workshop on Multidisciplinary Researches in Engineering. Vol.2. 83-90 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] N.Inami, H.Tominaga, T.Yamasaki: "Network Based Training System for Handwriting Japanese Characters using Interactive Electronic Whiteboard"Proc.Int.Conf.Computers in Education. 257-264 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] T.Yamasaki, Y.Matsubara, E.Sato: "Eye Tracking Evaluation using Eye Camera for Visual Pointing Interface"Proc.Int.Conf.Computers in Education. 790-793 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 稲見, 富永, 松原, 山崎: "ハプティックデバイスを用いる書き方学習システム"ヒューマンインタフェースシンポジューム2003論文集. 643-646 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 島田, 稲見, 富永, 山崎: "マルチメディア対応日本語教育システム-学習漢字データベースの構築とその利用-"電子情報通信学会教育工学研究会. 102巻・697号. 79-84 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] T.Yamasaki, N.Inami: "Language Learning System on the Network - Web-based Training System for Handwriting of Japanese Characters using Interactive Electronic Whiteboard"Proc.Joint Workshop of Cognition and Learning through Media-Communication for Advanced e-Learning. Vol.1,No.1. 237-240 (2003)

    • Related Report
      2003 Annual Research Report

URL: 

Published: 2003-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi