• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Learning Assistance Using Various Sensors for Tailor-Made Education

Research Project

Project/Area Number 15K12172
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Learning support system
Research InstitutionOsaka Prefecture University

Principal Investigator

Kise Koichi  大阪府立大学, 工学(系)研究科(研究院), 教授 (80224939)

Project Period (FY) 2015-04-01 – 2018-03-31
Project Status Completed (Fiscal Year 2017)
Budget Amount *help
¥3,510,000 (Direct Cost: ¥2,700,000、Indirect Cost: ¥810,000)
Fiscal Year 2016: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Fiscal Year 2015: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Keywordsテーラーメイド教育 / センシング技術 / reading-life log / wordometer / vocabulometer / confidence estimation / concentration estimation / TOEIC score / 学習支援 / センサ / アイトラッカ / キーロガー / 確信推定 / スコア推定 / 視線解析 / 眼電位法 / TOEIC / 長文読解問題 / 多肢選択問題 / 主観的高難易度語 / テーラメイド教育 / オープンアイウェア
Outline of Final Research Achievements

The tailor-made education is an education that depends on personal features, which attracts attention as an education of the next generation. In this research, we have developed various sensing technologies and estimation of personal features based on them, both of which are mandatory for realizing the tailor-made education. In particular, we recognize “reading” as a fundamental process of education and learning and have developed the following technologies: estimation of the number of read words, periods of reading, types of documents, and the record of read words. In addition, we have also developed methods for estimation of unknown words, vocabularies, TOEIC scores, confidence on answers to multiple-choice questions and typing questions, concentration while watching video lectures, as well as recommendation of reading materials based on the estimation.

Report

(4 results)
  • 2017 Annual Research Report   Final Research Report ( PDF )
  • 2016 Research-status Report
  • 2015 Research-status Report
  • Research Products

    (55 results)

All 2018 2017 2016 2015 2011 Other

All Int'l Joint Research (5 results) Journal Article (6 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 4 results,  Open Access: 1 results,  Acknowledgement Compliant: 1 results) Presentation (43 results) (of which Int'l Joint Research: 26 results,  Invited: 2 results) Patent(Industrial Property Rights) (1 results)

  • [Int'l Joint Research] ドイツ人工知能研究センター(ドイツ)

    • Related Report
      2017 Annual Research Report
  • [Int'l Joint Research] ボルドー大学(フランス)

    • Related Report
      2017 Annual Research Report
  • [Int'l Joint Research] ドイツ人工知能研究センター(ドイツ)

    • Related Report
      2016 Research-status Report
  • [Int'l Joint Research] ドイツ人工知能研究センター(ドイツ)

    • Related Report
      2015 Research-status Report
  • [Int'l Joint Research] ラロッシェル大学(フランス)

    • Related Report
      2015 Research-status Report
  • [Journal Article] Deeply Sensing Learners for Better Assistance2018

    • Author(s)
      Koichi Kise
    • Journal Title

      Positive Learning in the Age of Information

      Volume: 1 Pages: 373-385

    • Related Report
      2017 Annual Research Report
  • [Journal Article] Wordometer Systems for Everyday Life2017

    • Author(s)
      Olivier Augereau, Charles Lima Sanches, Koichi Kise, Kai Kunze
    • Journal Title

      PACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

      Volume: 1 Issue: 4 Pages: 1-21

    • DOI

      10.1145/3161601

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Reading-Life Log as a New Paradigm of Utilizing Character and Document Media2017

    • Author(s)
      Koichi Kise, Shinichiro Omachi, Seiichi Uchida, Masakazu Iwamura, Masahiko Inami
    • Journal Title

      Human-Harmonized Information Technology

      Volume: 2 Pages: 197-233

    • DOI

      10.1007/978-4-431-56535-2_7

    • ISBN
      9784431565338, 9784431565352
    • Related Report
      2017 Annual Research Report
  • [Journal Article] 視線情報と一人称視点画像を用いた文書カテゴリの自動識別2016

    • Author(s)
      志賀 優毅、内海 ゆづ子、岩村 雅一、Kai Kunze、黄瀬 浩一
    • Journal Title

      電子情報通信学会論文誌

      Volume: J99-D Pages: 950-958

    • Related Report
      2016 Research-status Report
    • Peer Reviewed
  • [Journal Article] Vertical error correction of eye trackers in nonrestrictive reading condition2016

    • Author(s)
      Charles Lima Sanches, Olivier Augereau, Koichi Kise
    • Journal Title

      IPSJ Transactions on Computer Vision and Applications

      Volume: 8 Pages: 1-7

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Pattern recognition using boundary data of component distributions2011

    • Author(s)
      Masako Omachi
    • Journal Title

      Computers & Industrial Engineering

      Volume: 60 Issue: 3 Pages: 466-472

    • DOI

      10.1016/j.cie.2010.08.007

    • Related Report
      2015 Research-status Report
    • Peer Reviewed
  • [Presentation] Vocabulometer: An eye-tracking web platform for reading analysis2018

    • Author(s)
      Olivier Augereau, Clement Jacquet, Koichi Kise, Nicholas Journet
    • Organizer
      International Workshop on Document Analysis Systems
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Quantified reading and learning for sharing experiences2018

    • Author(s)
      Koichi Kise, Olivier Augereau, Yuzuko Utsumi, Masakazu Iwamura, Kai Kunze, Shoya Ishimaru, Andreas Dengel
    • Organizer
      2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 視点情報と単語の出現頻度を用いた主観的高難易度単語の推定2017

    • Author(s)
      大社 綾乃,Olivier Augereau,黄瀬 浩一
    • Organizer
      電子情報通信学会パターン認識メディア理解研究会
    • Place of Presentation
      札幌,北海道
    • Year and Date
      2017-02-19
    • Related Report
      2016 Research-status Report
  • [Presentation] 英語多肢選択問題解答時の視線に基づく確信度推定2017

    • Author(s)
      山田 健斗,大社 綾乃,藤好 宏樹,星加 健介,Olivier Augereau,黄瀬 浩一
    • Organizer
      電子情報通信学会パターン認識メディア理解研究会
    • Place of Presentation
      札幌,北海道
    • Year and Date
      2017-02-19
    • Related Report
      2016 Research-status Report
  • [Presentation] 問題解答時の視点情報を用いた文書非依存な英語能力推定法2017

    • Author(s)
      藤好 宏樹, Olivier Augereau, 黄瀬 浩一
    • Organizer
      電子情報通信学会パターン認識メディア理解研究会
    • Place of Presentation
      札幌,北海道
    • Year and Date
      2017-02-19
    • Related Report
      2016 Research-status Report
  • [Presentation] キーロガを用いた英単語タイピングの確信判定2017

    • Author(s)
      丸市賢功,坂本周司,OlivierAugereau,黄瀬浩一
    • Organizer
      電子情報通信学会パターン認識メディア理解研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 文書への依存性を考慮したTOEICスコア推定法の実験的評価2017

    • Author(s)
      星加 健介,Olivier Augereau,黄瀬 浩一
    • Organizer
      電子情報通信学会技術研究報告パターン認識メディア理解研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 視点特徴とテキスト特徴の分析による日本語テキストの難易度推定2017

    • Author(s)
      楽 卓登,Olivier Augereau,Charles Lima Sanches,黄瀬 浩一
    • Organizer
      電子情報通信学会技術研究報告パターン認識メディア理解研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Assessing Cognitive Workload on Printed and Electronic Media using Eye-Tracker and EDA Wristband2017

    • Author(s)
      Iuliia Brishtel, Shoya Ishimaru, Olivier Augereau, Koichi Kise, and Andreas Dengel
    • Organizer
      23rd International Conference on Intelligent User Interfaces
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 視線に基づく英語多肢選択問題解答の確信度推定2017

    • Author(s)
      山田 健斗,Olivier Augereau,黄瀬 浩一
    • Organizer
      画像の認識理解シンポジウム(MIRU2017)
    • Related Report
      2017 Annual Research Report
  • [Presentation] Identification of Reader Specific Difficult Words by Analyzing Eye Gaze and Document Content2017

    • Author(s)
      Utpal Garain, Onkar Pandit, Olivier Augereau, Ayano Okoso, Koichi Kise
    • Organizer
      International Conference on Document Analysis and Recognition
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Japanese reading objective understanding estimation by eye gaze analysis2017

    • Author(s)
      Charles Lima Sanches, Koichi Kise, and Olivier Augereau
    • Organizer
      2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Estimation of confidence based on eye gaze: an application to multiple-choice questions2017

    • Author(s)
      Kento Yamada, Olivier Augereau, Koichi Kise
    • Organizer
      2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Real-time wordometer demonstration using commercial EoG glasses2017

    • Author(s)
      Robert Hitinui, Olivier Augereau, Koichi Kise
    • Organizer
      2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Using the eye gaze to predict document reading subjective understanding2017

    • Author(s)
      Charles Lima Sanches, Olivier Augereau, and Koichi Kise
    • Organizer
      International Workshop on Human-Document Interaction
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 様々なセンサを用いた読書行動解析2017

    • Author(s)
      黄瀬 浩一, Olivier Augereau, Charles Lima Sanches, 藤好 宏樹, 大社 綾乃, 山田 健斗, Kai Kunze, 石丸 翔也, Andreas Dengel
    • Organizer
      教育情報システム学会研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Deeply Sensing Learners for Better Assistance: Towards Distribution of Learning Experiences2017

    • Author(s)
      Koichi Kise
    • Organizer
      the PLATO conference
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Towards an Automated Estimation of English Skill via TOEIC Score Based on Reading Analysis2016

    • Author(s)
      Olivier Augereau, Hiroki Fujiyoshi, Koichi Kise
    • Organizer
      International Conference on Pattern Recognition
    • Place of Presentation
      Cancun, Mexico
    • Year and Date
      2016-12-04
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] The Wordometer 2.0; Estimating the Number of Words You Read in Real Life using Commercial EOG Glasses2016

    • Author(s)
      Shoya Ishimaru, Koichi Kise, Kai Kunze, Andreas Dengel
    • Organizer
      International Conference on Ubiquitous Computing, International Symposium on Wearable Computers
    • Place of Presentation
      Heidelberg, Germany
    • Year and Date
      2016-09-12
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Reading Interventions - Tracking Reading State and Designing Interventions2016

    • Author(s)
      Shoya Ishimaru, Tilman Dingler, Kai Kunze, Koichi Kise, and Andreas Dengel
    • Organizer
      2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing
    • Place of Presentation
      Heidelberg, Germany
    • Year and Date
      2016-09-12
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] リーディングライフログを用いた日常的な読書行動の計量2016

    • Author(s)
      星加 健介,石丸 翔也,Olivier Augereau,黄瀬浩一
    • Organizer
      電子情報通信学会パターン認識メディア理解研究会
    • Place of Presentation
      名古屋市,愛知県
    • Year and Date
      2016-05-19
    • Related Report
      2016 Research-status Report
  • [Presentation] 読書行動の検出における有効な視線特徴量の選定2016

    • Author(s)
      中嶌 一樹,内海 ゆづ子,岩村 雅一,黄瀬 浩一
    • Organizer
      情報処理学会コンピュータビジョンとイメージメディア研究会
    • Place of Presentation
      茨木市,大阪府
    • Year and Date
      2016-05-12
    • Related Report
      2016 Research-status Report
  • [Presentation] Camera-Based System for User Friendly Annotation of Documents2016

    • Author(s)
      Yusuke Oguma, Koichi Kise
    • Organizer
      International Workshop on Document Analysis Systems
    • Place of Presentation
      Santorini, Greece
    • Year and Date
      2016-04-11
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] 多様な文書にも対応可能なカメラベース文書アノーテーション付与・共有2016

    • Author(s)
      小熊 勇佑,黄瀬 浩一
    • Organizer
      電子情報通信学会パターン認識メディア理解研究会
    • Place of Presentation
      産業技術総合研究所副都心センター(東京都江東区)
    • Year and Date
      2016-03-24
    • Related Report
      2015 Research-status Report
  • [Presentation] 視点情報を用いた主観的高難易度単語の推定2016

    • Author(s)
      大社 綾乃, 石丸 翔也, Olivier Augereau, 黄瀬 浩一
    • Organizer
      電子情報通信学会パターン認識メディア理解研究会
    • Place of Presentation
      産業技術総合研究所副都心センター(東京都江東区)
    • Year and Date
      2016-03-24
    • Related Report
      2015 Research-status Report
  • [Presentation] 視点情報を用いた英語習熟度推定法の実験的検討2016

    • Author(s)
      藤好 宏樹,石丸 翔也,Olivier Augereau,黄瀬 浩一
    • Organizer
      電子情報通信学会パターン認識メディア理解研究会
    • Place of Presentation
      産業技術総合研究所副都心センター(東京都江東区)
    • Year and Date
      2016-03-24
    • Related Report
      2015 Research-status Report
  • [Presentation] Media-Independent Stamp-Based Document Annotation Using DocumentImage Retrieval2015

    • Author(s)
      Yusuke Oguma and Koichi Kise
    • Organizer
      1st International Workshop on Visual Recognition and Retrieval for Mixed and Augmented Reality
    • Place of Presentation
      福岡国際会議場(福岡県福岡市)
    • Year and Date
      2015-10-03
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] 2nd Workshop on Ubiquitous Technologies to Augment the Human Mind: Towards the Knowledge Log2015

    • Author(s)
      Kai Kunze, Tilman Dingler, Niels Henze, Koichi Kise, Yoichi Sato
    • Organizer
      2nd Workshop on Ubiquitous Technologies to Augment the Human Mind: Towards the Knowledge Log
    • Place of Presentation
      グランフロント大阪(大阪府大阪市北区)
    • Year and Date
      2015-09-07
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Quantifying Reading Habits; Counting How Many Words You Read2015

    • Author(s)
      Kai Kunze, Katsutoshi Masai, Masahiko Inami, Omer Sacakli, Marcus Liwicki, Andreas Dengel, Shoya Ishimaru, Koichi Kise
    • Organizer
      2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2015)
    • Place of Presentation
      グランフロント大阪(大阪府大阪市北区)
    • Year and Date
      2015-09-07
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Quantifying the Mental State on the Basis of Physical and Social Activities2015

    • Author(s)
      Shoya Ishimaru, Koichi Kise
    • Organizer
      2nd Workshop on Ubiquitous Technologies to Augment the Human Mind: Towards the Knowledge Log
    • Place of Presentation
      グランフロント大阪(大阪府大阪市北区)
    • Year and Date
      2015-09-07
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Reading Similarity Measure Based on Comparison of Fixation Sequences2015

    • Author(s)
      Riki Kudo, Olivier Augereau, Takuto Rou, Koichi Kise
    • Organizer
      2nd Workshop on Ubiquitous Technologies to Augment the Human Mind: Towards the Knowledge Log
    • Place of Presentation
      グランフロント大阪(大阪府大阪市北区)
    • Year and Date
      2015-09-07
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Eye gaze and text line matching for reading analysis2015

    • Author(s)
      Charles Lima Sanches, Olivier Augereau, Koichi Kise
    • Organizer
      2nd Workshop on Ubiquitous Technologies to Augment the Human Mind: Towards the Knowledge Log
    • Place of Presentation
      グランフロント大阪(大阪府大阪市北区)
    • Year and Date
      2015-09-07
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] MEME ― Eye Wear Computing to Explore Human Behavior2015

    • Author(s)
      Kai Kunze, Yuji Uema, Katsuma Tanaka, Shoya Ishimaru, Koichi Kise and Masahiko Inami
    • Organizer
      2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing Adjunct Publication (UbiComp2015)
    • Place of Presentation
      グランフロント大阪(大阪府大阪市北区)
    • Year and Date
      2015-09-07
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Extraction of Read Text for Automatic Video Annotation2015

    • Author(s)
      Mizuki Matsubara, Joachim Folz, Takumi Toyama, Marcus Liwicki, Andreas Dengel, Koichi Kise
    • Organizer
      2015 ACM International Symposium on Wearable Computers
    • Place of Presentation
      グランフロント大阪(大阪府大阪市北区)
    • Year and Date
      2015-09-07
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] The Eye as the Window of the Language Ability: Estimation of English Skills by Analyzing Eye Movement While Reading Documents2015

    • Author(s)
      Kazuyo Yoshimura, Kai Kunze, Koichi Kise
    • Organizer
      13th International Conference on Document Analysis and Recognition (ICDAR2015)
    • Place of Presentation
      Prouve congress center, Nancy, France
    • Year and Date
      2015-08-23
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] A proposal of a document image reading-life log based on document image retrieval and eyetracking2015

    • Author(s)
      Olivier Augereau, Koichi Kise, Kensuke Hoshika
    • Organizer
      13th International Conference on Document Analysis and Recognition (ICDAR2015)
    • Place of Presentation
      Prouve congress center, Nancy, France
    • Year and Date
      2015-08-23
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Document Analysis Meets Activity Recognition: A New Paradigm of Analyzing Documents in Combination With Users’ Reading Behavior2015

    • Author(s)
      Koichi Kise
    • Organizer
      13th International Conference on Document Analysis and Recognition (ICDAR2015)
    • Place of Presentation
      Prouve congress center, Nancy, France
    • Year and Date
      2015-08-23
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Estimating the number of read words with the Wordometer2015

    • Author(s)
      Olivier Augereau, Kai Kunze, Koichi Kise
    • Organizer
      画像の認識理解シンポジウム
    • Place of Presentation
      ホテル阪急エキスポパーク(大阪府吹田市)
    • Year and Date
      2015-07-27
    • Related Report
      2015 Research-status Report
  • [Presentation] 英文問題解答時の視点情報を用いた英語能力推定法2015

    • Author(s)
      藤好 宏樹,吉村 和代,Kai Kunze,黄瀬 浩一
    • Organizer
      電子情報通信学会パターン認識メディア理解研究会
    • Place of Presentation
      三重大学(三重県津市)
    • Year and Date
      2015-05-24
    • Related Report
      2015 Research-status Report
  • [Presentation] 学習補助のための視点情報に基づく文書アノテーション2015

    • Author(s)
      大社 綾乃, Kai Kunze, Olivier Augereau, 黄瀬 浩一
    • Organizer
      電子情報通信学会パターン認識メディア理解研究会
    • Place of Presentation
      三重大学(三重県津市)
    • Year and Date
      2015-05-24
    • Related Report
      2015 Research-status Report
  • [Presentation] 視点情報に基づくリーディングライフログの取得とその視覚化2015

    • Author(s)
      星加 健介,藤好 宏樹,Olivier Augereau,黄瀬浩一
    • Organizer
      電子情報通信学会パターン認識メディア理解研究会
    • Place of Presentation
      三重大学(三重県津市)
    • Year and Date
      2015-05-24
    • Related Report
      2015 Research-status Report
  • [Presentation] Towards Extraction of Subjective Reading Incomprehension: Analysis of Eye Gaze Features2015

    • Author(s)
      Ayano Okoso, Joachim Folz, Takumi Toyama, Marcus Liwicki, Kai Kunze, Koichi Kise
    • Organizer
      33rd Annual ACM Conference on Human Factors in Computing Systems
    • Place of Presentation
      COEX, Seoul, Korea
    • Year and Date
      2015-04-18
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Smart Eyewear for Interaction and Activity Recognition2015

    • Author(s)
      Shoya Ishimaru, Kai Kunze, Katsuma Tanaka, Yuji Uema, Koichi Kise and Masahiko Inami
    • Organizer
      33rd Annual ACM Conference on Human Factors in Computing Systems
    • Place of Presentation
      COEX, Seoul, Korea
    • Year and Date
      2015-04-18
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Patent(Industrial Property Rights)] 回答に対する確信判定方法および確信判定プログラム2018

    • Inventor(s)
      黄瀬浩一、オジュロ オリビエ、丸市 賢功
    • Industrial Property Rights Holder
      黄瀬浩一、オジュロ オリビエ、丸市 賢功
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2018-037535
    • Filing Date
      2018
    • Related Report
      2017 Annual Research Report

URL: 

Published: 2015-04-16   Modified: 2019-03-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi