• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Document reading analysis - towards smart documents

Research Project

Project/Area Number 16K16089
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Perceptual information processing
Research InstitutionOsaka Prefecture University

Principal Investigator

Augereau Olivier  大阪府立大学, 工学(系)研究科(研究院), 研究員 (10772436)

Project Period (FY) 2016-04-01 – 2018-03-31
Project Status Completed (Fiscal Year 2017)
Budget Amount *help
¥4,030,000 (Direct Cost: ¥3,100,000、Indirect Cost: ¥930,000)
Fiscal Year 2017: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2016: ¥2,470,000 (Direct Cost: ¥1,900,000、Indirect Cost: ¥570,000)
Keywordseye tracking / reading analysis / reading understanding / smart documents / smart document / adaptive document / 視覚メディア処理 / document analysis / reader analysis
Outline of Final Research Achievements

The aim of this research project is to create smart documents that can adapt themselves to the readers. Some sensors such as eye trackers (Tobii, SMI, pupil, JINS MEME) and physiological sensors (E4 wristband) are used to analyze information about the user while reading a document. For example we estimate the reader comprehension, confusion, concentration and emotion. At the same time, the document that the reader is interacting with is analyzed. The information about the document and the user behavior are combined to proceed a "mutual analysis". By knowing the difficulty of a document and the skill of the reader, the system can select an easier version of the document. Another application is to recommend a user to review specific parts of a lesson based on the confidence and correctness of his answers.

Report

(3 results)
  • 2017 Annual Research Report   Final Research Report ( PDF )
  • 2016 Research-status Report
  • Research Products

    (10 results)

All 2018 2017 2016

All Journal Article (6 results) (of which Int'l Joint Research: 6 results,  Peer Reviewed: 6 results,  Open Access: 1 results) Presentation (4 results) (of which Int'l Joint Research: 4 results)

  • [Journal Article] Assessing Cognitive Workload on Printed and Electronic Media Using Eye-Tracker and EDA Wristband2018

    • Author(s)
      Brishtel, Iuliia and Ishimaru, Shoya and Augereau, Olivier and Kise, Koichi and Dengel, Andreas
    • Journal Title

      Proceedings of the 23rd International Conference on Intelligent User Interfaces Companion

      Volume: 1 Pages: 1-2

    • DOI

      10.1145/3180308.3180354

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Wordometer Systems for Everyday Life2017

    • Author(s)
      Olivier Augereau, Charles Lima Sanches, Koichi Kise, Kai Kunze
    • Journal Title

      PACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

      Volume: 1 Issue: 4 Pages: 1-21

    • DOI

      10.1145/3161601

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Identification of Reader Specific Difficult Words by Analyzing Eye Gaze and Document Content2017

    • Author(s)
      Garain, Utpal and Pandit, Onkar and Augereau, Olivier and Okoso, Ayano and Kise, Koichi
    • Journal Title

      Document Analysis and Recognition (ICDAR), 2017 14th IAPR International Conference on

      Volume: 1 Pages: 1346-1351

    • DOI

      10.1109/icdar.2017.221

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Using the eye gaze to predict document reading subjective understanding2017

    • Author(s)
      Sanches, Charles Lima and Augereau, Olivier and Kise, Koichi
    • Journal Title

      Document Analysis and Recognition (ICDAR), 2017 14th IAPR International Conference on

      Volume: 8

    • DOI

      10.1109/icdar.2017.377

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Estimation of Confidence Based on Eye Gaze: An Application to Multiple-choice Questions2017

    • Author(s)
      Yamada, Kento and Kise, Koichi and Augereau, Olivier
    • Journal Title

      Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers

      Volume: 1 Pages: 217-220

    • DOI

      10.1145/3123024.3123138

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Vertical error correction of eye trackers in nonrestrictive reading condition2016

    • Author(s)
      Charles Lima Sanches, Olivier Augereau, Koichi Kise
    • Journal Title

      IPSJ Transactions on Computer Vision and Applications

      Volume: 8 Issue: 1

    • DOI

      10.1186/s41074-016-0008-x

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Towards an Automated Estimation of English Skill via TOEIC Score Based on Reading Analysis2016

    • Author(s)
      Olivier Augereau, Hiroki Fujiyoshi and Koichi Kise
    • Organizer
      International Conference on Pattern Recognition
    • Place of Presentation
      Cancun
    • Year and Date
      2016-12-05
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Emotional arousal estimation while reading comics based on physiological signal analysis2016

    • Author(s)
      Mizuki Matsubara, Olivier Augereau, Charles Lima Sanches, Koichi Kise
    • Organizer
      Proceedings of the 1st International Workshop on coMics ANalysis, Processing and Understanding
    • Place of Presentation
      Cancun
    • Year and Date
      2016-12-04
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Manga content analysis using physiological signals2016

    • Author(s)
      Charles Lima Sanches, Olivier Augereau, Koichi Kise
    • Organizer
      Proceedings of the 1st International Workshop on coMics ANalysis, Processing and Understanding
    • Place of Presentation
      Cancun
    • Year and Date
      2016-12-04
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Estimation of english skill with a mobile eye tracker2016

    • Author(s)
      Olivier Augereau, Kai Kunze, Hiroki Fujiyoshi, Koichi Kise
    • Organizer
      UbiComp Adjunct 2016
    • Place of Presentation
      Heidelberg
    • Year and Date
      2016-09-12
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2016-04-21   Modified: 2019-03-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi