A Study on Modeling Text Reading Behaviors

• Project/Area Number: 23650076
• Research Category: Grant-in-Aid for Challenging Exploratory Research
• Allocation Type: Multi-year Fund
• Research Field: Intelligent informatics
• Research Institution: National Institute of Informatics
• Principal Investigator: AIZAWA Akiko 国立情報学研究所, コンテンツ科学研究系, 教授 (90222447)
• Project Period (FY): 2011 – 2012
• Project Status: Completed (Fiscal Year 2012)
• Budget Amount: ¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000); Fiscal Year 2012: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000); Fiscal Year 2011: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
• Keywords: 視線計測 / 読解行動 / テキスト理解 / 自然言語処理 / 言語インタフェース / 視線計測装置 / 視線計測誤差 / 行動予測 / 文書構造理解 / 文書構造解析

Research Abstract

This research investigated a method for modeling human text reading behavior using both the eye-movement and linguistic analysis of the target text. First, we proposed a method for compensating gaze position measurement errors using text-reading specific information such as a word-bounding boxes layout and human reading patterns. Next, we studied models to predict human reading actions. In our formulation, each word in a document was characterized by fixation duration time, a position in a document, and linguistic features such as POS tag. The proposed models were verified through experiments using an existing gaze-corpus or experiments with our own subjects

Research Products

• [Presentation] "Eye-data to Validate Readability Models for Diagnosis" (2013)
  • Author(s): Pascual Martinez-Gomez, Akiko Aizawa
  • Organizer: 17th European Conference on Eye Movements (ECEM 2013)
  • Place of Presentation: Lund, Sweden
  • Year and Date: 2013-08-13
• [Presentation] "Modeling Comma Placement in Chinese Text for Better Readability using Linguistic Features and Gaze Information" (2013)
  • Author(s): Tadayoshi Hara, Chen Chen, Yoshinobu Kano, Akiko Aizawa
  • Organizer: In the Second Workshop on Predicting and Improving Text Readability for Target Reader Populations (PITR 2013)
  • Place of Presentation: Sofia, Bulgaria
  • Year and Date: 2013-08-08
• [Presentation] "視線情報に基づいたテキスト幅の最適化" (2013)
  • Author(s): 冨田恭平, 原忠義, 相澤彰子
  • Organizer: 第27回人工知能学会全国大会
  • Place of Presentation: 富山国際会議場(富山)
  • Year and Date: 2013-06-05
• [Presentation] Eye-data to Validate Readability Models for Diagnosis (2013)
  • Author(s): Pascual Martinez-Gomez, Akiko Aizawa
  • Organizer: The 17th European Conference on Eye Movements (ECEM 2013)
  • Place of Presentation: Lund, Sweden
• [Presentation] 視線情報に基づいたテキスト幅の最適化 (2013)
  • Author(s): 冨田恭平, 原忠義, 相澤彰子
  • Organizer: 第27回人工知能学会全国大会
  • Place of Presentation: 富山国際会議場（富山市）
• [Presentation] "Predicting Word Fixations in Text with a CRF Model for Capturing General Reading Strategies among Readers" (2012)
  • Author(s): Tadayoshi Hara, Daichi Mochihashi, Yoshinobu Kano, Akiko Aizawa
  • Organizer: In the Workshop on Eye-Tracking and Natural Language Processing (ETNLP) of 24th International Conference on Computational Linguistics
  • Place of Presentation: Mumbai, India
  • Year and Date: 2012-12-15
• [Presentation] "Recognizing personal characteristics of readers using eye-movements and text features" (2012)
  • Author(s): Pascual Martinez-Gomez, Tadayoshi Hara, Akiko Aizawa
  • Organizer: Conference on Computational Linguistics (COLING 2012)
  • Place of Presentation: Mumbai, India
  • Year and Date: 2012-12-08
• [Presentation] "Reading as a translation process: issues in alignment of gaze and textual information" (2012)
  • Author(s): Akiko Aizawa
  • Organizer: Workshop on Future Directions in Translation Research
  • Place of Presentation: Todaiji Culture Center
  • Year and Date: 2012-12-04
• [Presentation] "Towards the Integration of Natural Language and Eye Tracking Information for Predicting Comma Placement in Chinese Sentence" (2012)
  • Author(s): Chen Chen, Yoshinobu Kano, Akiko Aizawa
  • Organizer: 第11回情報科学技術フォーラム(FIT2012)
  • Place of Presentation: 法政大学小金井キャンパス(小金井)
  • Year and Date: 2012-09-06
• [Presentation] "Synthesizing Image Representations of Linguistic and Topological Features for Predicting Areas of Attention" (2012)
  • Author(s): Pascual Martinez-Gomez, Tadayoshi Hara, Chen Chen, Kyohei Tomita, Yoshinobu Kano, Akiko Aizawa
  • Organizer: The 12th Pacific Rim International Conference on Artificial Intelligence (PRICAI 2012)
  • Place of Presentation: Kuching, Malaysia
  • Year and Date: 2012-09-03
• [Presentation] "OCRを用いた視線情報と閲覧テキストの言語的特徴の関連付け" (2012)
  • Author(s): 冨田恭平, 相澤彰子, Martinez-Gomez Pascual, 陳〓, 原忠義, 狩野芳伸
  • Organizer: 言語処理学会第18回年次大会
  • Place of Presentation: 広島市立大学(広島)
  • Year and Date: 2012-03-16
• [Presentation] "視線情報と言語処理" (2012)
  • Author(s): 相澤彰子
  • Organizer: 情報処理学会東海支部第7回講演会 招待講演
  • Place of Presentation: 名古屋大学(名古屋)
  • Year and Date: 2012-03-02
• [Presentation] "Image registration for text-gaze alignment" (2012)
  • Author(s): Pascual Martinez-Gomez, Chen Chen, Tadayoshi Hara, Yoshinobu Kano, Akiko Aizawa
  • Organizer: Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
  • Place of Presentation: Lisbon, Portugal
  • Year and Date: 2012-02-14
• [Presentation] Recognizing personal characteristics of readers using eye-movements and text features (2012)
  • Author(s): Pascual Martinez-Gomez, Tadayoshi Hara, Akiko Aizawa
  • Organizer: The 24th International Conference on Computational Linguistics (COLING 2012)
  • Place of Presentation: Mumbai, India
• [Presentation] Predicting Word Fixations in Text with a CRF Model for Capturing General Reading Strategies among Readers (2012)
  • Author(s): Tadayoshi Hara, Daichi Mochihashi, Yoshinobu Kano, Akiko Aizawa
  • Organizer: Workshop on Eye-Tracking and Natural Language Processing (ETNLP) of 24th International Conference on Computational Linguistics (COLING 2012)
  • Place of Presentation: Mumbai, India
• [Presentation] Reading as a Translation Process: Issues in Alignment of Gaze and Textual Information (2012)
  • Author(s): Akiko Aizawa
  • Organizer: The Workshop on Future Directions in Translation Research
  • Place of Presentation: 東大寺総合文化センター（奈良市）
  • Invited
• [Presentation] Synthesizing Image Representations of Linguistic and Topological Features for Predicting Areas of Attention (2012)
  • Author(s): Pascual Martinez-Gomez, Tadayoshi Hara, Chen Chen, Kyohei Tomita, Yoshinobu Kano, Akiko Aizawa
  • Organizer: The 12th Pacific Rim International Conference on Artificial Intelligence (PRICAI 2012)
  • Place of Presentation: Kuching, Malaysia
• [Presentation] Towards the Integration of Natural Language and Eye Tracking Information for Predicting Comma Placement in Chinese Sentence (2012)
  • Author(s): Chen Chen, Yoshinobu Kano, Akiko Aizawa
  • Organizer: 第11回情報科学技術フォーラム(FIT2012)
  • Place of Presentation: 法政大学小金井キャンパス（小金井市）
• [Presentation] 視線情報と言語処理
  • Author(s): 相澤彰子
  • Organizer: 情報処理学会東海支部第7回講演会
  • Place of Presentation: 名古屋大学東山キャンパス（名古屋市）
  • Invited
• [Presentation] OCRを用いた視線情報と閲覧テキストの言語的特徴の関連付け
  • Author(s): 冨田恭平, 相澤彰子, Martinez-Gomez Pascual, 陳チェン, 原忠義, 狩野芳伸
  • Organizer: 言語処理学会第18回年次大会
  • Place of Presentation: 広島市
• [Presentation] Image registration for text-gaze alignment.
  • Author(s): Pascual Martinez-Gomez, Chen Chen, Tadayoshi Hara, Yoshinobu Kano, Akiko Aizawa
  • Organizer: 2012 ACM International Conference on Intelligent User Interfaces (IUI 2012)
  • Place of Presentation: リスボン（ポルトガル）
• [Presentation] Quantitative analysis and inference on gaze data using natural language processing techniques
  • Author(s): Pascual Martinez-Gomez
  • Organizer: 2012 ACM International Conference on Intelligent User Interfaces (IUI 2012)
  • Place of Presentation: リスボン（ポルトガル）
• [Presentation] Synthesizing Image Representations of Linguistic Features over a Text for Predicting Areas of Attention in Reading
  • Author(s): Pascual Martinez-Gomez, Tadayoshi Hara, Chen Chen, Kyohei Tomita, Yoshinobu Kano and Akiko Aizawa
  • Organizer: 12th Pacific Rim International Conference on Artificial Intelligence (accepted)
  • Place of Presentation: クチン（マレーシア）