• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Eyetifact: Development of a Platform for Eyewear Data Conversion and Its Application to Activity Recognition in the Wild

Research Project

Project/Area Number 17K12728
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Human interface and interaction
Research InstitutionOsaka Prefecture University

Principal Investigator

Ishimaru Shoya  大阪府立大学, 研究推進機構, 客員研究員 (10788730)

Project Period (FY) 2017-04-01 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2019: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2018: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2017: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Keywords心的状態認識 / 読書行動認識 / アイトラッキング / 赤外線サーモグラフィ / 皮膚電気活動 / 眼電位 / リカレントニューラルネットワーク / 人工知能 / 認知的行動認識 / in-the-wild study / 読書行動 / 行動認識 / 視線 / 瞳孔径 / 鼻部皮膚温度 / 認知科学
Outline of Final Research Achievements

This project aims to develop a system that learns the relationship between data recorded by multiple sensors and converts data obtained from one sensor into the equivalent data obtained by another advanced sensor. In the first year, as basic research for sensor data conversion, we investigated the relationship between internal states and sensor signals including eye movements and nose temperatures. In the next year, we developed data collection software and evaluated its scalability. In the final year, we added EEG to the list of the measurements and estimated the level of interest while reading from eye movements. Furthermore, we proposed a method for recognizing reading behavior in the real world by using electrooculography glasses and published the method with a dataset.

Academic Significance and Societal Importance of the Research Achievements

本研究の成果は,安価で日常的に記録ができるアイウェアのデータを大量に記録して高機能のものに変換するという方法で,これまでボトルネックであった「いかにして大量の行動データを集めるか」という問題を解消することができる.社会的には,教育と医療への影響が期待できる.例えば,本研究成果によって認知的行動の活動計測が実用化される.万歩計を見ながら生活することで運動のモチベーションを維持できるのと同様に,1日の読書量や会話量を計測することで,勉強のやる気を維持したり,行動の変化から病気の早期発見や治療,予防に役立てることができる.

Report

(4 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (7 results)

All 2019 2018 2017

All Presentation (7 results) (of which Int'l Joint Research: 7 results)

  • [Presentation] Electrooculography Dataset for Reading Detection in the Wild2019

    • Author(s)
      Shoya Ishimaru, Takanori Maruichi, Manuel Landsmann, Koichi Kise and Andreas Dengel
    • Organizer
      The 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Gaze-Based Interest Detection on Newspaper Articles2018

    • Author(s)
      Soumy Jacob, Shoya Ishimaru, Syed Saqib Bukhari and Andreas Dengel
    • Organizer
      International Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interaction (PETMEI)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Interest Detection While Reading Newspaper Articles by Utilizing a Physiological Sensing Wristband2018

    • Author(s)
      Soumy Jacob, Shoya Ishimaru and Andreas Dengel
    • Organizer
      ACM International Joint Conference on Pervasive and Ubiquitous Computing
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Combining Software-Based Eye Tracking and a Wide-Angle Lens for Sneaking Detection2018

    • Author(s)
      Dayananda Herurkar, Shoya Ishimaru and Andreas Dengel
    • Organizer
      ACM International Joint Conference on Pervasive and Ubiquitous Computing
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Cognitive State Measurement on Learning Materials by Utilizing Eye Tracker and Thermal Camera2017

    • Author(s)
      Shoya Ishimaru, Soumy Jacob, Apurba Roy, Syed Saqib Bukhari, Carina Heisel, Nicolas Grossmann, Michael Thees, Jochen Kuhn and Andreas Dengel
    • Organizer
      Proc. ICDAR2017
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Towards Reading Trackers in the Wild: Detecting Reading Activities by EOG Glasses and Deep Neural Networks2017

    • Author(s)
      Shoya Ishimaru, Kensuke Hoshika, Kai Kunze, Koichi Kise and Andreas Dengel
    • Organizer
      Proc. UbiComp2017 Adjunct
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] ARFLED: Ability Recognition Framework for Learning and Education2017

    • Author(s)
      Shoya Ishimaru and Andreas Dengel
    • Organizer
      Proc. UbiComp2017 Adjunct
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2017-04-28   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi