• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Establishing Usability Evaluation Method and Developing the Evaluation System based on Multimodal Information

Research Project

Project/Area Number 16500055
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Media informatics/Database
Research InstitutionUniversity of Yamanashi

Principal Investigator

IMAMIYA Atsumi  University of Yamanashi, Division of Interdisciplinary Research, Graduate School of Medicine and Engineering, Professor (40006276)

Co-Investigator(Kenkyū-buntansha) OMATA Masaki  University of Yamanashi, Division of Interdisciplinary Research, Graduate School of Medicine and Engineering, Research Associate (60402088)
GO Kentaro  University of Yamanashi, Division of Interdisciplinary Research, Graduate School of Medicine and Engineering, Associate Professor (50282009)
KWOK Misa Grace  山梨大学, 大学院・医学工学総合研究部, 助手 (70362077)
Project Period (FY) 2004 – 2006
Project Status Completed (Fiscal Year 2006)
Budget Amount *help
¥3,200,000 (Direct Cost: ¥3,200,000)
Fiscal Year 2006: ¥1,000,000 (Direct Cost: ¥1,000,000)
Fiscal Year 2005: ¥1,100,000 (Direct Cost: ¥1,100,000)
Fiscal Year 2004: ¥1,100,000 (Direct Cost: ¥1,100,000)
KeywordsHuman Interface / Usability Evaluation / Phvsiological Index / Multimodal Interface / Web EvaMatinn / 可触化システム評価 / クロスモダリティ / ヒューマンインターフェース / 風の可蝕化 / 風の化蝕化
Research Abstract

This research explores the use of the multimodal data in evaluating usability, including subjective, physiological, eye tracking and physical data, with the aim of improving current evaluation techniques. We have three main conjectures: Conjecture A: Physiological measures can be used to objectively measure user experience. Conjecture B: Combining eye movement and physical data can get closer insights into user behavior, thereby helping to evaluate task performance and understand individual difference. Conjecture C: Physiological measures of experience will correspond to subjective ratings of the experience, but they will not be always consistent.
We have presented a series of three experiments to improve current HCI evaluation techniques by incorporating physiological, physical and eye tracking data into traditional methods. The study results showed these multimodal data can be powerful for improving evaluation techniques:
(1) Physiological measures can be powerful for quantitatively an … More d objectively evaluating user experience, especially when used in concern with subjective ratings and video analysis. We find evidence that there are different physiological responses across different stress levels in a game environment. These results provide support for Conjecture A.
(2) We argue that that eye movements are a reflection of cognitive process, while physical actions are the result of such process ; thus, combining eye and hand movements can provide more information about user behavior and interaction process. These results support the Conjecture B.
(3) We also investigate the relationships between traditional usability index and new usability data sources (eye tracking and physiological data). Physiological data can be mirrored in the subjective reports of assessing user experience. These results emphasize that both subjective and physiological evaluation techniques should be used together because they may provide different information of user experience. These results provide support for our Conjecture C. Less

Report

(4 results)
  • 2006 Annual Research Report   Final Research Report Summary
  • 2005 Annual Research Report
  • 2004 Annual Research Report
  • Research Products

    (31 results)

All 2006 2005 2004

All Journal Article (31 results) (of which Peer Reviewed: 9 results)

  • [Journal Article] AN EMPIRICAL STUDY OF RELATIONSHIPS BETWEEN TRADITIONAL USABILITY2006

    • Author(s)
      Tao Lin, Atsumi Imamiya, 他2名
    • Journal Title

      Australasian Journal of Information Systems 13

      Pages: 105-117

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] 感覚特性に基づいた反力と振動による風の可触化モデルの評価2006

    • Author(s)
      小俣昌樹, 公 彦〓, 今宮淳美
    • Journal Title

      電子情報通信学会論文誌-D J89-D

      Pages: 2155-2163

    • NAID

      110007380141

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] 力量ボタンマウスの操作特性の検証2006

    • Author(s)
      小俣昌樹, 松村健次, 今宮淳美
    • Journal Title

      情報科学技術フォーラム情報技術レターズ 5

      Pages: 301-303

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Combined user physical, physiological and subjective measures for assessing usability2006

    • Author(s)
      Lin, T., Imamiya, A
    • Journal Title

      Proceeding of The 8th International Conference on Multimodal Interfaces(ICMI'06) 8

      Pages: 364-371

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Displays characteristics affect users' emotional arousal in 3D games2006

    • Author(s)
      Lin, T., Imamiya, ほか2名
    • Journal Title

      Proceeding of the 9th ERCIM workshop "User Interface for All 9

      Pages: 304-316

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] An Empirical Study of Relationships between Traditional Usability Indexes and Physiological Data2006

    • Author(s)
      T. Lin,A. Imamiya, M. Omata,W. Hu
    • Journal Title

      Australian Journal of Information System Vol.13, No.2

      Pages: 104-117

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Combined user physical, physiological and subjective measures for assessing usability2006

    • Author(s)
      Lin, T., Imamiya, A
    • Journal Title

      Proceeding of The 8th International Conference on Multimodal Interfaces (Icmro6)

      Pages: 364-371

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Displays characteristics affect users' emotional arousal in 3D games2006

    • Author(s)
      Lin, T., Imamiya
    • Journal Title

      Proceeding of the 9th ERCIM workshop User Interface for All

      Pages: 304-316

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Evaluation of a Model for Haptizing Wind with Reactive Force and Vibration based on Huiman Perception (in Japanese)2006

    • Author(s)
      Omata, M., Gong, Y., Imamiya, A
    • Journal Title

      Transaction of the Institute of Electronics, Information and Communication Engineers Vol.J89D

      Pages: 2155-2163

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] AN EMPIRICAL STUDY OF RELATIONSHIPS BETWEEN TRADITIONAL USABILITY2006

    • Author(s)
      Tao Lin, Atsumi Imamiya, 他2名
    • Journal Title

      Australian Journal of Information Systems Volume 13 Number 2

      Pages: 105-117

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 感覚特性に基づいた反力と振動による風の可触化モデルの評価2006

    • Author(s)
      小俣昌樹, 公 彦卿, 今宮淳美
    • Journal Title

      電子情報通信学会論文誌-D Vol.J89-D, No.10

      Pages: 2155-2163

    • NAID

      110007380141

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 力量ボタンマウスの操作特性の検証2006

    • Author(s)
      小俣昌樹, 松村健次, 今宮淳美
    • Journal Title

      FIT2006 第5回情報科学技術フォーラム 情報技術レターズ Vol.5

      Pages: 301-303

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Cross-Modality between Haptic and Auditory Roughness with a Force Feedback Device2006

    • Author(s)
      Emi Kitamura, Kenji Ozawa, Atsumi Imamiya ほか2名
    • Journal Title

      Journal of Robotics and Mechatronics Vol.18,No.4

      Pages: 450-457

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Combined user physical, physiological and subjective measures for assessing usability2006

    • Author(s)
      Lin, T., Imamiya, A
    • Journal Title

      Proceeding of The 8th International Conference on Multimodal Interface (ICMT06) Vol.8

      Pages: 364-371

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Displays characteristics affect users' emotional arousal in 3D games2006

    • Author(s)
      Lin, T., Imamiya, ほか2名
    • Journal Title

      Proceeding of the 9th ERCIM workshop "User Interface for All" Vol.9

      Pages: 304-316

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Haptizing Wind on a Weather Map with Reactive Force and Vibration2005

    • Author(s)
      Masaki Omata, Masami Ishihara, Misa Grace Kwok, and Atsumi Imamiya
    • Journal Title

      IFIP INTERACT2005 10

      Pages: 19-29

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Do Physiological Data Relate to Traditional Usability Indexes?2005

    • Author(s)
      Tao Lin, Wanhua Hu, Masaki Omata, Atsumi Imamiya
    • Journal Title

      OZCHI2005 15

      Pages: 1-10

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Do Physiological Data Relate to Traditional Usability Indexes2005

    • Author(s)
      Tao, Lin, Wanhua, Hu, Masaki, Omata, Atsumi, Imamiya
    • Journal Title

      OZCHI2005 Vol.15

      Pages: 1-10

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Haptizing Wind on a Weather Map with Reactive Force and Vibration2005

    • Author(s)
      Masaki, Omata, Masami, Ishihara, Misa, Grace, Kwok, Atsumi, Imamiya
    • Journal Title

      IFIP INTERACT Vol.10

      Pages: 19-29

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Effects of Encoding Bit Rates on User Level QoS for Video Streaming2005

    • Author(s)
      H.Masuda, A.Imamiya, G.Kitagata, T.Suganuma.K.Go, N.Shiratori
    • Journal Title

      Proceedings of IASTED Conerence INTERNET AND MULTIMEDIA SYSTEMS AND APPLICATION

      Pages: 41-46

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Lightness Influence on Virtual Haptic Roughness Perception2005

    • Author(s)
      Wanhua Hu, Kazuo Sakai, Atsumi Imamiya, Masaki Omata, Tao Lin
    • Journal Title

      Information Technology Letters Vol.4

      Pages: 249-252

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Haptizing Wind on a Weather Map with Reactive Force and Vibration2005

    • Author(s)
      Masaki Omata, Masami Ishihara, Misa Grace Kwok, Atsumi Imamiya
    • Journal Title

      IFIP INTERACT2005 Vol.10

      Pages: 19-29

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Visual and Haptic Interaction on Virtual Haptic Roughness Perception with Different Lightness2005

    • Author(s)
      Wanhua Hu, Tao Lin, Kazuo Sakai, Atsumi Imamiya, Masaki Omata
    • Journal Title

      Proceedings of IASTED-HCI 2005

      Pages: 126-131

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Do Physiological Data Related to Traditional Usability Indexes?2005

    • Author(s)
      Tao Lin, Wanhua Hu, Masaki Omata, Atsumi Imamiya
    • Journal Title

      OZCHI2005 Vol.15

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 人間の空間記憶特性に基づく略地図生成システム2004

    • Author(s)
      Misa Grace Kwok, 土屋良貴, 今宮淳美
    • Journal Title

      情報科学技術フォーラム情報技術レターズ 3

      Pages: 303-306

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] 感覚特性に基づいた反力と振動による流れ場の可触化2004

    • Author(s)
      小俣 昌樹, 石原 雅巳, Kwok, Misa Grace, 今宮 淳美
    • Journal Title

      情報科学技術フォーラム情報技術レターズ 3

      Pages: 287-290

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Web上のカテゴリ検索のユーザビリティ評価における原因推定のための視線情報の有用性2004

    • Author(s)
      藤田 雄一, 蒔苗 正, 小俣 昌樹, 今宮 淳美
    • Journal Title

      ヒューマンインタフェースシンポジウム2004論文集

      Pages: 921-926

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 人間の空間記憶特性に基づく略地図生成システム2004

    • Author(s)
      Misa Grce Kwok, 土屋良貴, 今宮 淳美
    • Journal Title

      情報科学技術フォーラム情報技術レターズ 第3巻

      Pages: 303-306

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 感覚特性に基づいた反力と振動による流れ場の可触化2004

    • Author(s)
      小俣 昌樹, 石原 雅巳, Kwok, Misa Grace, 今宮 淳美
    • Journal Title

      情報科学技術フォーラム情報技術レターズ 第3巻

      Pages: 287-290

    • Related Report
      2004 Annual Research Report
  • [Journal Article] ネットワーク社会を目指した拡張現実感技術による情報提示法と情報操作法2004

    • Author(s)
      小俣昌樹, 郷健太郎, 今宮淳美, 茅暁陽
    • Journal Title

      電子情報通信学会技術研究報告「技術と社会・倫理研究会(SITE)」 Vol.103, No.635

      Pages: 19-24

    • NAID

      110003173961

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Do Colors Affect Our Recognition Memory for Haptic Rough Surfaces?2004

    • Author(s)
      Zhaowu Luo, Atsumi Imamiya
    • Journal Title

      Proceedings of the International Workshop on Interactive Visualization and Interaction Technologies Vol.4

      Pages: 897-904

    • Related Report
      2004 Annual Research Report

URL: 

Published: 2004-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi