A Study on Emotion Recognition based on Foot-Floor Pressure Distribution Patterns in Walking and its Application

• Project/Area Number: 23500149
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: Media informatics/Database
• Research Institution: Shimane University
• Principal Investigator: HIRAKAWA Masahito 島根大学, 総合理工学研究科(研究院), 教授 (30173222)
• Project Period (FY): 2011 – 2013
• Project Status: Completed (Fiscal Year 2013)
• Budget Amount: ¥5,200,000 (Direct Cost: ¥4,000,000、Indirect Cost: ¥1,200,000); Fiscal Year 2013: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000); Fiscal Year 2012: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000); Fiscal Year 2011: ¥3,120,000 (Direct Cost: ¥2,400,000、Indirect Cost: ¥720,000)
• Keywords: ユーザインタフェ-ス / 歩行 / 感情推定 / フロアマットセンサ / デジタルサイネージ / ユーザインターフェース / マルチモーダルインターフェース / スマートセンサ情報システム / 画像、文章、音声等認識

Research Abstract

The ability to walk upright is one of the hallmarks of being human. Gait patterns convey complex states of mind as well as age and sex, and there is a potential to develop a new application domain. We have conducted research in gait detection and tracking of footsteps of multiple persons who may wear shoes, and in analysis to recognize a pedestrian's emotion. An application of the system to digital signage was also investigated.

Research Products

• [Journal Article] Identifying Individuals' Footsteps Walking on a Floor Sensor Device (2013)
  • Author(s): Kiryu Ibara, Kenta Kanetsuna, and Masahito Hirakawa
  • Journal Title: Lecture Notes in Computer Science Volume: 8210 Pages: 56-63
  • DOI: 10.1007/978-3-319-02750-0_6
  • ISBN: 9783319027494, 9783319027500
  • Peer Reviewed
• [Journal Article] Estimation of Lower Body Motion during Walking on a Floor Sensor Device (2012)
  • Author(s): M. Oikawa, N. Tanijiri, and M. Hirakawa
  • Journal Title: ICIC Express Letters Volume: Vol.6, No.12 Pages: 3027-3031
  • URL: http://www.ijicic.org/el-6%2812%29.htm
• [Presentation] Multimodal + Multimedia + Sensors = Pleasant Interfaces (2013)
  • Author(s): M. Hirakawa
  • Organizer: Proc., 2013 International Conference on Advances in ICT for Emerging Regions
  • Place of Presentation: コロンボ市(スリランカ)
  • Invited
• [Presentation] Multimodal + Multimedia + Sensors = Pleasant Interfaces (2013)
  • Author(s): Masahito Hirakawa
  • Organizer: 2013 International Conference on Advances in ICT for Emerging Regions
  • Place of Presentation: コロンボ市（スリランカ）バンダラナイケ記念国際会議場
  • Invited
• [Presentation] 多様な入力様式を用いたシステム対話技術 (2012)
  • Author(s): 平川正人
  • Organizer: しまね情報分野産学交流会
  • Place of Presentation: くにびきメッセ(島根県)
  • Year and Date: 2012-03-15
• [Presentation] フロアセンサ上を移動する歩行者の靴領域追跡ならびに下肢動作の推定 (2012)
  • Author(s): 井原煕隆, 兼綱健太, 下村優矢, 平川正人
  • Organizer: HISS シンポジウム
  • Place of Presentation: 岡山県立大学(総社市)
• [Presentation] Human Gait Estimation by Footstep Tracking on a Floor Sensor Device (2012)
  • Author(s): M. Oikawa, N. Tanijiri, and M. Hirakawa
  • Organizer: Proc., apCHI2012
  • Place of Presentation: くにびきメッセ(島根県)
• [Presentation] Human Gait Estimation by Footstep Tracking on a Floor Sensor Device (2012)
  • Author(s): M. Oikawa, N. Tanijiri, and M. Hirakawa
  • Organizer: ACM apCHI2012
  • Place of Presentation: くにびきメッセ（松江市）
• [Presentation] フロアセンサ上を移動する歩行者の靴領域追跡ならびに下肢動作の推定 (2012)
  • Author(s): 井原煕隆，兼綱健太，下村優矢，平川正人
  • Organizer: HISSシンポジウム
  • Place of Presentation: 岡山県立大学（総社市）
• [Presentation] 多様な入力様式を用いたシステム対話技術 (2012)
  • Author(s): 平川正人
  • Organizer: しまね情報分野産学交流会2012
  • Place of Presentation: くにびきメッセ（島根県）
• [Remarks]
  • URL: http://www.cis.shimane-u.ac.jp/~hirakawa/
• [Remarks] 歩行動作に応えるシステム
  • URL: http://www.cis.shimane-u.ac.jp/~hirakawa/projects.html
• [Remarks] 研究プロジェクト/歩行動作に応えるシステム
  • URL: http://www.cis.shimane-u.ac.jp/~hirakawa/projects.html#id83