• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Understanding user's intention and situation using wearable sensors and emotion machine model

Research Project

Project/Area Number 15500064
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Media informatics/Database
Research InstitutionShizuoka University

Principal Investigator

TAKEBAYASHI Yoichi  Shizuoka University, Faculty of Informatics, Professor, 情報学部, 教授 (10345803)

Co-Investigator(Kenkyū-buntansha) HARAIKAWA Tomohiro  Shizuoka University, Faculty of Informatics, Research Associate, 情報学部, 助手 (90324326)
SAKANE Yutaka  Shizuoka University, Faculty of Informatics, Research Associate, 情報学部, 助手 (40345806)
Project Period (FY) 2003 – 2004
Project Status Completed (Fiscal Year 2004)
Budget Amount *help
¥3,700,000 (Direct Cost: ¥3,700,000)
Fiscal Year 2004: ¥1,700,000 (Direct Cost: ¥1,700,000)
Fiscal Year 2003: ¥2,000,000 (Direct Cost: ¥2,000,000)
Keywordswearable / sensor / intention / situation / emotion / ubiquitous / karate / multimodal / 知識処理 / 環境情報 / 意図状況理解 / 感情モデル / ウェアラブル・センサ
Research Abstract

We have developed several intention and situations models by using wearable sensors and Minsky's emotion machine model. We have developed several multimodal sensing systems to comprehend human situations, intentions and emotions from data acquired by signal processing, symbol processing and knowledge processing. The multimodal knowledge can be created by integrating acquired information, videos, sounds, sensor data, knowledge and know-how.
We have built several multimodal knowledge contents obtained from various wearable and ubiquitous sensors in several applications, including team cycling, Karate, mountain climbing and face-to-face meeting. The motions of the players and the nod motions of the audience are collected by using motion sensors such as accelerated velocity sensors. The situations of the karate match and the meeting, the intentions and emotions of the players and the audience can be evaluated from type and timing data of movements and nods. Thus, we have constructed several understanding models based on the emotion machine.
We propose a cyclist community activation support system which provides multimodal knowledge contents for cyclists and makes them enjoy their riding. It also provides a new way of speech communication using an ad-hoc wireless LAN technology to achieve spontaneous speech communication. Our understanding models can be applied to various sports, arts, cultures, hobbies and so on.

Report

(3 results)
  • 2004 Annual Research Report   Final Research Report Summary
  • 2003 Annual Research Report
  • Research Products

    (35 results)

All 2004 2003 Other

All Journal Article (29 results) Publications (6 results)

  • [Journal Article] New Cycling Environment Using Multimodal Knowledge and Ad-hoc Network2004

    • Author(s)
      Yoshitaki, Sakane, Takebayashi
    • Journal Title

      IEICE Transactions on Information and Systems Vol.E-87-D No.6

      Pages: 1377-1385

    • NAID

      110003214011

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A Design of Ubiquitous Karate School for Learning Mind and Body Interaction2004

    • Author(s)
      Sakane, Takahata, Otani, Kuroki, Takebayashi
    • Journal Title

      Advances in Pervasive Computing

      Pages: 345-350

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Mountaineering Supporting System2004

    • Author(s)
      Kuroki, Yoshitaki, Sakane, Takebayashi
    • Journal Title

      Advances in Pervasive Computing

      Pages: 297-301

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A DESIGN OF THE UBIQUITOUS KARATE SCHOOL FOR LEARNING MIND AND BODY INTERACTION2004

    • Author(s)
      Y.Sakane, M.Takahata, N.Otani, Y.Kuroki, Y.Takebayashi
    • Journal Title

      Pervasive 2004, Advances in Pervasive Computing

      Pages: 345-350

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] A MOUNTAINEERING SUPPORTING SYSTEM2004

    • Author(s)
      Y.Kuroki, S.Yoshitaki, Y.Sakane, Y.Takebayashi
    • Journal Title

      Pervasive 2004, Advances in Pervasive Computing

      Pages: 297-301

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] さりげない役立ち情報の提示による居住者とのアット・ホームなインタラクション2004

    • Author(s)
      安念克洋, 山本剛, 天野竜太, 水谷文俊, 秡川友宏, 坂根裕, 竹林洋一
    • Journal Title

      人工知能学会第18回全国大会 2E1-01

      Pages: 1-2

    • NAID

      130004653452

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] ユビキタスカメラと音声入力を利用した仕事中のマルチモーダル知識の収集と利用2004

    • Author(s)
      大谷尚史, 藤城卓己, 坂根裕, 竹材洋一
    • Journal Title

      人工知能学会第18回全国大会 1D1-03

      Pages: 1-4

    • NAID

      130004653569

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 円滑なコミユニケーションスキル獲得のための英語教育支援システム2004

    • Author(s)
      木寺敦則, 桐山伸也, 堀内裕晃, 竹林洋一
    • Journal Title

      人工知能学会第18回全国大会 3E1-01

      Pages: 1-2

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] サイクリスト支援のためのマルチモーダルナレッジとコミュニケーション環境のデザイン2004

    • Author(s)
      吉滝幸世, 田森裕邦, 坂根裕, 竹利洋一
    • Journal Title

      人工知能学会第18回全国大会 1B3-05

      Pages: 1-3

    • NAID

      130004653540

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] ユビキタスセンシング技術を用いた空手の試合における駆け引きの記録2004

    • Author(s)
      高畠政実, 青島大悟, 坂根裕, 白井正博, 杉山岳弘, 竹林洋一
    • Journal Title

      人工知能学会第18回全国大会 2B1-01

      Pages: 1-2

    • NAID

      130004653402

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] DJインタフェースを用いたクラブの音環境デザイン2004

    • Author(s)
      白木顕介, 坂根裕, 杉山岳弘, 竹林洋一
    • Journal Title

      人工知能学会第18全国大会 1B3-05

      Pages: 1-2

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A Mountaineering Supporting System2004

    • Author(s)
      Kuroki, Yoshitaki, Sakane, Takebayashi
    • Journal Title

      Advances in Pervasive Computing

      Pages: 297-301

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Airy Displays to Portray Utillity Information2004

    • Author(s)
      K.Annen, G.Yamamoto, R.Amano, F.mizutani, T.Haraikawa, Y.Sakane, Y.Takebayashi
    • Journal Title

      The 18^<th> Annual Conference of the Japanese Society for Artificial Intelligence, 2004 2E1-01

      Pages: 1-2

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Representation and Use of Multimodal Knowledge on the Task by using Ubiquitous Cameras2004

    • Author(s)
      N.Otani, T.Fujishiro, Y.Sakane, Y.Takebayashi
    • Journal Title

      The 18^<th> Annual Conference of the Japanese Society for Artificial Intelligence, 2004 1D1-03

      Pages: 1-4

    • NAID

      40020007363

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Education Support System for Improvement of Knowledge and Communicative Skills in English2004

    • Author(s)
      A.Kidera, S.Kiriyama, H.Horiuchi, Y.Takebayashi
    • Journal Title

      The 18^<th> Annual Conference of the Japanese Society for Artificial Intelligence, 2004 3E1-O1

      Pages: 1-2

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A Design of Multimodal Knowledge and Communication Environment for Cycling Community2004

    • Author(s)
      S.Yoshitaki, H.Tamori, Y.Sakane, Y.Takebayashi
    • Journal Title

      The 18^<th> Annual Conference of the Japanese Society for Artificial Intelligence, 2004 1B3-05

      Pages: 1-3

    • NAID

      40020007327

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Extraction of Player's Tactics in the Karate Match using Ubiquitous Sensing Technology2004

    • Author(s)
      M.Takahata, D.Aoshima, Y.Sakane, M.Shirai, T.Sugiyama, Y.Takebayashi
    • Journal Title

      The 18^<th> Annual Conference of the Japanese Society for Artificial Intelligence, 2004 2B1-01

      Pages: 1-2

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A Design of Acoustic Environment Using DJ Interfaces2004

    • Author(s)
      K.Shirai, Y.Sakane, T.Sugiyama, Y.Takebayashi
    • Journal Title

      The 18^<th> Annual Conference of the Japanese Society for Artificial Intelligence, 2004 1B3-05

      Pages: 1-2

    • NAID

      10012520287

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A MOUNTAINEERING SUPPORTING SYSTEM2004

    • Author(s)
      Y.Kuroki, S.Yoshitaki, Y.Sakane, Y.Takabayashi
    • Journal Title

      Pervasive 2004, Advances in Pervasive Computing

      Pages: 297-301

    • Related Report
      2004 Annual Research Report
  • [Journal Article] さりげない役立ち情報の提示による居住者とのアット・ホームなインタラクション2004

    • Author(s)
      安念克洋, 山本剛, 天野竜太, 水谷文俊, 祓川友宏, 坂根裕, 竹林洋一
    • Journal Title

      人工知能学会第18回全国大会 2E1-01

    • NAID

      130004653452

    • Related Report
      2004 Annual Research Report
  • [Journal Article] ユビキタスカメラと音声入力を利用した仕事中のマルチモーダル知識の収集と利用2004

    • Author(s)
      大谷尚史, 藤城卓己, 坂根裕, 竹林洋一
    • Journal Title

      人工知能学会第18回全国大会 1D1-03

    • NAID

      130004653569

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 円滑なコミュニケーションスキル獲得のための英語教育支援システム2004

    • Author(s)
      木寺敦則, 桐山伸也, 堀内裕晃, 竹林洋一
    • Journal Title

      人工知能学会第18回全国大会 3E1-01

    • Related Report
      2004 Annual Research Report
  • [Journal Article] サイクリスト支援のためのマルチモーダルナレッジとコミュニケーション環境のデザイン2004

    • Author(s)
      吉滝幸世, 田森裕邦, 坂根裕, 竹林洋一
    • Journal Title

      人工知能学会第18回全国大会 1B3-05

    • NAID

      130004653540

    • Related Report
      2004 Annual Research Report
  • [Journal Article] DJインタフェースを用いたクラブの音環境デザイン2004

    • Author(s)
      白木顕介, 坂根裕, 杉山岳弘, 竹林洋一
    • Journal Title

      人工知能学会第18回全国大会 1B3-05

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Cycling Support System Using Multimodal Knowledge and Ad-hoc Network2003

    • Author(s)
      Yoshitaki, Sakane, Takebayashi
    • Journal Title

      HCI International 2003, Adjunct Proceedings

      Pages: 297-298

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Multimodal Knowledge Creation in Ubiquitous Learning2003

    • Author(s)
      Takebayashi, Sugiiyama, Sakane
    • Journal Title

      Proceedings of UME 2003

      Pages: 49-52

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] マルチモーダルヘッドセットを用いたうなずき検出と会話の重要箇所把握2003

    • Author(s)
      山本 剛, 坂根裕, 竹林洋一
    • Journal Title

      情報処理学会ヒューマンインタフェース研究会論文集 2003-HI-105

      Pages: 13-19

    • NAID

      110002911813

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Multimodal Knowledge Creation in Ubiquitous Learning2003

    • Author(s)
      Takebayashi, Sugiyama, Sakane
    • Journal Title

      Proceedings of UME 2003

      Pages: 49-52

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Nod detection and Retrieval of meaningful communications with a Multemodal headset2003

    • Author(s)
      G.Yamamoto, Y.Sakane, Y.Takebayashi
    • Journal Title

      IPSJ SIG Technical Report 2003-HI-105

      Pages: 13-19

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Publications] Yoshitaki, Sakane, Takebayashi: "New Cycling Environment Using Multimodal Knowledge and Ad-hoc Network"IEICE Transactions on Information and Systems. (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] Yoshitaki, Sakane, Takebayashi: "Cycling Support System Using Multimodal Knowledge and Ad-hoc Network"HCI International 2003, Adjunct Proceedings. 297-298 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Takebayashi, Sugijyama, Sakane: "Multimodal Knowledge Creation in Ubiquitous Learning"Proceedings of UME 2003. 49-52 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Sakane, Takahata, Otani, Kuroki, Takebayashi: "A Design of Ubiquitous Karate School for Learning Mind and Body Interaction"Advances in Pervasive Computing. (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] Kuroki, Yoshitaki, Sakane, Takebayashi: "A Mountainecring Supporting System"Advances in Pervasive Computing. (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] 山本, 坂根, 竹林: "マルチモーダルヘッドセットを用いたうなずき検出と会話の重要箇所把握"情報処理学会ヒューマンインタフェース研究会論文集. 13-19 (2003)

    • Related Report
      2003 Annual Research Report

URL: 

Published: 2003-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi