• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Analyzing group decision making process based on multimodal conversation modeling

Research Project

Project/Area Number 15K00300
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Intelligent informatics
Research InstitutionJapan Advanced Institute of Science and Technology (2017)
Tokyo Institute of Technology (2015-2016)

Principal Investigator

Okada Shogo  北陸先端科学技術大学院大学, 先端科学技術研究科, 准教授 (00512261)

Project Period (FY) 2015-04-01 – 2018-03-31
Project Status Completed (Fiscal Year 2017)
Budget Amount *help
¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
Fiscal Year 2017: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2016: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2015: ¥2,600,000 (Direct Cost: ¥2,000,000、Indirect Cost: ¥600,000)
Keywordsマルチモーダルインタラクション / 社会的信号処理 / 機械学習 / データマイニング / グループディスカッション / Social Signal Processing / グループプロセス / インタラクションマイニング / コミュニケーション支援 / 会話解析システム
Outline of Final Research Achievements

This research project focuses on group discussion for a problem solving and develops a framework for analyzing the group decision making process based on verbal and nonverbal (multimodal) information which observed from group members.We defined the quality of group output as an index set of social science (“product dimension”), which proposed by Hackman. The annotation data of the quality of group output has been collected. The machine learning model it developed to predict the product dimension from multimodal information including dialog transcription, head motion, speech prosody and turn taking. Novel co-occurrence data mining is proposed to capture the group interaction and multimodal patterns. Through the machine learning modeling and data mining,the specific multimodal features observed in group discussion process with high/low quality can be discovered automatically. Best prediction accuracy of product dimension is 82 % in binary classification task (high or low of quality).

Report

(4 results)
  • 2017 Annual Research Report   Final Research Report ( PDF )
  • 2016 Research-status Report
  • 2015 Research-status Report
  • Research Products

    (37 results)

All 2018 2017 2016 2015 Other

All Int'l Joint Research (1 results) Journal Article (14 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 14 results,  Open Access: 4 results,  Acknowledgement Compliant: 5 results) Presentation (19 results) (of which Int'l Joint Research: 6 results) Remarks (2 results) Patent(Industrial Property Rights) (1 results)

  • [Int'l Joint Research] IDIAP Research Institute/EPFL(Switzerland)

    • Related Report
      2015 Research-status Report
  • [Journal Article] Analysis on the Participants' Functional Roles and their Transitions in Group Discussion Conversation2018

    • Author(s)
      張 琪、黄 宏軒、木村 清也、岡田 将吾、大田 直樹、桑原 和宏
    • Journal Title

      The Transactions of Human Interface Society

      Volume: 20 Issue: 1 Pages: 31-44

    • DOI

      10.11184/his.20.1_31

    • NAID

      130006401342

    • ISSN
      1344-7262, 2186-8271
    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Multimodal conflict scene recognition in negotiation dialogue2018

    • Author(s)
      Shogo Okada, Akihiro Matsuda, Katsumi Nitta
    • Journal Title

      Springer Lecture Notes in Computer Science (LNCS)

      Volume: V

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Investigating Effectiveness of Linguistic Features Based on Speech Recognition for Storytelling Skill Assessment2018

    • Author(s)
      Shogo Okada, Kazunori Komatani
    • Journal Title

      Springer Lecture Notes in Computer Science (LNCS)

      Volume: --

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Modeling Content Structures of Domain-Specific Texts with RUP-HDP-HSMM and Its Applications2017

    • Author(s)
      Youwei Lu, Shogo Okada, Katsumi Nitta:
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E100.D Issue: 9 Pages: 2126-2137

    • DOI

      10.1587/transinf.2017EDP7043

    • NAID

      130006038441

    • ISSN
      0916-8532, 1745-1361
    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Argumentation Support Tool with Modularization Function and Its Evaluation2017

    • Author(s)
      Yuki Katsura, Kei Nishina, Shogo Okada and Katsumi Nitta
    • Journal Title

      Advances in Social Computing and Digital Education

      Volume: vol 677 Pages: 117-135

    • DOI

      10.1007/978-3-319-52039-1_8

    • ISBN
      9783319520384, 9783319520391
    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Proposal of a Model to Determine the Attention Target for an Agent in Group Discussion with Non-verbal Features.2017

    • Author(s)
      Seiya Kimura, Hung-Hsuan Huang, Qi Zhang, Shogo Okada, Naoki Ohta, Kazuhiro Kuwabara
    • Journal Title

      In Proceedings of the 5th International Conference on Human Agent Interaction (HAI '17).

      Volume: vol 1 Pages: 195-202

    • DOI

      10.1145/3125739.3125775

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Toward a Supporting System of Communication Skill: The Influence of Functional Roles of Participants in Group Discussion2017

    • Author(s)
      Qi Zhang, Hung-Hsuan Huang, Seiya Kimura, Shogo Okada, Yuki Hayashi, Yutaka Takase, Yukiko I. Nakano, Naoki Ohta, Kazuhiro Kuwabara:
    • Journal Title

      Lecture Notes in Computer Science, Springer

      Volume: vol 10283. Pages: 178-188

    • DOI

      10.1007/978-3-319-58562-8_14

    • ISBN
      9783319585611, 9783319585628
    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Recognizing Words from Gestures: Discovering Gesture Descriptors Associated with Spoken Utterances,2017

    • Author(s)
      Shogo Okada, Kazuhiro Otsuka
    • Journal Title

      Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition

      Volume: -

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Weibull Partition Models with Applications to Hidden Semi-Markov Models2017

    • Author(s)
      Youwei Lu, Shogo Okada, Katsumi Nitta
    • Journal Title

      Proceedings of INNS IEEE International Joint Conference on Neural Networks (IJCNN 2017)

      Volume: -

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Estimating Communication Skills based on Multimodal Information in Group Discussions2016

    • Author(s)
      岡田将吾, 松儀良広, 中野有紀子, 林佑樹, 黄宏軒, 高瀬裕, 新田克己
    • Journal Title

      Transactions of the Japanese Society for Artificial Intelligence

      Volume: 31 Issue: 6 Pages: AI30-E_1-12

    • DOI

      10.1527/tjsai.AI30-E

    • NAID

      130005277075

    • ISSN
      1346-0714, 1346-8030
    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Estimating communication skills using dialogue acts and nonverbal features in multiple discussion datasets2016

    • Author(s)
      Shogo Okada, Shogo Okada, Yoshihiko Ohtake, Yukiko I. Nakano, Yuki Hayashi, Hung-Hsuan Huang, Yutaka Takase, Katsumi Nitta
    • Journal Title

      Proceedings of ACM International Conference on Multimodal Interaction (ICMI)

      Volume: 1 Pages: 169-176

    • DOI

      10.1145/2993148.2993154

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Fashion image classification on mobile phones using layered deep convolutional neural networks2016

    • Author(s)
      Kazunori Hori, Shogo Okada, Katsumi Nitta
    • Journal Title

      Proceedings of International Conference on Mobile and Ubiquitous Multimedia (MUM 2016)

      Volume: 1 Pages: 359-361

    • DOI

      10.1145/3012709.3016075

    • Related Report
      2016 Research-status Report
    • Peer Reviewed
  • [Journal Article] Predicting performance of collaborative storytelling using multimodal analysis2016

    • Author(s)
      Shogo Okada, Mi Hang, Katsumi Nitta
    • Journal Title

      IEICE Transaction D

      Volume: E99-D,No.6

    • NAID

      130005154709

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Personality Trait Classification via Co-Occurrent Multiparty Multimodal Event Discovery2015

    • Author(s)
      Shogo Okada, Oya Aran, Daniel Gatica-Perez
    • Journal Title

      Proceedings of the ACM International Conference on Multimodal Interaction (ICMI)

      Volume: 1 Pages: 15-22

    • DOI

      10.1145/2818346.2820757

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Presentation] 社会的信号処理と人工知能2017

    • Author(s)
      岡田将吾
    • Organizer
      電子情報通信学会 ヴァーバル・ノンヴァーバル・コミュニケーション研究会
    • Place of Presentation
      東京都 江東区
    • Year and Date
      2017-03-29
    • Related Report
      2016 Research-status Report
  • [Presentation] 交渉対話におけるマルチモーダル情報に基づいた対立場面の推定2017

    • Author(s)
      松田章洋・岡田将吾・新田克己
    • Organizer
      人工知能学会 言語・音声理解と対話処理研究会(SLUD)第79回研究会
    • Place of Presentation
      広島県 広島市
    • Year and Date
      2017-03-08
    • Related Report
      2016 Research-status Report
  • [Presentation] インタビュー対話における重要シーン推定のための言語・非言語特徴量の分析2017

    • Author(s)
      石原 卓弥, 長澤 史記, 岡田 将吾, 新田 克己
    • Organizer
      第30回人工知能学会全国大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] ユーザーの態度推定に基づき適応的なインタビューを行うロボット対話システムの開発2017

    • Author(s)
      長澤 史記, 石原 卓弥, 岡田 将吾, 新田 克己
    • Organizer
      第30回人工知能学会全国大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Proposal of a Model to Determine the Attention Target for an Agent in Group Discussion with Non-verbal Features.2017

    • Author(s)
      Seiya Kimura, Hung-Hsuan Huang, Qi Zhang, Shogo Okada, Naoki Ohta, Kazuhiro Kuwabara
    • Organizer
      International Conference on Human Agent Interaction (HAI '17).
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Recognizing Words from Gestures: Discovering Gesture Descriptors Associated with Spoken Utterances.2017

    • Author(s)
      Shogo Okada, Kazuhiro Otsuka
    • Organizer
      IEEE 12th International Conference on Automatic Face & Gesture Recognition
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Toward a Supporting System of Communication Skill: The Influence of Functional Roles of Participants in Group Discussion2017

    • Author(s)
      Qi Zhang, Hung-Hsuan Huang, Seiya Kimura, Shogo Okada, Yuki Hayashi, Yutaka Takase, Yukiko I. Nakano, Naoki Ohta, Kazuhiro Kuwabara:
    • Organizer
      HCI International 2017
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] マルチモーダル情報を利用した議論エージェント2017

    • Author(s)
      濱田貴大, 長澤史記,石原卓弥,平田勇人,岡田将吾,新田克己
    • Organizer
      HAIシンポジウム
    • Related Report
      2017 Annual Research Report
  • [Presentation] マルチモーダル情報に基づくインタビューにおける重要シーンの推定2017

    • Author(s)
      石原 卓弥, 長澤 史記, 岡田 将吾, 新田 克己
    • Organizer
      HCGシンポジウム2017
    • Related Report
      2017 Annual Research Report
  • [Presentation] ユーザーの態度推定に基づき適応的なインタビューを行うロボット対話システムの開発2017

    • Author(s)
      長澤 史記, 石原 卓弥, 岡田 将吾, 新田 克己
    • Organizer
      人工知能学会 言語・音声理解と対話処理研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Fashion image classification on mobile phones using layered deep convolutional neural networks2016

    • Author(s)
      Kazunori Hori, Shogo Okada, Katsumi Nitta
    • Organizer
      International Conference on Mobile and Ubiquitous Multimedia (MUM 2016)
    • Place of Presentation
      Rovaniemi, Finland
    • Year and Date
      2016-12-12
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] マルチモーダルモデリングに基づくコミュニケーション能力とグループディスカッションタスクの関連性分析2016

    • Author(s)
      岡田 将吾, 大竹 圭彦, 中野 有紀子, 林 佑樹, 黄 宏軒, 高瀬 裕, 新田 克己
    • Organizer
      HCGシンポジウム2016
    • Place of Presentation
      高知県 高知市
    • Year and Date
      2016-12-07
    • Related Report
      2016 Research-status Report
  • [Presentation] インタラクティブ発表場における発表者と聴衆の行動分析2016

    • Author(s)
      松儀 良広・岡田 将吾・新田 克己・山崎 啓介
    • Organizer
      HCGシンポジウム2016
    • Place of Presentation
      高知県 高知市
    • Year and Date
      2016-12-07
    • Related Report
      2016 Research-status Report
  • [Presentation] Estimating communication skills using dialogue acts and nonverbal features in multiple discussion datasets2016

    • Author(s)
      Shogo Okada, Shogo Okada, Yoshihiko Ohtake, Yukiko I. Nakano, Yuki Hayashi, Hung-Hsuan Huang, Yutaka Takase, Katsumi Nitta
    • Organizer
      ACM International Conference on Multimodal Interaction (ICMI)
    • Place of Presentation
      Tokyo, JAPAN
    • Year and Date
      2016-11-12
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] ループディスカッションにおいて現れるコミュニケーション能力のマルチモーダル分析2016

    • Author(s)
      岡田 将吾, 松儀 良広, 中野 有紀子, 林 佑樹, 黄 宏軒, 高瀬 裕, 新田 克己
    • Organizer
      人工知能学会 言語・音声理解と対話処理研究会(SLUD)第77回研究会
    • Place of Presentation
      京都府 京都市
    • Year and Date
      2016-08-10
    • Related Report
      2016 Research-status Report
  • [Presentation] コミュニケーショングラウンディングに基づく会話研究2016

    • Author(s)
      岡田 将吾
    • Organizer
      電子情報通信学会 ヴァーバル・ノンヴァーバル・コミュニケーション研究会
    • Place of Presentation
      東京
    • Year and Date
      2016-03-26
    • Related Report
      2015 Research-status Report
  • [Presentation] マルチモーダル非言語情報を用いた会話中に観測されるジェスチャの機能認識精度の向上2015

    • Author(s)
      岡田 将吾,坊農 真弓,高梨 克也,角 康之,新田 克己
    • Organizer
      電子情報通信学会 HCG シンポジウム 2015
    • Place of Presentation
      富山
    • Year and Date
      2015-12-16
    • Related Report
      2015 Research-status Report
  • [Presentation] Personality Trait Classification via Co-Occurrent Multiparty Multimodal Event Discovery2015

    • Author(s)
      Shogo Okada
    • Organizer
      17th ACM International Conference on Multimodal Interaction (ICMI)
    • Place of Presentation
      Seattle, Washington, USA
    • Year and Date
      2015-11-09
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] 説明行為の質の推定に向けた会話者のマルチモーダル情報モデリング2015

    • Author(s)
      岡田将吾, 米 航, 新田 克己
    • Organizer
      第74回 人工知能学会言語・音声理解と対話処理研究会 SIG-SLUD
    • Place of Presentation
      千葉
    • Year and Date
      2015-07-22
    • Related Report
      2015 Research-status Report
  • [Remarks] Social Signal Interaction Group's homepage

    • URL

      http://www.jaist.ac.jp/~okada-s/

    • Related Report
      2017 Annual Research Report
  • [Remarks] Shogo Okada's HP

    • URL

      http://www.ntt.dis.titech.ac.jp/wordpress/

    • Related Report
      2015 Research-status Report
  • [Patent(Industrial Property Rights)] モデル学習装置、発話単語推定装置、モデル 学習方法、発話単語推定方法、プログラム2017

    • Inventor(s)
      岡田将吾、大塚和弘
    • Industrial Property Rights Holder
      岡田将吾、大塚和弘
    • Industrial Property Rights Type
      特許
    • Filing Date
      2017-03-28
    • Related Report
      2016 Research-status Report

URL: 

Published: 2015-04-16   Modified: 2019-03-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi