• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Non-verbal Communication based on Mutual Understanding between Human and Robot

Research Project

Project/Area Number 16K12495
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Soft computing
Research InstitutionTokyo Metropolitan University

Principal Investigator

Kubota Naoyuki  首都大学東京, システムデザイン研究科, 教授 (30298799)

Co-Investigator(Kenkyū-buntansha) 武田 隆宏  第一工業大学, 工学部, 助教 (70748186)
大保 武慶  東京工芸大学, 工学部, 助教 (60771889)
Research Collaborator WOO jinseok  
Project Period (FY) 2016-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2018: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2017: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2016: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Keywordsノンバーバルコミュニケーション / ジェスチャ / 協調的理解 / ロボットパートナー / ソフトコンピューティング / 知能ロボティクス / 情報構造化空間
Outline of Final Research Achievements

Recently, the importance of non-verbal communication has been increasing in the study on human-robot coexisting, but most of them focus on the simple gestures for proto-pointing and for command to control robots. Therefore, in this study, we discuss the methodology to realize (1) cooperative understanding of referential intention and social intention included in pointing (2) iconic gestures used for communication between human and robot from constructivism approach and systems approach. In this report, we propose the recognition method for pointing gestures and iconic gestures. Next, we conduct several experiments using the proposed method and discuss the effectiveness of the proposed method. Finally, we discuss the future research direction on the mutual understanding of non-verbal communication.

Academic Significance and Societal Importance of the Research Achievements

本研究は、人間とロボットが共生するためのノンバーバルコミュニケーションの一つとして指さしと物まねを学際的な観点から議論した点が学術的な特色である。特に、物まねに基づくアイコン的ジェスチャの認識は、行為的表象、映像的表象、象徴的表象の相互互換性が重要であり、相関的な学習が必要不可欠であることがわかった。また、指さしによる多段階の伝達意図の理解は状況依存性が高い反面、成功すれば、少ないジェスチャで多くを伝えあえることもわかった。本研究を通して得られた成果や知見は、原初的コミュニケーションなどを扱う認知発達心理学や生態心理学をはじめ、発達障害に関する療育など様々な研究分野の発展にも貢献できる。

Report

(4 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Research-status Report
  • 2016 Research-status Report
  • Research Products

    (5 results)

All 2019 2018 2017

All Journal Article (1 results) (of which Peer Reviewed: 1 results) Presentation (4 results) (of which Int'l Joint Research: 3 results)

  • [Journal Article] Nonverbal Communication based on Instructed Learning for Socially Embedded Robot Partners2019

    • Author(s)
      Ryosuke Tanaka, Jinseok Woo and Naoyuki Kubota
    • Journal Title

      Journal of Advanced Computational Intelligence and Intelligent Informatics (JACIII)

      Volume: 23(3)

    • NAID

      130007651640

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Presentation] Interaction Design Using Multi-Robot System for Information Support2018

    • Author(s)
      Jinseok Woo, Kouhei Yamamoto and Naoyuki Kubota
    • Organizer
      2018 International Conference on Fuzzy Theory and Its Applications (iFuzzy 2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Cognitive Environment System by Joint Attention Behaviors and Relevance Theory for Robot Partners2018

    • Author(s)
      Ryosuke Tanaka, Jinseok Woo and Naoyuki Kubota
    • Organizer
      2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC 2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Cooperative Human-Robot Interaction based on Pointing Gesture in Informationally Structured Space2018

    • Author(s)
      大保武慶, 川端崚介, 久保田直行
    • Organizer
      World Automation Congress 2018
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] 指さし・物まね行為を用いた人とロボットのコミュニケーションシステム2017

    • Author(s)
      粕谷千秋, 大保武慶, 武田隆宏, 久保田直行
    • Organizer
      第18回 計測自動制御学会システムインテグレーション部門講演会
    • Related Report
      2017 Research-status Report

URL: 

Published: 2016-04-21   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi