• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Multimodal Language Acquisition by Robots - Learning Case Particles

Research Project

Project/Area Number 15K00244
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Perceptual information processing
Research InstitutionOkayama Prefectural University

Principal Investigator

Iwahashi Naoto  岡山県立大学, 情報工学部, 教授 (90394999)

Project Period (FY) 2015-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000)
Fiscal Year 2017: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2016: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2015: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
Keywords記号創発ロボティクス / ヒューマンロボットインタラクション / 機械学習 / コミュニケーションモデル / ニューラルネットワーク / 言語獲得 / マルチモーダル / ディープラーニング / ロボット / 格助詞 / 総計的機械翻訳 / シーケンス間変換モデル
Outline of Final Research Achievements

The purpose of this research was to extend the learning using simple object manipulation instruction utterance consisting only of content words and verbs, which was conventionally possible, to sentences including case particles that are functional words.
We have successfully developed a neural network model that learns that robots respond to motion and speech (including case particles) with motion and speech (including case particles). The original features in this method are the following three: (1) Input information of human motion, speech, and situation image. (2) Output information on robot operation and speech. (3) Adaptively respond to multiple types of speech acts.
Furthermore, using this model, we also succeeded in modeling verbal communication in schizophrenic patients.

Academic Significance and Societal Importance of the Research Achievements

ロボットが、人間とのマルチモーダルなコミュニケーションを通して、実世界の事物に直接グラウンドしない機能語である格助詞とその文法上の機能を学習する手法は極めて独創的である。
動作と発話からなる人間の行為に対して、ロボットが、動作と発話で応答できるニューラルネットワークモデルを世界に先駆けて開発したことは、日本のディープラーニングのロボティクスおよび言語処理応用研究における高い競争力の維持に大いに貢献している。
さらに、精神科医療に対して、人工知能研究が貢献する道筋をつけることができたことは医学的にも大きな意義がある。

Report

(5 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Research-status Report
  • 2016 Research-status Report
  • 2015 Research-status Report
  • Research Products

    (18 results)

All 2018 2017 2016 2015 Other

All Journal Article (1 results) (of which Peer Reviewed: 1 results) Presentation (14 results) (of which Int'l Joint Research: 5 results,  Invited: 1 results) Remarks (3 results)

  • [Journal Article] Symbol emergence in robotics: a survey2016

    • Author(s)
      Tadahiro Taniguchi, Takayuki Nagai, Tomoaki Nakamura, Naoto Iwahashi, Tetsuya Ogata, Hideki Asoh
    • Journal Title

      Advanced Robotics

      Volume: 30 Issue: 11-12 Pages: 706-728

    • DOI

      10.1080/01691864.2016.1174370

    • Related Report
      2015 Research-status Report
    • Peer Reviewed
  • [Presentation] Neural Network Model for Human-Robot Multimodal Linguistic Interaction2018

    • Author(s)
      守屋綾祐、高渕健太、岩橋直人
    • Organizer
      HAI シンポジウム
    • Related Report
      2017 Research-status Report
  • [Presentation] Robot Language Acquisition Based on Sequence-to-Sequence Learning2017

    • Author(s)
      Ye Kyaw Thu, Kenta Takabuchi, Kaisei Fukai, Naoto Iwahashi and Takeo Kunishima
    • Organizer
      15th Int. Conf. Computer Application
    • Place of Presentation
      Yangon, The Republic of the Union of Myanmar
    • Year and Date
      2017-02-16
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] DNN-based Object Manipulation to Syllable Sequence for Language Acquisition2017

    • Author(s)
      K. Takabuchi, N. Iwahashi, Y.K. Thu and T. Kunishima
    • Organizer
      Int. Symp. Artificial Life and Robotics
    • Place of Presentation
      Beppu, Japan
    • Year and Date
      2017-01-19
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] DNN-based Language Acquisition for Object Manipulation Task2017

    • Author(s)
      K. Ye, K. Takabuchi, N. Iwahashi
    • Organizer
      International Conference on Development and Learning and on Epigenetic Robotics
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Symbol Grounding from Natural Conversation for Human-Robot Communication2017

    • Author(s)
      K. Ye, T. Ishida, N. Iwahashi, T. Nakamura, T. Nagai
    • Organizer
      International Conference on Human Agent Interaction
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] LRCNによる参照点に依存した動作の認識2017

    • Author(s)
      深井海星、武井豪輔、高渕健太、岩橋直人、Ye Kyaw Thu, 国島丈生
    • Organizer
      人工知能学会全国大会
    • Related Report
      2017 Research-status Report
  • [Presentation] 雑談を通した物体と単語の学習2017

    • Author(s)
      石田卓也、山本一馬、岩橋直人、Ye Kyaw Thu、中村友昭、長井隆行、国島丈生
    • Organizer
      人工知能学会全国大会
    • Related Report
      2017 Research-status Report
  • [Presentation] Robots that learn to communicate2017

    • Author(s)
      N. Iwahahsi
    • Organizer
      15th Int. Conf. Computer Application
    • Place of Presentation
      Yangon, The Republic of the Union of Myanmar
    • Related Report
      2016 Research-status Report
    • Invited
  • [Presentation] A Language Acquisition Method Based on Statistical Machine Translation for Application to Robots2016

    • Author(s)
      K. Takabuchi, N. Iwahashi and Takeo Kunishima
    • Organizer
      The Sixth Joint IEEE Int. Conf. Developmental Learning and Epigenetic Robotics
    • Place of Presentation
      Cergy-Pontoise France
    • Year and Date
      2016-09-19
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] 動画像情報と音声情報のシーケンス変換学習に基づく言語獲得2016

    • Author(s)
      高渕健太、岩橋直人、国島丈生
    • Organizer
      自然言語処理研究発表会
    • Place of Presentation
      総社市、岡山県
    • Year and Date
      2016-07-29
    • Related Report
      2016 Research-status Report
  • [Presentation] シーケンス変換モデルに基づくロボットによる言語獲得2016

    • Author(s)
      高渕健太、坂本伸次、植田紗也佳、岩橋直人、国島丈生
    • Organizer
      人工知能学会全国大会
    • Place of Presentation
      北九州市、福岡県
    • Year and Date
      2016-06-06
    • Related Report
      2016 Research-status Report
  • [Presentation] シーケンス変換モデルに基づくロボットによる言語獲得2016

    • Author(s)
      高渕健太, 坂本伸次, 植田紗也佳, 岩橋直人, 國島丈夫
    • Organizer
      2016年度人工知能学会全国大会(第27回)
    • Place of Presentation
      北九州国際会議場(福岡県・北九州市)
    • Year and Date
      2016-06-06
    • Related Report
      2015 Research-status Report
  • [Presentation] 統計的機械翻訳技術に基づくロボットの言語獲得2015

    • Author(s)
      坂本伸次, 植田紗也佳, 岩橋直人, 国島丈生
    • Organizer
      第17回IEEE広島学生シンポジウム(HISS2015)
    • Place of Presentation
      岡山大学(岡山県・岡山市)
    • Year and Date
      2015-11-21
    • Related Report
      2015 Research-status Report
  • [Presentation] ロボットによる実世界情報を用いた付属語の獲得2015

    • Author(s)
      植田紗也佳, 岩橋直人, 國島丈生
    • Organizer
      2015年度人工知能学会全国大会(第26回)
    • Place of Presentation
      公立はこだて未来大学(北海道・函館市)
    • Year and Date
      2015-05-31
    • Related Report
      2015 Research-status Report
  • [Remarks]

    • Related Report
      2018 Annual Research Report
  • [Remarks] Artificial Intelligence Laboratory

    • URL

      http://www-ime.c.oka-pu.ac.jp/index.html

    • Related Report
      2016 Research-status Report
  • [Remarks] OPU Artificial Intelligence Lab.

    • URL

      http://www-ime.c.oka-pu.ac.jp/

    • Related Report
      2015 Research-status Report

URL: 

Published: 2015-04-16   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi