• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Synthesis of motion representation based on geometric operation in the stochastic space of motions and language

Research Project

Project/Area Number 17K20000
Research Category

Grant-in-Aid for Challenging Research (Exploratory)

Allocation TypeMulti-year Fund
Research Field Human informatics and related fields
Research InstitutionOsaka University

Principal Investigator

Takano Wataru  大阪大学, 数理・データ科学教育研究センター, 特任教授(常勤) (30512090)

Project Period (FY) 2017-06-30 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥6,370,000 (Direct Cost: ¥4,900,000、Indirect Cost: ¥1,470,000)
Fiscal Year 2019: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
Fiscal Year 2018: ¥2,470,000 (Direct Cost: ¥1,900,000、Indirect Cost: ¥570,000)
Fiscal Year 2017: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Keywordsロボット / 自然言語 / 機械学習 / 運動 / 人工知能 / 統計的情報処理 / 言語
Outline of Final Research Achievements

Language is absolutely essential for a robot to be implemented into our daily life that lies on the highly sophisticated intelligence based on symbols and language. In this research, we have presented a stochastic mathematical model with multiple hidden layers to represent the association between human motions and their descriptive language. The motions and language set to the input and output layer, respectively. The input layer are connected to the output layer via multiple hidden layers, and the connection is specified the probabilistic parameters, such as probability of hidden state being generated from an input. We have derived an algorithm to optimize these parameters. It implies than the association between the motion and language can be extracted as the distribution of hidden variables in their space. This model makes it possible to convert motion data into their descriptive sentence.

Academic Significance and Societal Importance of the Research Achievements

本研究成果では,運動と言語を結ぶ多層統計モデルの学習法を提案し,行動を言語表現に変換することを実現した.確率パラメータの性質を利用した最適化計算は.新たな学習アルゴリズムであり,学術的意義がある.また,開発した技術は,行動を言語として理解するロボットの基盤となり,研究室,介護施設,病院などの人間行動を言語化する応用研究に発展している.ロボットや人工システムが日常生活に浸透することを加速させる社会的意義がある.

Report

(4 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (19 results)

All 2020 2019 2018 2017 Other

All Journal Article (6 results) (of which Peer Reviewed: 6 results,  Open Access: 5 results) Presentation (12 results) (of which Int'l Joint Research: 4 results,  Invited: 4 results) Remarks (1 results)

  • [Journal Article] Annotation Generation from IMU-Based Human Whole-Body Motions in Daily Life Behavior2020

    • Author(s)
      Wataru Takano
    • Journal Title

      IEEE Transactions on Human-Machine Systems

      Volume: 50 Pages: 13-21

    • DOI

      10.1109/sii46433.2020.9026240

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Action Description from 2D Human Postures in Care Facilities2020

    • Author(s)
      Wataru Takano, Haeyeon Lee
    • Journal Title

      IEEE Robotics and Automation Letters

      Volume: 5 Issue: 2 Pages: 774-781

    • DOI

      10.1109/lra.2020.2965394

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Representation and Classification of Whole-body Motion Integrated with Finger Motion2020

    • Author(s)
      Wataru Takano, Yusuke Murakami, Yoshihiko Nakamura
    • Journal Title

      Robotics and Autonomous Systems

      Volume: 124 Pages: 103378-103378

    • DOI

      10.1016/j.robot.2019.103378

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] A Data-driven Approach to Probabilistic Impedance Control for Humanoid Robots2020

    • Author(s)
      Wataru Takano, Hiroki Kanayama, Taro Takahashi, Tomohisa Moridaira, Yoshihiko Nakamura
    • Journal Title

      Robotics and Autonomous Systems

      Volume: 124 Pages: 103353-103353

    • DOI

      10.1016/j.robot.2019.103353

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Linking Human Motions and Objects to Language for Synthesizing Action Sentences2019

    • Author(s)
      Wataru Takano, Yoshihiko Yamada, Yoshihiko Nakamura
    • Journal Title

      Autonomous Robots

      Volume: Vol.43, No.4 Issue: 4 Pages: 913-925

    • DOI

      10.1007/s10514-018-9762-1

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Bilateral Remote Teaching and Autonomous Task Execution with Task Progress Feedback2018

    • Author(s)
      Yasuhiro Ishiguro, Wataru Takano, Yoshihiko Nakamura
    • Journal Title

      Advanced Robotics

      Volume: 32 Issue: 6 Pages: 311-324

    • DOI

      10.1080/01691864.2018.1441746

    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Presentation] Action Description from 2D Human Postures in Care Facilities2020

    • Author(s)
      Wataru Takano, Haeyeon Lee
    • Organizer
      IEEE International Conference on Robotics and Automation
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Sentence Generation from IMU-based Human Whole-Body Motions in Daily Life Behaviors2020

    • Author(s)
      Wataru Takano
    • Organizer
      The 2020 IEEE/SICE International Symposium on System Integration
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 高齢者行動の言語化を用いた自動介護日誌システムの開発2019

    • Author(s)
      高野 渉
    • Organizer
      第20回計測自動制御学会システムインテグレーション部門講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 多層統計モデルを用いた運動の言語化2019

    • Author(s)
      高野 渉
    • Organizer
      第37回日本ロボット学会学術講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 運動知識を活用した単カメラ映像から全身運動の3次元再構成法2019

    • Author(s)
      高野 渉
    • Organizer
      第37回日本ロボット学会学術講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 介護施設における2次元姿勢推定を用いた行動識別と言語化2019

    • Author(s)
      高野渉, 李海妍
    • Organizer
      日本機械学会ロボティクスメカトロニクス講演会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 体操における運動の分節化とその時系列統合による技の自動認識2018

    • Author(s)
      高野渉,中村仁彦
    • Organizer
      第36回日本ロボット学会学術講演会
    • Related Report
      2018 Research-status Report
  • [Presentation] Robotics and Artificial Intelligence for Human/Robot Movements2018

    • Author(s)
      Wataru Takano
    • Organizer
      IEEE International Conference on Robotics and Biomimetics
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] On Human Activity Dataset for Humanoid Robots2018

    • Author(s)
      Wataru Takano
    • Organizer
      The Workshop on the Latest Advances in Big Activity Data Sources for Robotics & New Challenges in IEEE International Conference on Intelligent Robots and Systems
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] 人間・ロボットの全身運動と言語の学習~深層学習への展開~2018

    • Author(s)
      高野渉
    • Organizer
      第36回日本ロボット学会学術講演会
    • Related Report
      2018 Research-status Report
    • Invited
  • [Presentation] Incorrect Label Detection Using Convolutional Autoencoder in Labeling Task of Optical Motion Capture Data2017

    • Author(s)
      Ikuo Kusajima, Wataru Takano, Yoshihiko Nakamura
    • Organizer
      The 2017 IEEE/SICE International Symposium on System Integration
    • Related Report
      2017 Research-status Report
  • [Presentation] Statistical Translation between Human/Robot Behaviors and Language2017

    • Author(s)
      Wataru Takano
    • Organizer
      The 3rd Japan-EU Workshop on Neurorobotics
    • Related Report
      2017 Research-status Report
    • Invited
  • [Remarks] Robotics & Data Science Lab - Research -

    • URL

      http://www-mmds.sigmath.es.osaka-u.ac.jp/faculty/personal/takano/research

    • Related Report
      2019 Annual Research Report

URL: 

Published: 2017-07-21   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi