• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

State Prediction and Motion Planning for Deformable Object Manipulation with Work Procedures

Research Project

Project/Area Number 20H04262
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 61050:Intelligent robotics-related
Research InstitutionShinshu University

Principal Investigator

Kimitoshi Yamazaki  信州大学, 学術研究院工学系, 教授 (00521254)

Project Period (FY) 2020-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥17,680,000 (Direct Cost: ¥13,600,000、Indirect Cost: ¥4,080,000)
Fiscal Year 2022: ¥5,850,000 (Direct Cost: ¥4,500,000、Indirect Cost: ¥1,350,000)
Fiscal Year 2021: ¥5,720,000 (Direct Cost: ¥4,400,000、Indirect Cost: ¥1,320,000)
Fiscal Year 2020: ¥6,110,000 (Direct Cost: ¥4,700,000、Indirect Cost: ¥1,410,000)
Keywords不定形物操作 / ロボット / 作業手順 / 動作計画 / 状態推定 / 柔軟物操作 / 知能ロボット / 不定形物 / 状態予測 / 操作方法獲得
Outline of Research at the Start

洗濯物を畳む・ベッドにシーツを敷く・食材を包丁で切り刻むなどの作業では,布や食材
などの不定形物に複数回の操作を加えることで,目標状態への遷移を実現している.このよ
うな手順を伴う不定形物作業を自動化するには,どのような操作をどのような順番で加える
べきかを,操作前および操作中の不定形物の状態によって臨機応変に決める必要がある.
本研究の目的は,上述したような「手順のある不定形物作業」の実現能力を自動機械
に獲得させる方法の確立である.

Outline of Final Research Achievements

The objective of this research is to establish methods for automatic machines to acquire the ability to realize "deformable object manipulation with procedures". For this purpose, we aimed to realize three functions. (a) the ability to predict the behavior of an deformable object, (b) the ability to manipulate a deformable object in order to give it a desired shape change, and (c) the ability to understand the manipulation procedure and to create an appropriate procedure. We have proposed a means to realize these abilities, and have demonstrated that autonomous robots can manipulate deformable objects, such as the folding of fabrics and clothes, through experiments.

Academic Significance and Societal Importance of the Research Achievements

自動機械による不定形物の操作を一つの実用的な分野として拡大するには,「不定形物の目標状態を提示すると,その状態へ移行させる方法を自動で考案し,操作を加え,作業を達成する」能力を自動機械に与えることが重要な要素の一つと考える.本研究では,そのような高い自律性を要する作業の実行能力に関する手法を提案し,さらには複数の事例を用いて検証する.これにより,不定形物作業の自動化の参入障壁を低くし,多くの研究者や技術者に受け入れられる土壌を創ることに貢献できると考える.

Report

(4 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • Research Products

    (28 results)

All 2023 2022 2021 2020

All Journal Article (11 results) (of which Peer Reviewed: 9 results,  Open Access: 8 results) Presentation (17 results) (of which Int'l Joint Research: 4 results,  Invited: 2 results)

  • [Journal Article] Multi-step Motion Learning by Combining Learning-from-Demonstration and Policy-Search2023

    • Author(s)
      Yaqiang Mo, Hikaru Sasaki, Takamitsu Matsubara and Kimitoshi Yamazaki
    • Journal Title

      Advanced Robotics

      Volume: - Issue: 9 Pages: 560-575

    • DOI

      10.1080/01691864.2022.2163187

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Visual Servoing in Virtualized Environments Based on Optical Flow Learning and Constrained Optimization2023

    • Author(s)
      Takuya Iwasaki, Solvi Arnold, Kimitoshi Yamazaki
    • Journal Title

      International Journal of Robotics and Automation

      Volume: 2023

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Cloth Manipulation Planning on Basis of Mesh Representations with Incomplete Domain Knowledge and Voxel-to-Mesh Estimation2023

    • Author(s)
      Solvi Arnold, Daisuke Tanaka, Kimitoshi Yamazaki
    • Journal Title

      Frontiers in Neurorobotics

      Volume: 16

    • DOI

      10.3389/fnbot.2022.1045747

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Robotic System for Assisting Long-sleeved Shirt Dressing Using Two Manipulators with Different Roles2023

    • Author(s)
      Keisuke Onda, Takahiro Yamazaki, Yutaka Takase, and Kimitoshi Yamazaki
    • Journal Title

      Proc. of the 2023 IEEE/SICE International Symposium on System Integration

      Volume: - Pages: 1050-1054

    • DOI

      10.1109/sii55687.2023.10039410

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Online State Estimation Using Optical Flow for Passing an Arm Through a Shirt Sleeve2022

    • Author(s)
      山崎隆広,アーノード・ソービ,山崎公俊
    • Journal Title

      Journal of the Robotics Society of Japan

      Volume: 40 Issue: 9 Pages: 817-826

    • DOI

      10.7210/jrsj.40.817

    • ISSN
      0289-1824, 1884-7145
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] End-effectors for Cloth Manipulation2022

    • Author(s)
      山崎公俊
    • Journal Title

      Journal of the Robotics Society of Japan

      Volume: 40 Issue: 5 Pages: 375-380

    • DOI

      10.7210/jrsj.40.375

    • ISSN
      0289-1824, 1884-7145
    • Related Report
      2022 Annual Research Report
    • Open Access
  • [Journal Article] A Robot System for Assisting Humans in Wearing Long-Sleeved Shirt2022

    • Author(s)
      Takahiro Yamazaki, Yutaka Takase, Kimitoshi Yamazaki
    • Journal Title

      Proc. of the 2022 IEEE International Conference on Mechatronics and Automation

      Volume: - Pages: 657-663

    • DOI

      10.1109/icma54519.2022.9855952

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] 製品製造自動化に向けた部品把持のためのビジョン技術2021

    • Author(s)
      山崎公俊
    • Journal Title

      画像ラボ

      Volume: 12 Pages: 67-72

    • Related Report
      2021 Annual Research Report
  • [Journal Article] A Motion Generation Method for Articulated Manipulators Using Linear Mapping Matrices Calculated by Neural Networks2021

    • Author(s)
      Kimitoshi Yamazaki
    • Journal Title

      Proc. of IEEE 17th International Conference on Automation Science and Engineering

      Volume: - Pages: 905-912

    • DOI

      10.1109/case49439.2021.9551436

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Disruption-Resistant Deformable Object Manipulation on basis of Online Shape Estimation and Prediction-Driven Trajectory Correction2021

    • Author(s)
      Daisuke Tanaka, Solvi Arnold, Kimitoshi Yamazaki
    • Journal Title

      IEEE Robotics and Automation Letters

      Volume: -

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Visual Servoing Using Virtual Space for Both Learning and Task Execution2021

    • Author(s)
      Tomoki Kawagoshi, Solvi Arnold, Kimitoshi Yamazaki
    • Journal Title

      Proc. of 2021 IEEE/SICE International Symposium on System Integration

      Volume: - Pages: 292-297

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Presentation] 作業状態予測を伴う操作軌道生成に基づく協調的着衣支援2022

    • Author(s)
      山崎隆広
    • Organizer
      計測自動制御学会中部支部シンポジウム2022
    • Related Report
      2022 Annual Research Report
  • [Presentation] 畳み込みニューラルネットワークを用いた垂下した衣服からの把持候補点検出2022

    • Author(s)
      恩田佳祐
    • Organizer
      計測自動制御学会中部支部シンポジウム2022
    • Related Report
      2022 Annual Research Report
  • [Presentation] Cloth Manipulation with Estimation of Material Properties2022

    • Author(s)
      Solvi Arnold
    • Organizer
      第40回日本ロボット学会学術講演会
    • Related Report
      2022 Annual Research Report
  • [Presentation] ニューラルネットワークを用いたモデル予測制御に基づく人との協調着衣2022

    • Author(s)
      山崎隆広
    • Organizer
      第40回日本ロボット学会学術講演会
    • Related Report
      2022 Annual Research Report
  • [Presentation] Cloth manipulation based on hierarchical shape prediction,2022

    • Author(s)
      Kimitoshi Yamazaki
    • Organizer
      2nd Workshop on Representing and Manipulating Deformable Objects
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Disruption-Resistant Deformable Object Manipulation on basis of Online Shape Estimation and Prediction-Driven Trajectory Correction2021

    • Author(s)
      Daisuke Tanaka
    • Organizer
      IEEE International Conference on Robotics and Automation
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Prediction, Estimation and Learning for Deformable Object Manipulation2021

    • Author(s)
      Kimitoshi Yamazaki
    • Organizer
      The Robotics Society of Japan (RSJ) and The Robotics Society (TRS, India) WORKSHOP
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 布のオンライン状態推定に基づく袖通し作業の実現2021

    • Author(s)
      山崎隆広
    • Organizer
      計測自動制御学会中部支部シンポジウム
    • Related Report
      2021 Annual Research Report
  • [Presentation] 人の実演教示に基づく個々の動作と動作の切り替えを考慮した手順あり作業の実行能力獲得2021

    • Author(s)
      莫亜強
    • Organizer
      第39回日本ロボット学会学術講演会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 仮想化環境にて学習したビジュアルサーボによる机上物体の把持2021

    • Author(s)
      岩崎拓也
    • Organizer
      第39回日本ロボット学会学術講演会
    • Related Report
      2021 Annual Research Report
  • [Presentation] オプティカルフローの学習に基づく着衣作業中の布製品のオンライン状態推定2021

    • Author(s)
      山崎 隆広
    • Organizer
      ロボティクス・メカトロニクス講演会2021
    • Related Report
      2021 Annual Research Report
  • [Presentation] 仮想化環境での学習による多様な障害物配置および目標物形状に対応可能なビジュアルサーボ2021

    • Author(s)
      岩崎拓也
    • Organizer
      ロボティクス・メカトロニクス講演会2021
    • Related Report
      2021 Annual Research Report
  • [Presentation] 柔軟物形状のオンライイン推定および予測に基づく操作行動生成2021

    • Author(s)
      山崎公俊
    • Organizer
      第26回ロボティクスシンポジア
    • Related Report
      2020 Annual Research Report
  • [Presentation] Visual Servoing Using Virtual Space for Both Learning and Task Execution2021

    • Author(s)
      Kimitoshi Yamazaki
    • Organizer
      IEEE/SICE International Symposium on System Integration
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Cloth Manipulation Planning with Mesh Representations and Incomplete Domain Knowledge2020

    • Author(s)
      Solvi Arnold
    • Organizer
      第38回日本ロボット学会学術講演会
    • Related Report
      2020 Annual Research Report
  • [Presentation] 操作中の形状変化予測に基づく柔軟物操作のためのオンライン操作軌道探索2020

    • Author(s)
      田中大輔
    • Organizer
      第38回日本ロボット学会学術講演会
    • Related Report
      2020 Annual Research Report
  • [Presentation] 個々の動作と動作切り替えを同時に考慮した方策学習に基づく手順あり作業の実行能力獲得2020

    • Author(s)
      莫亜強
    • Organizer
      第38回日本ロボット学会学術講演会
    • Related Report
      2020 Annual Research Report

URL: 

Published: 2020-04-28   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi