• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Bilateral Control Using Functional Electrical Stimulation for Teaching Object Manipulation Skills to Robot with Five Fingers

Research Project

Project/Area Number 21H01347
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 21040:Control and system engineering-related
Research InstitutionUniversity of Tsukuba

Principal Investigator

Sakaino Sho  筑波大学, システム情報系, 准教授 (70610898)

Co-Investigator(Kenkyū-buntansha) 原 正之  埼玉大学, 理工学研究科, 准教授 (00596497)
Project Period (FY) 2021-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥17,420,000 (Direct Cost: ¥13,400,000、Indirect Cost: ¥4,020,000)
Fiscal Year 2023: ¥5,850,000 (Direct Cost: ¥4,500,000、Indirect Cost: ¥1,350,000)
Fiscal Year 2022: ¥5,070,000 (Direct Cost: ¥3,900,000、Indirect Cost: ¥1,170,000)
Fiscal Year 2021: ¥6,500,000 (Direct Cost: ¥5,000,000、Indirect Cost: ¥1,500,000)
Keywords機能的電気刺激 / 制御 / 模倣学習 / ロボット / 技能教示
Outline of Research at the Start

研究代表者はこれまでに、反力呈示ができる遠隔操作「バイラテラル制御」を用いると、ヒトの持つ環境適応技能をロボットへ教示できることをあきらかにした。しかし、手指の技能教示に必要な装着型ロボットの製作は困難を極めた。そこで、ヒトの筋を電流で駆動する機能的電気刺激を用いてヒトの身体を直接制御することで装着型ロボットの代替とすることを提案してきたが、五指すべてを駆動することはできなかった。よって、本研究課題では、3次元的に筋を刺激して五指を選択的に駆動することで、機能的電気刺激を用いた五指のバイラテラル制御を開発することを目的とし、五指の物体操作技能をロボットへ教示するための基盤技術を確立する。

Outline of Final Research Achievements

This research project aimed at independent control of the five fingers using functional electrical stimulation. We also aimed to instruct object manipulation skills that also include force control. First, we realized independent drive of an index finger by using multiple electrodes, and demonstrated that the middle and ring fingers can be driven independently using the extensor digitorum muscle. Since it has been easy to drive thumbs and little fingers independently, these results allow all five fingers to be driven independently. Then, we implemented the stimulation method on two participants and demonstrated that bilateral control of the five fingers was possible.
After that, we developed a robot hand with crossed-hand structures with nails which can grasp variety of size of objects. By instructing force control skills using bilateral control, the robot acquired human-like object manipulation skills, and was able to manipulate a wide variety of objects with a success rate of 95%.

Academic Significance and Societal Importance of the Research Achievements

少子高齢化社会を迎える日本において肉体労働の大幅なロボット化は急務である。そのためには人間が未知環境を操作する際に必須である力制御技能をロボットに獲得させることが必須である。これまで反力提示が可能な遠隔操作「バイラテラル制御」を用いることで人間の力制御技能データを抽出しロボットに再現できることはあきらかになっていた。しかし、五指への力覚提示デバイスが製作困難であったため、五指の物体操作技能を教示できなかった。一方、本研究課題は人間の身体を覚提示デバイスとすることで、人間の五指を用いた物体操作技能を教示可能にした。ロボットが多種多様な物体の把持・操作が可能になったことを実験により実証した。

Report

(4 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Annual Research Report
  • 2021 Annual Research Report
  • Research Products

    (23 results)

All 2024 2023 2022 2021

All Journal Article (9 results) (of which Peer Reviewed: 9 results,  Open Access: 5 results) Presentation (14 results) (of which Int'l Joint Research: 5 results,  Invited: 4 results)

  • [Journal Article] バイラテラル制御に基づく模倣学習による複数物体の同時把持2024

    • Author(s)
      山根 広暉, 境野 翔, 辻 俊明
    • Journal Title

      日本ロボット学会誌

      Volume: -

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Soft and Rigid Object Grasping With Cross-Structure Hand Using Bilateral Control-Based Imitation Learning2024

    • Author(s)
      Yamane Koki、Saigusa Yuki、Sakaino Sho、Tsuji Toshiaki
    • Journal Title

      IEEE Robotics and Automation Letters

      Volume: 9 Issue: 2 Pages: 1198-1205

    • DOI

      10.1109/lra.2023.3335768

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Autoregressive Model Considering Low Frequency Errors in Command for Bilateral Control-Based Imitation Learning2023

    • Author(s)
      Akagawa Tetsuro、Sakaino Sho
    • Journal Title

      IEEJ Journal of Industry Applications

      Volume: 12 Issue: 1 Pages: 26-32

    • DOI

      10.1541/ieejjia.22002155

    • ISSN
      2187-1094, 2187-1108
    • Year and Date
      2023-01-01
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] 3D Surface Wiping using Bilateral Control-Based Imitaiton Learning2023

    • Author(s)
      山根 広暉, 七種 勇樹, 境野 翔, 辻 俊明
    • Journal Title

      Journal of the Robotics Society of Japan

      Volume: 41 Issue: 4 Pages: 395-398

    • DOI

      10.7210/jrsj.41.395

    • ISSN
      0289-1824, 1884-7145
    • Related Report
      2023 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Selective Drive and Control of Index Finger Joint Using Multipoint Functional Electrical Stimulation2022

    • Author(s)
      Tatsuhiro Hamana, Minami Kawashima, Sho Sakaino, Toshiaki Tsuji
    • Journal Title

      IEEE Access

      Volume: 10 Pages: 112444-112459

    • DOI

      10.1109/access.2022.3215515

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Imitation Learning for Nonprehensile Manipulation Through Self-Supervised Learning Considering Motion Speed2022

    • Author(s)
      Saigusa Yuki、Sakaino Sho、Tsuji Toshiaki
    • Journal Title

      IEEE Access

      Volume: 10 Pages: 68291-68306

    • DOI

      10.1109/access.2022.3185651

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Position Control of Two Finger Joints Using Functional Electrical Stimulation2022

    • Author(s)
      Minami Kawashima, Tatsuhiro Hamana, Sho Sakaino, Toshiaki Tsuji
    • Journal Title

      REHAB WEEK 2022

      Volume: -

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed
  • [Journal Article] An Independently Learnable Hierarchical Model for Bilateral Control-Based Imitation Learning Applications2022

    • Author(s)
      Hayashi Kazuki、Sakaino Sho、Tsuji Toshiaki
    • Journal Title

      IEEE Access

      Volume: 10 Pages: 32766-32781

    • DOI

      10.1109/access.2022.3155255

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Imitation Learning for Variable Speed Contact Motion for Operation up to Control Bandwidth2022

    • Author(s)
      Sakaino Sho、Fujimoto Kazuki、Saigusa Yuki、Tsuji Toshiaki
    • Journal Title

      IEEE Open Journal of the Industrial Electronics Society

      Volume: 3 Pages: 116-127

    • DOI

      10.1109/ojies.2022.3149333

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] Practical Implementations of Bilateral Control-Based Imitation Learning at iREX20232024

    • Author(s)
      Sho Sakaino, Nozomu Masuya, Hiroshi Sato, Koki Yamane, Takuya Kusume, Masashi Konosu, Naoto Imazu
    • Organizer
      the 10th IEEJ International Workshop on Sensing, Actuation, Motion Control, and Optimization
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Loss Function Considering Dead Zone for Neural Networks2024

    • Author(s)
      Koki Inami, Koki Yamane, Sho Sakaino
    • Organizer
      the 18th IEEE International Conference on Advanced Motion Control
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Imitation Learning Inputting Image Feature to Each Layer of Neural Network2024

    • Author(s)
      Koki Yamane, Sho Sakaino, Toshiaki Tsuji
    • Organizer
      the 18th IEEE International Conference on Advanced Motion Control
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] バイラテラル制御に基づく模倣学習による複数物体の同時把持2023

    • Author(s)
      山根広暉, 境野翔, 辻俊明
    • Organizer
      第41回日本ロボット学会学術講演会
    • Related Report
      2023 Annual Research Report
  • [Presentation] バイラテラル制御に基づく模倣学習の応用事例2023

    • Author(s)
      境野翔
    • Organizer
      2023年電気学会産業応用部門大会
    • Related Report
      2023 Annual Research Report
    • Invited
  • [Presentation] 拘束条件を考慮したバイラテラル制御に基づく模倣学習2023

    • Author(s)
      桝屋望, 赤川徹朗, 山根広暉, 楠目琢也, 境野翔, 辻俊明
    • Organizer
      ロボティクス・メカトロニクス講演会
    • Related Report
      2023 Annual Research Report
  • [Presentation] バイラテラル制御に基づく模倣学習による計量タスクの実現2023

    • Author(s)
      楠目琢也, 桝屋望, 赤川徹朗, 山根広暉, 境野翔, 辻俊明
    • Organizer
      ロボティクス・メカトロニクス講演会
    • Related Report
      2023 Annual Research Report
  • [Presentation] バイラテラル制御に基づく模倣学習による斜面の拭き動作2022

    • Author(s)
      赤川徹朗,七種勇樹, 境野翔
    • Organizer
      日本ロボット学会学術講演会
    • Related Report
      2022 Annual Research Report
  • [Presentation] バイラテラル制御に基づく模倣学習による三次元曲面拭き動作2022

    • Author(s)
      山根広暉, 七種勇樹, 境野翔, 辻俊明
    • Organizer
      日本ロボット学会学術講演会
    • Related Report
      2022 Annual Research Report
  • [Presentation] 画像認識とバイラテラル制御に基づくコンベアピッキングタスクの模倣学習2022

    • Author(s)
      赤川徹朗, 境野翔
    • Organizer
      ロボティクス・メカトロニクス講演会2022
    • Related Report
      2022 Annual Research Report
  • [Presentation] Bilateral Control-Based Imitation Learning for Position/Force Hybrid Motion Generation2022

    • Author(s)
      Sho Sakaino
    • Organizer
      the 47th Annual Conference of the IEEE Industrial Electronics Society
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Bilateral Control-Based Imitation Learning for Velocity-Controlled Robot2021

    • Author(s)
      Sho Sakaino
    • Organizer
      the 30th IEEE International Symposium on Industrial Electronics
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 複数の刺激波形を用いた機能的電気刺激による手指関節の駆動2021

    • Author(s)
      浜名 竜大
    • Organizer
      メカトロニクス制御研究会
    • Related Report
      2021 Annual Research Report
  • [Presentation] ハプティクスに基づく模倣学習によるロボットの汎用物体操作2021

    • Author(s)
      境野 翔
    • Organizer
      電気学会産業応用部門大会
    • Related Report
      2021 Annual Research Report
    • Invited

URL: 

Published: 2021-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi