• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Complementary multimodal biosiginal measurement and analysis for prosthetic hand control

Research Project

Project/Area Number 19K12877
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 90150:Medical assistive technology-related
Research InstitutionThe University of Electro-Communications

Principal Investigator

Jiang Yinlai  電気通信大学, 脳・医工学研究センター, 准教授 (70508340)

Co-Investigator(Kenkyū-buntansha) 横井 浩史  電気通信大学, 大学院情報理工学研究科, 教授 (90271634)
Project Period (FY) 2019-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2021: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2020: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2019: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Keywords筋電義手 / 表面筋電図 / Force Myography / 義手 / マルチモーダル / 筋電センサ / 圧力 / マルチモーダル信号計測 / 生体インピーダンス / 生体信号
Outline of Research at the Start

能動義手を身体の一部であるように自由自在に操るためには、切断者の操作意図を切断者の生体信号から安定的かつ正確に読み取る技術が必要である。切断者の切断部位,残存筋及び皮膚の状況などはそれぞれ異なるため、一種類の生体信号では不十分な場合がよくある。本研究は、筋活動を反映する筋電信号、組織変化を反映する生体インピーダンス信号、外力を反映する圧力信号との3種類の相補的な生体信号に着目する。この3種類の生体信号より多様な制御意図を安定的に識別する方法を開発し、多自由度義手の普及を促す。

Outline of Final Research Achievements

Surface electromyography (sEMG) has been widely investigated as a biological signal from which motion intentions can be recognized to control prosthetic hands. The availability and quality of sEMG can limit the usability and intuitiveness of advanced prosthetic hands that can restore most necessary hand movements. This study introduces force myography (FMG) as a supplementary signal and develops a hybrid sensor to measure sEMG and FMG signals simultaneously. Furthermore, a layer-fusion convolutional neural network (CNN) was proposed to analyze the sEMG and FMG signals. The recognition results of hand motion showed a significantly improved classification accuracy (CA) of the hybrid sEMG and FMG with respect to individual modality due to the rubustness of FMG. The FMG-assisted sEMG sensing approach can effectively offer great potential in the clinical application of sophisticated prosthetic hands without increasing burden to the user.

Academic Significance and Societal Importance of the Research Achievements

学術的意義:本研究は、筋活動の機能的信号であるsEMGと組織的信号であるFMGを異種信号として組み合わせることで、筋活動に含まれた動作意図をより多く、より正確的に読み取ることができるようになった。異種の生体信号を非侵襲的に読み取り、総合的に解析する方法、サイボーグの要素技術となり得る。
社会的意義:異種のsEMGとFMG信号を単体のセンサで同じ場所で計測できるため、信号の可用性が高く、計測系もシンプルなままであるので、高機能義手の使用性を改善し、使用範囲を飛躍的に広げることにつながると期待できる。

Report

(4 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Research-status Report
  • 2019 Research-status Report
  • Research Products

    (36 results)

All 2022 2021 2020 2019 Other

All Journal Article (14 results) (of which Int'l Joint Research: 5 results,  Peer Reviewed: 13 results,  Open Access: 10 results) Presentation (20 results) (of which Int'l Joint Research: 10 results) Remarks (1 results) Patent(Industrial Property Rights) (1 results)

  • [Journal Article] Inverse kinematics for a 7-DOF humanoid robotic arm with joint limit and end pose coupling2022

    • Author(s)
      Dou Rutong、Yu Shenbo、Li Wenyang、Chen Peng、Xia Pengpeng、Zhai Fengchen、Yokoi Hiroshi、Jiang Yinlai
    • Journal Title

      Mechanism and Machine Theory

      Volume: 169 Pages: 104637-104637

    • DOI

      10.1016/j.mechmachtheory.2021.104637

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Asymmetric shape of distal phalanx of human finger improves precision grasping2021

    • Author(s)
      Kumagai Ayane、Obata Yoshinobu、Yabuki Yoshiko、Jiang Yinlai、Yokoi Hiroshi、Togo Shunta
    • Journal Title

      Scientific Reports

      Volume: 11 Issue: 1 Pages: 10402-10402

    • DOI

      10.1038/s41598-021-89791-3

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Survey on Main Drive Methods Used in Humanoid Robotic Upper Limbs2021

    • Author(s)
      Wang Yiwei、Li Wenyang、Togo Shunta、Yokoi Hiroshi、Jiang Yinlai
    • Journal Title

      Cyborg and Bionic Systems

      Volume: 2021 Pages: 1-12

    • DOI

      10.34133/2021/9817487

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Development of a Two-Layered Elastic Glove for Dynamic Stable Grasping of Powered Prosthetic Hand2021

    • Author(s)
      小畑承経, 熊谷あやね, 矢吹佳子,東郷俊太, 姜銀来, 横井浩史
    • Journal Title

      Journal of the Robotics Society of Japan

      Volume: 39 Issue: 8 Pages: 744-750

    • DOI

      10.7210/jrsj.39.744

    • NAID

      130008107279

    • ISSN
      0289-1824, 1884-7145
    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Coupled Tendon Drive and its Modularization Design2021

    • Author(s)
      姜銀来,李文揚,王軼偉;,東郷俊太,横井浩史
    • Journal Title

      Journal of the Robotics Society of Japan

      Volume: 39 Issue: 9 Pages: 803-806

    • DOI

      10.7210/jrsj.39.803

    • NAID

      130008117375

    • ISSN
      0289-1824, 1884-7145
    • Related Report
      2021 Annual Research Report
  • [Journal Article] Development of a Humanoid Shoulder Based on 3-Motor 3 Degrees-of-Freedom Coupled Tendon-driven Joint Module2021

    • Author(s)
      Wenyang Li, Yiwei Wang, Shunta Togo, Hiroshi Yokoi,and Yinlai Jiang
    • Journal Title

      IEEE Robotics and Automation Letters

      Volume: 6 Issue: 2 Pages: 1105-1111

    • DOI

      10.1109/lra.2021.3056376

    • Related Report
      2020 Research-status Report
    • Peer Reviewed
  • [Journal Article] Semi-automated control system for reaching movements in EMG shoulder disarticulation prosthesis based on mixed reality device2021

    • Author(s)
      Shunta Togo, Kazuaki Matsumoto, Susumu Kimizuka, Yilai Jiang, and Hiroshi Yokoi
    • Journal Title

      IEEE Open Journal of Engineering in Medicine and Biology

      Volume: 2 Pages: 55-64

    • DOI

      10.1109/ojemb.2021.3058036

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Joint Angle Based Motor Point Tracking Stimulation for Surface FES: A Study on Biceps Brachii2021

    • Author(s)
      Kento Ichikawa, Yinlai Jiang, Masao Sugi, Shunta Togo, Hiroshi Yokoi
    • Journal Title

      Medical Engineering & Physics

      Volume: 88 Pages: 9-18

    • DOI

      10.1016/j.medengphy.2020.11.014

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Modularization of 2- and 3-DoF Coupled Tendon-Driven Joints2021

    • Author(s)
      Wenyang Li, Peng Chen, Dianchun Bai, Xiaoxiao Zhu, Shunta Togo, Hiroshi Yokoi
    • Journal Title

      IEEE Transactions on Robotics

      Volume: 37 Issue: 3 Pages: 1-13

    • DOI

      10.1109/tro.2020.3038687

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Development of a shoulder disarticulation prosthesis system intuitively controlled with the trunk surface electromyogram2020

    • Author(s)
      Susumu Kimizuka, Yohei Tanaka, Shunta Togo, Yinlai Jiang, Hiroshi Yokoi
    • Journal Title

      Frontiers in Neurorobotics

      Volume: 14 Pages: 74-74

    • DOI

      10.3389/fnbot.2020.542033

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Modularized Coupled Tendon-Driven Humanoid Robot Arm2020

    • Author(s)
      姜銀来,李文揚, 陳鵬,東郷俊太, 横井浩史
    • Journal Title

      Journal of the Robotics Society of Japan

      Volume: 38 Issue: 7 Pages: 657-666

    • DOI

      10.7210/jrsj.38.657

    • NAID

      130007897136

    • ISSN
      0289-1824, 1884-7145
    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Anthropomorphic Prosthetic Hand with Combination of Light Weight and Diversiform Motions2019

    • Author(s)
      Jing Xiaobei、Yong Xu、Jiang Yinlai、Li Guanglin、Yokoi Hiroshi
    • Journal Title

      Applied Sciences

      Volume: 9 Issue: 20 Pages: 4203-4203

    • DOI

      10.3390/app9204203

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Development of an sEMG sensor composed of two-layered conductive silicone with different carbon concentrations2019

    • Author(s)
      Togo Shunta、Murai Yuta、Jiang Yinlai、Yokoi Hiroshi
    • Journal Title

      Scientific Reports

      Volume: 9 Issue: 1 Pages: 13996-13996

    • DOI

      10.1038/s41598-019-50112-4

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Design and Implementation of Arch Function for Adaptive Multi-Finger Prosthetic Hand2019

    • Author(s)
      Yong Xu、Jing Xiaobei、Wu Xinyu、Jiang Yinlai、Yokoi Hiroshi
    • Journal Title

      Sensors

      Volume: 19 Issue: 16 Pages: 3539-3539

    • DOI

      10.3390/s19163539

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Development of a 7-DOF electric shoulder prosthesis using a return-routing coupled tendon-driven mechanism2022

    • Author(s)
      Yuko Nakamura, Yinlai Jiang, Hiroshi Yokoi and Shunta Togo
    • Organizer
      IEEE LifeTech 2022
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Comparison of precision grasping performance between artificial fingers with and without nails2022

    • Author(s)
      Ayane Kumagai, Yoshinobu Obata, Hiroshi Yokoi, Yinlai Jiang, Shunta Togo and Yoshiko Yabuki
    • Organizer
      IEEE LifeTech 2022
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A 3-DOF Bionic Waist Joint for Humanoid Robot2021

    • Author(s)
      Yiwei Wang, Wenyang Li, Tongyang Cao, Shunta Togo, Hiroshi Yokoi, Jiang Yinlai
    • Organizer
      the 43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Inverse Kinematics and Master-Slave Control for a 7-DoF Tendon-Driven Humanoid Robot Arm2021

    • Author(s)
      Zhenyu Sun, Wenyang Li, Xiaobei Jing, Xu Yong, Yinlai Jiang and Hiroshi Yokoi
    • Organizer
      2021 IEEE International Conference on Real-time Computing and Robotics
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Design of a 3-DOF Coupled Tendon-Driven Waist Joint2021

    • Author(s)
      Yiwei Wang, Wenyang Li, Shunta Togo, Hiroshi Yokoi,and Yinlai Jiang
    • Organizer
      2021 IEEE International Conference on Robotics and Automation
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 拮抗筋構造型ロボット関節に対する仮想軌道に基づく繰り返し制御2021

    • Author(s)
      藤井裕子,姜銀来,横井浩史,東郷俊太
    • Organizer
      第39回日本ロボット学会学術講演会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 動的安定把持実現のための電動義手用2層弾性グローブの開発2021

    • Author(s)
      小畑 承経,熊谷 あやね,矢吹 佳子,東郷 俊太,姜 銀来,横井 浩史
    • Organizer
      第39回日本ロボット学会学術講演会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 多軸干渉駆動機構のためのワイヤ滑り関節機構の開発2021

    • Author(s)
      関 美咲,姜 銀来,横井 浩史,東郷 俊太
    • Organizer
      第39回日本ロボット学会学術講演会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 筋電肩義手のための全軸干渉型ロボットアームの開発2021

    • Author(s)
      君塚 進,東郷 俊太,姜 銀来,横井 浩史
    • Organizer
      第39回日本ロボット学会学術講演会
    • Related Report
      2021 Annual Research Report
  • [Presentation] ワイヤ劣駆動ロボットフィンガによる薄板小物体把持のための関節トルク比と過伸展機構の検討2021

    • Author(s)
      大谷 俊介,姜 銀来,東郷 俊太,横井 浩史,山野井 佑介
    • Organizer
      第39回日本ロボット学会学術講演会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 筋電信号の時変性に適応する教師データ更新手法に関する研究2020

    • Author(s)
      黒田 勇幹,山野井 佑介,東郷 俊太,姜 銀来,加藤 龍,横井 浩史
    • Organizer
      第38回日本ロボット学会学術講演会
    • Related Report
      2020 Research-status Report
  • [Presentation] 磁気センサを応用した柔軟な圧力センサの開発2020

    • Author(s)
      島田 孝太,東郷 俊太,姜 銀来,横井 浩史
    • Organizer
      第38回日本ロボット学会学術講演会
    • Related Report
      2020 Research-status Report
  • [Presentation] 肩義手のための腕の手先位置のフィードバックシステムに適した振動刺激の検討2020

    • Author(s)
      中村 優子,姜 銀来,横井 浩史,東郷 俊太
    • Organizer
      第38回日本ロボット学会学術講演会
    • Related Report
      2020 Research-status Report
  • [Presentation] 先天性前腕欠損者のための幼児用2自由度電動義手の開発2020

    • Author(s)
      平井 太智,中尾 聡一郎,小野 祐真,黒田 勇幹,矢吹 佳子,山野井 佑介,東郷 俊太,姜 銀来,加藤 龍,横井 浩史
    • Organizer
      第38回日本ロボット学会学術講演会
    • Related Report
      2020 Research-status Report
  • [Presentation] 回内・回外機能を有し個性に適応する幼児用筋電義手の開発と評価2020

    • Author(s)
      中尾 聡一郎,平井 太智,小野 祐真,山野井 佑介,黒田 勇幹,矢吹 佳子,東郷 俊太,姜 銀来,加藤 龍,高木 岳彦,石原 正博,横井 浩史
    • Organizer
      第38回日本ロボット学会学術講演会
    • Related Report
      2020 Research-status Report
  • [Presentation] Development of an Adaptive Prosthetic Hand2019

    • Author(s)
      Xu Yong, Xiaobei Jing, Xinyu Wu, Yinlai Jiang, Hiroshi Yokoi
    • Organizer
      IEEE International Conference on Robotics and Biomimetics
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Design of A Prosthetic Hand for Multiple hand Motions2019

    • Author(s)
      Xiaobei Jing, Xu Yong, Guanglin Li, Yinlai Jiang, Hiroshi Yokoi
    • Organizer
      IEEE International Conference on Robotics and Biomimetics
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Gear-Driven Prosthetic Hand with Major Grasp Functions for Toddlers2019

    • Author(s)
      Xiaobei Jing, Xu Yong, Yuankang Shi, Yoshiko Yabiki, Yinlai Jiang, Hiroshi Yokoi, Guanglin Li
    • Organizer
      2019 IEEE/RSJ International Conference on Intelligent Robots and Systems
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Motor Point Tracking Stimulation of Biceps Brachii Using Multi Electrodes Based Functional Electrical Stimulation2019

    • Author(s)
      Kento Ichikawa, Yinlai Jiang, Masao Sugi, Shunta Togo, and Hiroshi Yokoi
    • Organizer
      2019 IEEE International Conference on Cyborg and Bionic Systems
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Development of Soft Impedance Balancer for EMG Electrode2019

    • Author(s)
      Yuankang Shi, Shunta Togo, Yinlai Jiang, and Hiroshi Yokoi
    • Organizer
      The 2019 IEEE International Conference on Real-time Computing and Robotics
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Remarks] 電気通信大学横井・姜・東郷研究室

    • URL

      http://www.hi.mce.uec.ac.jp/yklab/index.html

    • Related Report
      2021 Annual Research Report 2020 Research-status Report 2019 Research-status Report
  • [Patent(Industrial Property Rights)] 筋電センサ及び電極部材2019

    • Inventor(s)
      横井浩史,姜銀来,石源康,東郷俊太,村井雄太,君塚進
    • Industrial Property Rights Holder
      国立大学法人電気通信大学
    • Industrial Property Rights Type
      特許
    • Filing Date
      2019
    • Related Report
      2019 Research-status Report

URL: 

Published: 2019-04-18   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi