• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research development of a human-centered intelligent robot system based on the fusion of advanced artificial intelligent technologies of tactile-visual sensing and control strategy

Research Project

Project/Area Number 23K03790
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 21010:Power engineering-related
Research InstitutionNagaoka University of Technology

Principal Investigator

TRAN PHUONGTHAO  長岡技術科学大学, 工学研究科, 助教 (20848923)

Project Period (FY) 2023-04-01 – 2027-03-31
Project Status Granted (Fiscal Year 2023)
Budget Amount *help
¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000)
Fiscal Year 2026: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2025: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2024: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2023: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
KeywordsMotion control / Force control / Intelligent sensing / Deep learning / Intelligent control / Robot / Intelligent robotics
Outline of Research at the Start

To build the intelligent human-centered robot system, multiple advanced AI functions of sensing technologies and control strategies are developed. AI virtual force sensor, AI safe interaction, and AI non-contact/contact interaction are developed as fully integrated AI functions driving the system.

Outline of Annual Research Achievements

The purpose of this research is to develop a human-centered intelligent robot system based on the fusion of advanced AI technologies of sensing and control to realize the safe and reliable human-robot interaction. To achieve this purpose, this research has been developing the AI virtual force sensor to replicate the force sensing behavior of a high-quality force sensor to realize high sensitivity, superior precision and wide bandwidth, with effective noise suppression. The deep learning algorithm with a long short-term memory neural network is applied to model the reaction force observer for highly precise replication of the measuring performance of a force sensor. The information from force sensor, motor position, and motor current reference is used as the training data of the deep neural network, while only position and current reference information of the motor is employed, excluding the necessity of a force sensor, when implementing the proposed force sensation practically. Numerical simulation results verify that the proposed method is successful in replicating the force sensing behavior of a force sensor with high sensitivity and superior precision. Moreover, to develop the AI safe interaction, this research has firstly developed the force control method with acceleration-based drive-side motion and instantaneous position-velocity information to increase the bandwidth of force control of the robotic system. The experimental results proves that the proposed force control system achieves wider bandwidth than the conventional method with velocity-based drive-side motion.

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

The theory and design of the proposed AI virtual force sensor based on deep learning has been successfully realized through numerical simulations on replicating the force sensing behavior of a force sensor with high sensitivity and superior precision. The hardware and implementation set up for the deep learning based AI virtual force sensor has been completed for experiments of the proposed method. The realization of wideband force control with acceleration-based drive-side motion and instantaneous position-velocity information is an important part of AI safe interaction being developed in this research.

Strategy for Future Research Activity

To achieve the purpose of building the human-centered intelligent robot system based on the fusion of advanced AI technologies to realize the safe, reliable and efficient human-robot interaction, the AI virtual force sensor will be completely realized by experiments in the next year. Moreover, the realized wideband force control and the AI virtual force sensor will be integrated to develop the AI safe interaction. In addition, environment detecting and adaptive force command generating function based on deep learning is constructing to ensure and maintain the safe interactions between robots and humans or working objects.

Report

(1 results)
  • 2023 Research-status Report
  • Research Products

    (5 results)

All 2024 2023

All Presentation (5 results) (of which Int'l Joint Research: 2 results)

  • [Presentation] Deep Learning Based Force-Sensor-Like Reaction Force Observer for Realization of Intelligent Force Sensing2024

    • Author(s)
      Thao Tran Phuong, Kiyoshi Ohishi, Yuki Yokokura, Toshimasa Miyazaki
    • Organizer
      The IEEE 18th international conference on Advanced Motion Control, AMC2024
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] Force Sensor-Like Reaction Force Observer Based on Deep Learning2024

    • Author(s)
      Thao Tran Phuong, Kiyoshi Ohishi, and Yuki Yokokura
    • Organizer
      The 2024 16th IEEE/SICE International Symposium on System Integration, SII2024
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] ねじれトルクとモータ速度の直接検出に基づく加速度ベース等価共振比制御による広帯域負荷側力制御2024

    • Author(s)
      佐々木 紀彰, Tran Phuong Thao, Juan Padron, 宮崎 敏昌, 大石 潔, 横倉 勇希
    • Organizer
      電気学会, モータドライブ研究会, MD-24-059
    • Related Report
      2023 Research-status Report
  • [Presentation] トルクセンサと位置・速度の瞬時情報に基づく広帯域なロボット用トルク制御法2023

    • Author(s)
      佐々木 紀彰, Tran Phuong Thao, Juan Padron, 宮崎 敏昌, 大石 潔 , 横倉 勇希, 竹島 義人, 猪股 広一
    • Organizer
      電気学会, 制御研究会, CT-23-115
    • Related Report
      2023 Research-status Report
  • [Presentation] トルクセンサとモータ加速度制御を組み合わせた広帯域負荷側加速度制御2023

    • Author(s)
      佐々木 紀彰, Tran Phuong Thao, Juan Padron, 宮崎 敏昌, 大石 潔
    • Organizer
      第24回計測自動制御学会, システムインテグレーション部門講演会, SI2023
    • Related Report
      2023 Research-status Report

URL: 

Published: 2023-04-13   Modified: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi