• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

High speed sensing of latent biological activities prior to human actions and their very early stages for accident prevention

Research Project

Project/Area Number 20K20483
Project/Area Number (Other) 19H05578 (2019)
Research Category

Grant-in-Aid for Challenging Research (Pioneering)

Allocation TypeMulti-year Fund (2020)
Single-year Grants (2019)
Review Section Medium-sized Section 61:Human informatics and related fields
Research InstitutionTokyo Institute of Technology

Principal Investigator

Kumazawa Itsuo  東京工業大学, 科学技術創成研究院, 教授 (70186469)

Co-Investigator(Kenkyū-buntansha) 小池 康晴  東京工業大学, 科学技術創成研究院, 教授 (10302978)
渡辺 義浩  東京工業大学, 工学院, 准教授 (80456160)
Project Period (FY) 2020-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥26,000,000 (Direct Cost: ¥20,000,000、Indirect Cost: ¥6,000,000)
Fiscal Year 2021: ¥7,800,000 (Direct Cost: ¥6,000,000、Indirect Cost: ¥1,800,000)
Fiscal Year 2020: ¥7,800,000 (Direct Cost: ¥6,000,000、Indirect Cost: ¥1,800,000)
Fiscal Year 2019: ¥10,400,000 (Direct Cost: ¥8,000,000、Indirect Cost: ¥2,400,000)
Keywords高時間分解能光学的計測 / フォトリフレクタアレイ / 危険運動・行動検知 / 仮想現実 / オンライン実験 / 人体揺動装置 / テレビ放送コンテンツ / ディープラーニング / フォトリフレクタ / 時空間信号認識 / フォトトランジスタ / 赤外線LED / 時空間変調照明 / 潜在生体活動 / 感覚遅延 / 運動遅延 / 高速生体信号認識 / 高速画像認識 / 脳波 / 筋電 / 高時間分解能 / 高空間分解能 / 行動予測 / 危険察知
Outline of Research at the Start

人の行動は、そのきっかけとなる刺激を感覚器が受けてから、脳内の情報処理や神経伝達に要する時間を経て、初めて筋肉が動き始めて開始する。開始後も、行動を完了するまでには、質量を持つ運動部位は、力学の法則に従い、限られた筋力で徐々に加速し、目標に到達するまでに相応の時間を要する。本課題では、こうして生じる数百ミリ秒の遅延の間に人の行動を予測し、事故が予知される場合にそれを未然に回避する方法を、高速生体信号認識、高速画像認識手法の開発を通じて研究する。

Outline of Final Research Achievements

Our initial research plan had to change due to restrictions on our social ativities to prevent people from infections of COVOD-19. However, even during the restricted period, we conducted online experiments instead of the face-to-face experiments and got sufficient experimentl results. For the online experiments in a virtual environment, we developed our original equipment with force and haptic feedbacks and tried to predict human reactions againt virtually created hazardous situations using 3D seinsing of latent human actions. As the eye movement is shown to be effective for the prediction, we developped a technique to measure eye movement reducing the reflection from eye glasses and presented the technique in VR2023.

Academic Significance and Societal Importance of the Research Achievements

人の行動は、そのきっかけとなる刺激を感覚器が受けてから、脳内の情報処理や神経伝達に要する数十から数百ミリ秒程度の時間が経過した後で、初めて筋肉が動き出して開始する。行動開始後も、加速し、目標に到達するまでに相応の時間を要する。本課題では、こうして生じる数百ミリ秒の遅延の間に人の行動を先読みする技術と、事故が予知される場合にそれを未然に回避する方法を研究してきた。上記遅延時間の間に先回りして事故回避しようとする点に革新性があり、従来技術の方向を大きく変革、転換させる潜在性を有する挑戦的課題になっており、得られた成果は社会の安全性の向上に大いに寄与するものである。

Report

(6 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Research-status Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • 2019 Annual Research Report
  • Research Products

    (25 results)

All 2023 2022 2021 2020 2019

All Journal Article (13 results) (of which Int'l Joint Research: 6 results,  Peer Reviewed: 12 results,  Open Access: 11 results) Presentation (12 results) (of which Int'l Joint Research: 4 results)

  • [Journal Article] Urinary Stones Segmentation in Abdominal X-Ray Images Using Cascaded U-Net Pipeline With Stone-Embedding Augmentation and Lesion-Size Reweighting Approach2023

    • Author(s)
      WONGSAKORN PREEDANAN,KENJI SUZUKI,TOSHIAKI KONDO, MASAKI KOBAYASHI, HAJIME TANAKA,JUNICHIRO ISHIOKA,YOH MATSUOKA,YASUHISA FUJII,AND ITSUO KUMAZAWA
    • Journal Title

      IEEE Access

      Volume: VOLUME 11 Pages: 25702-25712

    • DOI

      10.1109/access.2023.3257049

    • Related Report
      2023 Annual Research Report 2022 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Improving Kidney Tumor Classification With Multi-Modal Medical Images Recovered Partially by Conditional CycleGAN2023

    • Author(s)
      Pavarut S., Preedanan W., Kumazawa I., Suzuki K., Kobayashi M., Tanaka H., Ishioka J., Matsuoka Y., Fujii Y..
    • Journal Title

      IEEE Access

      Volume: 11 Pages: 146250-146261

    • DOI

      10.1109/access.2023.3345648

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Artificial intelligence model substantially improves stratum corneum moisture content prediction from visible-light skin images and skin feature factors2023

    • Author(s)
      Tomoyuki Shishido, Yasuhiro Ono, Itsuo Kumazawa, Ichiro Iwai, kenji suzuki.
    • Journal Title

      Skin Research and Technology

      Volume: 29 Issue: 8

    • DOI

      10.1111/srt.13414

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Improvement of Urinary Stone Segmentation Using GAN-Based Urinary Stones Inpainting Augmentation2022

    • Author(s)
      WONGSAKORN PREEDANAN,KENJI SUZUKI,TOSHIAKI KONDO, MASAKI KOBAYASHI, HAJIME TANAKA,JUNICHIRO ISHIOKA,YOH MATSUOKA,YASUHISA FUJII,AND ITSUO KUMAZAWA
    • Journal Title

      IEEE Access

      Volume: VOLUME 10 Pages: 115131-115142

    • DOI

      10.1109/access.2022.3218444

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Abstract Reservoir Computing.2022

    • Author(s)
      Christoph Walter Senn and Itsuo Kumazawa.
    • Journal Title

      AI 2022

      Volume: Volume 3, Issue 1, Issue: 1 Pages: 194-210

    • DOI

      10.3390/ai3010012

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Brain activity reflects subjective response to delayed input when using an electromyography-controlled robot2021

    • Author(s)
      Hyeonseok Kim, Yeongdae Kim, Makoto Miyakoshi, Sorawit Stapornchaisit, Natsue Yoshimura, Yasuharu Koike
    • Journal Title

      Frontiers in Systems Neuroscience, Frontiers

      Volume: 1 Pages: 767477-767477

    • DOI

      10.3389/fnsys.2021.767477

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Multi-Joint Angles Estimation of Forearm Motion using a Regression Model2021

    • Author(s)
      Zixuan Qin, Sorawit Stapornchaisit, Zixun He, Natsue Yoshimura, Yasuharu Koike
    • Journal Title

      Frontiers in Neurorobotics, Frontiers Media SA

      Volume: 1 Pages: 685961-685961

    • DOI

      10.3389/fnbot.2021.685961

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Development of Multi-sensor Array Electrodes for Measurement of Deeper Muscle Activation2020

    • Author(s)
      Koike Yasuharu、Kim Yeongdae、Stapornchaisit Sorawit、Qin Zixuan、Kawase Toshihiro、Yoshimura Natsue
    • Journal Title

      Sensors and Materials

      Volume: 32 Issue: 3 Pages: 959

    • DOI

      10.18494/SAM.2020.2636

    • ISSN
      0914-4935, 2435-0869
    • Year and Date
      2020-03-19
    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] A Constrained Convex Optimization Approach to Hyperspectral Image Restoration with Hybrid Spatio-Spectral Regularization2020

    • Author(s)
      Takeyama Saori、Ono Shunsuke、Kumazawa Itsuo
    • Journal Title

      Remote Sensing

      Volume: 12 Issue: 21 Pages: 3541-3541

    • DOI

      10.3390/rs12213541

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] The Effect of ICA and Non-negative Matrix Factorization Analysis for EMG Signals Recorded From Multi-Channel EMG Sensors2020

    • Author(s)
      Kim Yeongdae、Stapornchaisit Sorawit、Miyakoshi Makoto、Yoshimura Natsue、Koike Yasuharu
    • Journal Title

      Frontiers in Neuroscience

      Volume: 14 Pages: 1-10

    • DOI

      10.3389/fnins.2020.600804

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Muscle Synergy and Musculoskeletal Model-Based Continuous Multi-Dimensional Estimation of Wrist and Hand Motions2020

    • Author(s)
      Kim Yeongdae、Stapornchaisit Sorawit、Kambara Hiroyuki、Yoshimura Natsue、Koike Yasuharu
    • Journal Title

      Journal of Healthcare Engineering

      Volume: 2020 Pages: 1-13

    • DOI

      10.1155/2020/5451219

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Finger Angle Estimation From Array EMG System Using Linear Regression Model With Independent Component Analysis2019

    • Author(s)
      Stapornchaisit Sorawit、Kim Yeongdae、Takagi Atsushi、Yoshimura Natsue、Koike Yasuharu
    • Journal Title

      Frontiers in Neurorobotics

      Volume: 13 Pages: 1-12

    • DOI

      10.3389/fnbot.2019.00075

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Characteristics of Kinematic Parameters in Decoding Intended Reaching Movements Using Electroencephalography (EEG)2019

    • Author(s)
      Kim Hyeonseok、Yoshimura Natsue、Koike Yasuharu
    • Journal Title

      Frontiers in Neuroscience

      Volume: 13 Pages: 1-13

    • DOI

      10.3389/fnins.2019.01148

    • Related Report
      2019 Annual Research Report
  • [Presentation] Enhanced Removal of the Light Reflection of Eyeglass Using Multi-Channel CycleGAN with Difference Image Equivalency Loss2023

    • Author(s)
      Yoshikazu Onuki, Kosei Kudo, Itsuo Kumazawa
    • Organizer
      IEEE VR2023
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Feature-Aided Bundle Adjustment Learning Framework for Self-Supervised Monocular Visual Odometry2021

    • Author(s)
      Weijun Mai and Yoshihiro Watanabe
    • Organizer
      2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS),
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] 投影型拡張現実への応用に向けたインスタンスセグメン テーションの高速化2021

    • Author(s)
      小石原 遼,渡辺 義浩
    • Organizer
      第24回 画像の認識・理解シンポジウム
    • Related Report
      2021 Research-status Report
  • [Presentation] 位相シフト法のための高速な運動誤差補正の検証2021

    • Author(s)
      久一 空,渡辺 義浩
    • Organizer
      第27回画像センシングシンポジウム
    • Related Report
      2021 Research-status Report
  • [Presentation] Non-destructive Measurement of Rice Leaf Dimension in 3D Point Cloud2020

    • Author(s)
      P Rattanasuwan, I Kumazawa, and T Kasetkasem
    • Organizer
      Proceedings 5th International Conference on Green Energy Technology
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] 偏光アレイカメラを用いた構造化光法による深度・法線の高速取得2020

    • Author(s)
      野元 貴史, 田畑 智志, 渡辺 義浩
    • Organizer
      第26回画像センシングシンポジウム
    • Related Report
      2020 Research-status Report
  • [Presentation] 時系列情報を用いた顔追跡の高速化に関する基礎研究2020

    • Author(s)
      小石原 遼,渡辺 義浩
    • Organizer
      第26回画像センシングシンポジウム
    • Related Report
      2020 Research-status Report
  • [Presentation] マルチパターン埋め込み型位相シフト法に基づく高速3次元計測の開発2020

    • Author(s)
      久一 空,野元 貴史,田畑 智志,渡辺 義浩
    • Organizer
      第26回画像センシングシンポジウム
    • Related Report
      2020 Research-status Report
  • [Presentation] Removal of the Infrared Light Reflection of Eyeglass Using Multi-Channel CycleGAN Applied for the Gaze Estimation Images2020

    • Author(s)
      Yoshikazu Onuki, Kosei Kudo, and Itsuo Kumazawa
    • Organizer
      2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] ハイパースペクトルイメージングのための圧縮pansharpening の検討2019

    • Author(s)
      武山彩織, 小野峻佑, 熊澤逸夫
    • Organizer
      電子情報通信学会技術研究報告
    • Related Report
      2019 Annual Research Report
  • [Presentation] 3D reconstruction of a rice model for growth monitoring2019

    • Author(s)
      Poompat Rattanasuwan, Hiroki Yano, and Teerasit Kasetkasem
    • Organizer
      2019年映像情報メディア学会年次大会予稿集
    • Related Report
      2019 Annual Research Report
  • [Presentation] A simple multi-spectrum imaging technique with a micro-prism sheet and a standard camera removing cross-talks using deep neural networks2019

    • Author(s)
      Kitti Chumkesornkulkit, Itsuo Kumazawa, and Teerasit Kasetkasem
    • Organizer
      2019年映像情報メディア学会年次大会予稿集
    • Related Report
      2019 Annual Research Report

URL: 

Published: 2019-07-04   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi