• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A Research on Hyper Vibration Spectrum Camera Using High-speed Vision

Research Project

Project/Area Number 19H00769
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Review Section Medium-sized Section 21:Electrical and electronic engineering and related fields
Research InstitutionHiroshima University

Principal Investigator

ISHII IDAKU  広島大学, 先進理工系科学研究科(工), 教授 (40282686)

Co-Investigator(Kenkyū-buntansha) 松田 浩  長崎大学, 工学研究科, 教授 (20157324)
妹尾 拓  広島大学, 先進理工系科学研究科(工), 准教授 (10512113)
姜 明俊  広島大学, 先進理工系科学研究科(工), 助教 (30819503)
高木 健  広島大学, 工学研究科, 准教授 (80452605)
Project Period (FY) 2019-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥45,370,000 (Direct Cost: ¥34,900,000、Indirect Cost: ¥10,470,000)
Fiscal Year 2021: ¥14,040,000 (Direct Cost: ¥10,800,000、Indirect Cost: ¥3,240,000)
Fiscal Year 2020: ¥17,160,000 (Direct Cost: ¥13,200,000、Indirect Cost: ¥3,960,000)
Fiscal Year 2019: ¥14,170,000 (Direct Cost: ¥10,900,000、Indirect Cost: ¥3,270,000)
Keywords実時間・長時間振動イメージング / 素レベル振動スペクトル計測 / 分布型ダイナミックセンシング / 音声周波数レベルでの振動パタン認識 / 高速画像認識と振動解析の統合 / 高速ビジョン / 振動分布計測 / 振動スペクトル解析 / 可視化イメージング / パタン認識
Outline of Research at the Start

本研究では、音響信号と時間周波数帯域が整合した高速視覚をベースに、全画素の輝度信号に対して計算された振動スペクトル分布を特徴量とした画素レベルパタン認識を行う実時間振動スペクトルイメージングの概念を提案し、高速ターゲットトラッキングと時系列振動スペクトラム解析を統合したダイナミクスベースド画像認識理論の体系化を行う。実際に周波数解析機能を全画素並列実装したハイパー振動スペクトルカメラを開発するとともに、アピアランス検査のみでは欠陥・経時変化が検出困難だったサーベイランス事例を通し、人間の目には不可能な音声周波数レベルの振動パタン認識を可能とする新たな振動スペクトルイメージングの有効性を示す。

Outline of Final Research Achievements

We develop a hyper vibration spectrum camera in which pixel-level vibration spectrum analysis is implemented in parallel to a high-speed vision system. It can realize dynamics-based image recognition based on multi-dimensional vibration spectrum images in which brightness signals are processed in the audio frequency range. We show its effectiveness in real-time vibration spectrum imaging that enable vibration pattern recognition by hybridizing high-speed image recognition and vibration analysis through vibration surveillance cases in various applications.

Academic Significance and Societal Importance of the Research Achievements

これまで限定された計測点数のスポット構造診断ツールであった振動解析技術の適用範囲を大きく広げる分布型ダイナミックセンシング技術を確立した点で学術的意義は高く、アピアランスのみでは検出が難しい、構造物・機械の疲労検査、製品クラック検査、生体インピーダンス計測等の応用場面において、入力不変なダイナミクス特性に基づく実時間かつ長時間振動イメージング技術としての技術革新を喚起した点で社会的意義は高い。

Report

(5 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Annual Research Report
  • 2019 Comments on the Screening Results   Annual Research Report
  • Research Products

    (35 results)

All 2022 2021 2020 2019

All Journal Article (15 results) (of which Int'l Joint Research: 6 results,  Peer Reviewed: 15 results,  Open Access: 13 results) Presentation (20 results) (of which Int'l Joint Research: 11 results)

  • [Journal Article] View and Scanning-Depth Expansion Photographic Microscope Using Ultrafast Switching Mirrors2022

    • Author(s)
      Shaopeng Hu, Wei Lu, Kohei Shimasaki, Mingjun Jiang, Taku Senoo, Idaku Ishii
    • Journal Title

      IEEE Transactions on Instrumentation and Measurement

      Volume: 71 Pages: 1-13

    • DOI

      10.1109/tim.2022.3147331

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Omnidirectional Panoramic Video System With Frame-by-Frame Ultrafast Viewpoint Control2022

    • Author(s)
      Shaopeng Hu, Hongyu Dong, Mingjun Jiang,Taku Seno, Idaku Ishii
    • Journal Title

      IEEE Robotics and Automation Letter

      Volume: 7 Issue: 2 Pages: 4086-4093

    • DOI

      10.1109/lra.2022.3150484

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Wide-area Operation Monitoring of Conveyors Using a Panoramic Vibration Camera2021

    • Author(s)
      Kohei Shimasaki, Zulhaj Aliansyah, Taku Senoo, Idaku Ishii, Tomohiko Ito
    • Journal Title

      ISIJ International

      Volume: 61 Issue: 10 Pages: 2587-2596

    • DOI

      10.2355/isijinternational.ISIJINT-2021-182

    • NAID

      130008104260

    • ISSN
      0915-1559, 1347-5460
    • Year and Date
      2021-10-15
    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Identification of Bridge Deterioration Using Rate of Change of Deflection Influence Lines and Deflection Curves2021

    • Author(s)
      市川辰旺, 宮濱晃一, 佐々木謙二, 出水亨, 古賀掲維, 島崎航平, 石井抱, 松田浩
    • Journal Title

      Journal of the Japanese Society for Experimental Mechanics

      Volume: 21 Issue: 2 Pages: 97-103

    • DOI

      10.11395/jjsem.21.97

    • NAID

      130008086183

    • ISSN
      1346-4930, 1884-4219
    • Year and Date
      2021-07-03
    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Single-Camera-Based Bridge Structural Displacement Measurement with Traffic Counting2021

    • Author(s)
      Zulhaj Aliansyah, Kohei Shimasaki, Taku Senoo, Idaku Ishii, and Shuji Umemoto
    • Journal Title

      Sensors

      Volume: 21 Issue: 13 Pages: 4517-4517

    • DOI

      10.3390/s21134517

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Visual-Feedback-Based Frame-by-Frame Synchronization for 3000 fps Projector–Camera Visual Light Communication2021

    • Author(s)
      Atul Sharma,Sushil Raut, Kohei Shimasaki, Taku Senoo, and Idaku Ishii
    • Journal Title

      Electronics

      Volume: 10 Issue: 14 Pages: 1631-1631

    • DOI

      10.3390/electronics10141631

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] High-frame-rate Video-based Multicopter Tracking System Using Pixel-level Short-time Fourier Transform2021

    • Author(s)
      Kohei Shimasaki, Nagahiro Fujiwara, Shaopeng Hu, Taku Senoo, and Idaku Ishii
    • Journal Title

      Journal of Intelligent and Robotic Systems

      Volume: 103 Issue: 2 Pages: 36-36

    • DOI

      10.1007/s10846-021-01483-2

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] A 500-fps Pan-tilt Tracking System with Deep-learning-based Object Detection2021

    • Author(s)
      Mingjun Jiang, Kohei Shimasaki, Shaopeng Hu, Taku Senoo, and Idaku Ishii
    • Journal Title

      IEEE Robotics and Automation Letters

      Volume: 6 Issue: 2 Pages: 691-698

    • DOI

      10.1109/lra.2020.3048653

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] 500-fps Omnidirectional Visual Tracking Using Three-Axis Active Vision System2021

    • Author(s)
      Mingjun Jiang, Ryo Sogabe, Kohei Shimasaki, Shaopeng Hu, Taku Senoo, and Idaku Ishii
    • Journal Title

      IEEE Transactions on Instrumentation and Measurement

      Volume: 70 Pages: 1-11

    • DOI

      10.1109/tim.2021.3053971

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] A Simultaneous Multi-object Zooming System Using an Ultrafast Pan-tilt Camera2021

    • Author(s)
      Shaopeng Hu, Kohei Shimasaki, Mingjun Jiang, Taku Senoo, Idaku Ishii
    • Journal Title

      IEEE Sensors Journal

      Volume: 21 Issue: 7 Pages: 9436-9448

    • DOI

      10.1109/jsen.2021.3054425

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Projection-mapping-based object pointing using a high-frame-rate camera-projector system2021

    • Author(s)
      Deepak Kumar, Sushil Raut, Kohei Shimasaki, Taku Senoo, Idaku Ishii
    • Journal Title

      ROBOMECH Journal

      Volume: - Issue: 1 Pages: 8-8

    • DOI

      10.1186/s40648-021-00197-2

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] HFR Projector Camera Based Visible Light Communication System for Real-Time Video Streaming2020

    • Author(s)
      Atul Sharma, Sushil Raut, Kohei Shimasaki, Taku Senoo, Idaku Ishii
    • Journal Title

      Sensors 2020

      Volume: 20(18) Issue: 18 Pages: 5368-5368

    • DOI

      10.3390/s20185368

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Ironworks Conveyor Monitoring Using Mirror-drive High-speed Active Vision2020

    • Author(s)
      唐 正密, 島崎 航平, 姜 明俊, 高木 健, 石井 抱, 古賀 掲維, 松田 浩
    • Journal Title

      Tetsu-to-Hagane

      Volume: 106 Issue: 2 Pages: 61-70

    • DOI

      10.2355/tetsutohagane.TETSU-2019-059

    • NAID

      130007792550

    • ISSN
      0021-1575, 1883-2954
    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] HFR-Video-Based Honeybee Activity Sensing2020

    • Author(s)
      Kohei Shimasaki ,Mingjun Jiang,Takeshi Takaki ,Idaku Ishii,Kazuhiko Yamamoto
    • Journal Title

      IEEE Sensors Journal

      Volume: Vol.20 Issue: 10 Pages: 5575-5587

    • DOI

      10.1109/jsen.2020.2968130

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] A Tandem Marker-Based Motion Capture Method for Dynamic Small Displacement Distribution Analysis2019

    • Author(s)
      Zulhaj Aliansyah, Kohei Shimasaki, Mingjun Jiang, Takeshi Takaki, Idaku Ishii, Hua Yang, Chikako Umemoto, Hiroshi Matsuda
    • Journal Title

      Journal of Robotics and Mechatronics

      Volume: 31 Issue: 5 Pages: 671-685

    • DOI

      10.20965/jrm.2019.p0671

    • NAID

      130007731548

    • ISSN
      0915-3942, 1883-8049
    • Year and Date
      2019-10-20
    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] ロボットハンドを使用した加振によるねじ緩み判別2021

    • Author(s)
      立石 侑也, 島崎 航平, 妹尾 拓, 石井 抱
    • Organizer
      第39回日本ロボット学会学術講演会
    • Related Report
      2021 Annual Research Report
  • [Presentation] A 1.3M Pixel 34,700fps Global-Shutter BSI Imager with HDR and Motion Blur Suppression Capability2021

    • Author(s)
      Gaozhan Cai, Kenji Tajima, Arno Van Hoorebeeck, Periklis Stampoglis, Bert Luyssaert, Bart Dierickx, Canol Gokel, Tom Van Uffelen, Gerlinde Ruttens, Jun Yamane, Idaku Ishii
    • Organizer
      International Image Sensor Workshop
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 分蜂を捉えるミツバチカメラ2021

    • Author(s)
      島崎航平, 妹尾拓, 石井抱, 荻原麻理, 芳山三喜雄
    • Organizer
      第38回センシングフォーラム 計測部門大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 高速ビジョンを用いたバーチャル触診システム2021

    • Author(s)
      島崎 航平, 高橋 裕之, 妹尾 拓, 石井 抱
    • Organizer
      日本機械学会 中国四国支部 第59期講演会
    • Related Report
      2020 Annual Research Report
  • [Presentation] 超高速パンチルトカメラを用いたリモート振動モニタリングシステム2021

    • Author(s)
      島崎 航平,胡 少鵬,妹尾 拓,石井 抱
    • Organizer
      IIP2021 情報・知能・精密機器部門(IIP部門)講演会
    • Related Report
      2020 Annual Research Report
  • [Presentation] Vibration Detection Using Differential Multiple Exposure Imaging2021

    • Author(s)
      Mingjun Jiang, Kohei Shimasaki, Taku Senoo, Idaku Ishii
    • Organizer
      電子情報通信学会総合大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] Nvidia Jetson TX2を利用した実時間振動イメージングシステム2021

    • Author(s)
      島崎航平, Atul Kumar Sharma,妹尾 拓,石井 抱
    • Organizer
      電子情報通信学会総合大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] Development of High-speed Miniature Pan-Tilt Embedded Vision System2021

    • Author(s)
      Sushil Raut, Idaku Ishii, Kohei Shimasaki, Taku Senoo, Akio Namiki
    • Organizer
      電気学会全国大会
    • Related Report
      2020 Annual Research Report
  • [Presentation] An Omnidirectional Multicopter Tracking System with HFR-Video-Based Vibration Source Localization2021

    • Author(s)
      Mingjun Jiang, Ryo Sogabe, Kohei Shimasaki, Taku Senoo, Idaku Ishii
    • Organizer
      SAMCON2021
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Vibration-feature-based Multicopter Detection with CNN-based2021

    • Author(s)
      Sushil Raut, Kohei Shimasaki, Taku Senoo, Idaku Ishii
    • Organizer
      SAMCON2021
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Multi-Person Authentication Using an Ultrafast Pan-Tilt Camera2021

    • Author(s)
      Liheng Shen, Shaopeng Hu, Kohei Shimasaki, Idaku Ishii
    • Organizer
      The 12th International Conference on Optics-photonics Design and Fabrication
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] View and Depth Expansion System for Microscope Photography Based on Dual Ultrafast Switching Mirror2021

    • Author(s)
      Shaopeng Hu, Wei Lu, Kohei Shimasaki, Idaku Ishii
    • Organizer
      The 12th International Conference on Optics-photonics Design and Fabrication
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Long-Time Automated Honeybees Count System Using High-Speed Vision2021

    • Author(s)
      Hironori Yoshida, Kohei Shimasaki, Taku Senoo, Idaku Ishii, Kazuhiko Yamamoto
    • Organizer
      2021 IEEE/SICE International Symposium on System Integration (SII)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 高速アクティブビジョンを用いた顔・QRコード同時照合システム2020

    • Author(s)
      伊藤優 , 胡少鵬 , 島崎航平, 石井抱
    • Organizer
      ROBOMECH2020
    • Related Report
      2020 Annual Research Report
  • [Presentation] Simultaneous Multi-face Zoom Tracking for 3-D People-Flow Analysis with Face Identification2020

    • Author(s)
      Liheng Shen, Shaopeng Hu, Kohei Shimasaki, Taku Senoo, Idaku Ishii
    • Organizer
      The 16th International Conference on Mobility, Sensing and Networking (MSN 2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 振動を伴う移動飛翔体に対する振動イメージング法の提案2019

    • Author(s)
      岡村朋晃,島崎航平,姜明俊,高木健,石井抱
    • Organizer
      ロボティクス・メカトロニクス 講演会 2019
    • Related Report
      2019 Annual Research Report
  • [Presentation] Visible Light Communication using an HFR camera-projector system2019

    • Author(s)
      Sharma Atul,島崎航平,高木健,石井抱
    • Organizer
      The SICE Annual Conference 2019
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Informatic Projection Mapping for Simultaneous Environment Recognition2019

    • Author(s)
      Deepak Kumar, Sharma, Atul,島崎航平,高木健 ,石井抱
    • Organizer
      The SICE Annual Conference 2019
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] GPU-accelerated High-speed Vision-based Vibration Spectrum Imaging2019

    • Author(s)
      島崎航平,Raut, Sushil,高木健,石井抱
    • Organizer
      The SICE Annual Conference 2019
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Structural Displacement Measurement with High-speed Vision System and Retro-reflective Markers2019

    • Author(s)
      Zulhaj Aliansyah, Kohei Shimasaki, Mingjun Jiang, Takeshi Takaki, and Idaku Ishii
    • Organizer
      Proceedings of International Conference on Advanced Mechatronics,Intelligent Manufacture and Industrial Automation 2019
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research

URL: 

Published: 2019-04-18   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi