• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Mulithread High-speed Vision Sensing Using Ultrafast Active Vision

Research Project

Project/Area Number 16H02348
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Research Field Measurement engineering
Research InstitutionHiroshima University

Principal Investigator

ISHII IDAKU  広島大学, 工学研究科, 教授 (40282686)

Co-Investigator(Kenkyū-buntansha) 松本 祐二  広島大学, 工学研究科, 助教 (30803366)
高木 健  広島大学, 工学研究科, 准教授 (80452605)
姜 明俊  広島大学, 工学研究科, 助教 (30819503)
奥 寛雅  群馬大学, 大学院理工学府, 准教授 (40401244)
青山 忠義  広島大学, 工学研究院, 助教 (00569337)
Project Period (FY) 2016-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥44,720,000 (Direct Cost: ¥34,400,000、Indirect Cost: ¥10,320,000)
Fiscal Year 2018: ¥14,040,000 (Direct Cost: ¥10,800,000、Indirect Cost: ¥3,240,000)
Fiscal Year 2017: ¥17,030,000 (Direct Cost: ¥13,100,000、Indirect Cost: ¥3,930,000)
Fiscal Year 2016: ¥13,650,000 (Direct Cost: ¥10,500,000、Indirect Cost: ¥3,150,000)
Keywords計測システム / 高速ビジョン / トラッキング / アクティブセンシング / 視覚サーベイランス
Outline of Final Research Achievements

This study proposed the concept of time-division multithread viewpoint control in which an ultrafast active vision system can function as multiple virtual pan-tilt cameras by accelerating sensing, computing, and actuation for target tracking, and systematized multithread target tracking theory that integrates high-speed image recognition and frame-by-frame viewpoint path planning. We developed an ultra-high-speed active vision system that can independently perform viewpoint control at hundreds of frames per second as time-division multithreaded processes, and verified the effectiveness of multithreaded high-speed vision sensing that "alternates" to dozens of virtual tracking visions by showing several surveillance applications in which spatio-temporal densities of multiple viewpoints are simultaneously controlled.

Academic Significance and Societal Importance of the Research Achievements

一台の超高速アクティブビジョンを複数台の仮想トラッキングビジョンとして機能させる時分割マルチスレッド視線制御技術は、計測目的に応じた効率的な視線パスプラニングを内包する次世代アクティブセンシング技術として、様々な応用場面で技術革新を喚起する点で学術的な意義が高い。また本研究は、超高速ロボットが複数の分身ロボットとして機能する「分身できる超高速ロボット」への野心的挑戦の第一歩であり、数十台の仮想トラッキングビジョンへ「分身」する、聖徳太子的な超高速ロボットの目を目指し、超高速ロボット=分身ロボティクスといった、世界に先駆けた革新的なパラダイムを提案する点で、本研究を行う意義は極めて高い。

Report

(4 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Annual Research Report
  • 2016 Annual Research Report
  • Research Products

    (29 results)

All 2019 2018 2017 2016

All Journal Article (9 results) (of which Int'l Joint Research: 4 results,  Peer Reviewed: 9 results,  Open Access: 3 results) Presentation (20 results) (of which Int'l Joint Research: 8 results)

  • [Journal Article] Vision-based Modal Analysis Using Multiple Vibration Distribution Synthesis to Inspect Large-Scale Structures2019

    • Author(s)
      Tadayoshi Aoyama, Liang Li, Mingjun Jiang, Takeshi Takaki, Idaku Ishii, Hua Yang, Chikako Umemoto, Hiroshi Matsuda, Makoto Chikaraishi, and Akimasa Fujiwara
    • Journal Title

      Journal of Dynamic Systems, Measurement, and Control

      Volume: Vol. 141, No. 3 Issue: 3

    • DOI

      10.1115/1.4041604

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] A Hardware-Oriented Algorithm for Ultra-High-Speed Object Detection2019

    • Author(s)
      Jianquan Li, Xilong Lu, Fangfang Liu, De Xu, Qingyi GU, and Idaku Ishii
    • Journal Title

      IEEE Sensors Journal

      Volume: Vol. 19, No. 10 Issue: 10 Pages: 3818-3831

    • DOI

      10.1109/jsen.2019.2895294

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Real-Time Monocular Three-Dimensional Motion Tracking Using a Multithread Active Vision System2018

    • Author(s)
      Shaopeng Hu, Mingjun Jiang, Takeshi Takaki, and Idaku Ishii
    • Journal Title

      Journal of Robotics and Mechatronics

      Volume: 30 Issue: 3 Pages: 453-466

    • DOI

      10.20965/jrm.2018.p0453

    • NAID

      130007405723

    • ISSN
      0915-3942, 1883-8049
    • Year and Date
      2018-06-20
    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] View Expansion System for Microscope Photography using the Observing Point Movement by Galvano Mirror2018

    • Author(s)
      青山忠義, 金石守, 高木健, 石井抱, 長谷川泰久
    • Journal Title

      Journal of the Robotics Society of Japan

      Volume: 36 Issue: 4 Pages: 294-301

    • DOI

      10.7210/jrsj.36.294

    • NAID

      130007397020

    • ISSN
      0289-1824, 1884-7145
    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] A Modular and Reconfigurable Pipeline Architecture for Learning Vector Quantization2018

    • Author(s)
      Xiangyu Zhang, Fengwei An, Lei Chen, Idaku Ishii, Hans Juergen Mattausch
    • Journal Title

      IEEE Transactions on Circuits and Systems I: Regular Papers

      Volume: 99 Issue: 10 Pages: 1-14

    • DOI

      10.1109/tcsi.2018.2804946

    • Related Report
      2018 Annual Research Report 2017 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Vibration Sensing of a Bridge Model Using a Multithread Active Vision System2018

    • Author(s)
      Tadayoshi Aoyama、Liang Li、Mingjun Jiang、Kazuki Inoue、Takeshi Takaki、Idaku Ishii
    • Journal Title

      IEEE/ASME Transactions on Mechatronics

      Volume: 23 Issue: 1 Pages: 179-189

    • DOI

      10.1109/tmech.2017.2764504

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Monocular Stereo Measurement Using High-Speed Catadioptric Tracking2017

    • Author(s)
      Shaopeng Hu、Yuji Matsumoto、Takeshi Takaki、Idaku Ishii
    • Journal Title

      Sensors

      Volume: 17 Issue: 8 Pages: 1839-1839

    • DOI

      10.3390/s17081839

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Real-Time Vibration Source Tracking using High-Speed Vision2017

    • Author(s)
      Mingjun Jiang, Qingyi Gu, Tadayoshi Aoyama, Takeshi Takaki, and Idaku Ishii,
    • Journal Title

      IEEE Sensors Journal

      Volume: 17(5) Issue: 5 Pages: 1513-1527

    • DOI

      10.1109/jsen.2016.2647690

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] A Hardware-oriented HOG Algorithm and Its VLSI Implementation2017

    • Author(s)
      Xiangyu Zhang、Fengwei An、Ikki Nakashima、 Aiwen Luo、Lei Chen、Idaku Ishii、Hans Jurgen Mattausch
    • Journal Title

      Japanese Journal of Applied Physics

      Volume: 56 Issue: 4S Pages: 04CF01-04CF01

    • DOI

      10.7567/jjap.56.04cf01

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] High-frame-rate Target Tracking with CNN-based Object Recognitio2018

    • Author(s)
      Mingjun Jiang, Yihao Gu, Takeshi Takaki, and Idaku Ishii
    • Organizer
      IEEE/RSJ International Conference on Intelligent Robots and Systems
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] HFR-video-based Image Pattern Recognition Using Pixel-level Temporal Frequency Response Matching2018

    • Author(s)
      Kohei Shimasaki, Tomoaki Okamura, Mingjun Jiang, Takeshi Takaki, Idaku Ishii, and Kazuhiko Yamamoto
    • Organizer
      IEEE International Conference on Automation Science and Engineering
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 遠隔広域ビデオ監視に向けた超望遠トラッキングシステムの開発2018

    • Author(s)
      足立洋輝, 姜明俊, 高木健, 石井抱
    • Organizer
      日本機械学会ROBOMECH2018
    • Related Report
      2018 Annual Research Report
  • [Presentation] アンダーサンプリングビデオ画像による画素レベル振動源定位の検討2018

    • Author(s)
      藤原長浩, 島崎航平, 姜明俊, 高木健, 石井抱
    • Organizer
      日本機械学会ROBOMECH2018
    • Related Report
      2018 Annual Research Report
  • [Presentation] 高速ビジョンを用いた実時間振動スペクトルイメージング2018

    • Author(s)
      島崎航平, 姜明俊, 高木健, 石井抱
    • Organizer
      日本機械学会ROBOMECH2018
    • Related Report
      2018 Annual Research Report
  • [Presentation] ディープラーニングを用いた高速対象追跡2018

    • Author(s)
      姜明俊, 高木健, 石井抱
    • Organizer
      日本機械学会ROBOMECH2018
    • Related Report
      2018 Annual Research Report
  • [Presentation] High-speed Vision System for Dynamic Structural Distributed Displacement Analysis2017

    • Author(s)
      Zulhaj Aliansyah
    • Organizer
      Regional Conference on acoustics and vibration
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Instantaneous Acquisition of Focused Image Using High-speed Microscope System2017

    • Author(s)
      Tadayoshi Aoyama
    • Organizer
      IEEE International Symposium on Micro-NanoMechatronics and Human Science
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Real-time Microscopic Video Shooting Using a View-expanded Microscope System2017

    • Author(s)
      Tadayoshi Aoyama
    • Organizer
      IEEE International Symposium on Micro-NanoMechatronics and Human Science
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] View Expansion System for Microscope Photography Based on Viewpoint Movement Using Galvano Mirror2017

    • Author(s)
      Tadayoshi Aoyama
    • Organizer
      2017 IEEE/RSJ International Conference on Intelligent Robots and Systems
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Vibration Distribution Measurement Using a High-speed Multithread Active Vision2017

    • Author(s)
      Liang Li
    • Organizer
      IEEE International Conference on Advanced Intelligent Mechatronics
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 1msオートパン・チルトによる目の高速トラッキングアルゴリズム2017

    • Author(s)
      若井 祐樹
    • Organizer
      日本機械学会ロボティクス・メカトロニクス講演会 2017
    • Related Report
      2017 Annual Research Report
  • [Presentation] 高速マルチスレッドアクティブビジョンを用いた実時間振動分布計測2016

    • Author(s)
      李 良
    • Organizer
      ROBMECH2016
    • Place of Presentation
      幕張メッセ
    • Related Report
      2016 Annual Research Report
  • [Presentation] ガルバノミラーを用いたアクティブデプスビジョンシステム2016

    • Author(s)
      井上 和生
    • Organizer
      ROBMECH2016
    • Place of Presentation
      幕張メッセ
    • Related Report
      2016 Annual Research Report
  • [Presentation] 高速ミラー追跡機能を用いた長尺ポール型撮影システム2016

    • Author(s)
      津田 和貴
    • Organizer
      ROBOMECH2016
    • Place of Presentation
      幕張メッセ
    • Related Report
      2016 Annual Research Report
  • [Presentation] 大型構造物の検査に向けた複数振動分布合成に基づくビジョンベースド振動モード解析2016

    • Author(s)
      李 良
    • Organizer
      第34回日本ロボット学会学術講演会
    • Place of Presentation
      山形大学小白川キャンパス
    • Related Report
      2016 Annual Research Report
  • [Presentation] ガルバノミラーを用いた顕微鏡撮影のための視 野拡張システム2016

    • Author(s)
      金石 守
    • Organizer
      第34回日本ロボット学会学術講演会
    • Place of Presentation
      山形大学小白川キャンパス
    • Related Report
      2016 Annual Research Report
  • [Presentation] 高速運動するマイクロ対象の合焦点画像を瞬時に捉えるトラッキング顕微鏡2016

    • Author(s)
      花菱元彬
    • Organizer
      第34回日本ロボット学会学術講演会
    • Place of Presentation
      山形大学小白川キャンパス
    • Related Report
      2016 Annual Research Report
  • [Presentation] High resolution imaging of a subsonic projectile using automated mirrors with large aperture2016

    • Author(s)
      Yukimi Tateno
    • Organizer
      The 31st Proceedings of International Congress on High-speed Imaging and Photonics (31st ICHSIP)
    • Place of Presentation
      ホテル阪急エキスポパーク,大阪
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 大型ミラーを使用した高速飛翔物体の高解像度映像計測2016

    • Author(s)
      舘野友貴美
    • Organizer
      2016年映像情報メディア学会年次大会
    • Place of Presentation
      三重大学工学部
    • Related Report
      2016 Annual Research Report

URL: 

Published: 2016-04-21   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi