• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A study of a honeybee camera instantly recognizes flapping communication

Research Project

Project/Area Number 20K14751
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 21030:Measurement engineering-related
Research InstitutionHiroshima University

Principal Investigator

Shimasaki Kohei  広島大学, デジタルものづくり教育研究センター, 特任助教 (20867303)

Project Period (FY) 2020-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2021: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
Fiscal Year 2020: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Keywordsアクティビティセンシング / 生物モニタリング / 高速ビジョン / 振動イメージング / 振動源検出 / 高速対象追跡 / 短時間フーリエ変換 / 画素レベル信号処理
Outline of Research at the Start

本研究では、申請者が行う高速ビジョンを用いた振動イメージング研究を起点として、音声周波数レベルの羽ばたきコミュニケーションを実時間イメージング・定量化するミツバチカメラの研究を行う。
1000fps画像に対し、CNN認識によるミツバチ位置・姿勢検出と画素レベルディジタル信号処理による羽ばたき検出を組合せた、個体毎の羽ばたきコミュニケーションを定量化するアルゴリズムが実時間動作する高速ビジョンを開発した上で、仲間に蜜源の場所を教える8の字ダンス等の長期間モニタリングを実施し、天候・季節等の条件で変わる蜜源位置に対する羽ばたき定量化によるオンライン定位実験等を通し、その有効性を示す。

Outline of Final Research Achievements

In this study, we investigated a honeybee camera for real-time imaging and quantification of wing flapping communication at the audio frequency level, starting from the vibration imaging research using high-speed vision. We proposed a high-speed vision algorithm to quantify individual wing flapping communication by combining the position and orientation detection of honeybees by CNN recognition and the wing flapping detection by pixel-level digital signal processing. We also developed a high-speed vision camera that can operate in real time for 1000 fps images as a honeybee camera, and conducted long-term monitoring of the figure-8 dance in the hive with the cooperation of the Honeybee Unit of the NARO. The effectiveness of the bee camera based on high-speed vision was demonstrated through these experiments.

Academic Significance and Societal Importance of the Research Achievements

本研究を通して進めてきた、ディジタル信号処理の全画素実装により、ミツバチの羽ばたきを画素単位で実時間検出し、ダイナミクスベースド画像認識技術を内包した新機軸の生物行動モニタリングシステムとして、これまで明らかにされていないミツバチの社会性アクティビティを示す羽ばたきコミュニケーション定量化を実現する点で、学術的意義がある。
また、本研究で開発した技術は単一画像の空間アピアランスのみでは検出が難しい、飛翔生物固有の羽ばたきパタンによる生物種判定に基づき、個体群での羽ばたきコミュニケーションを可視化し、群社会性を示す蜂群アクティビティを定量化するミツバチカメラとして社会的意義をもたらす。

Report

(3 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Research-status Report
  • Research Products

    (25 results)

All 2021

All Journal Article (11 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 11 results,  Open Access: 10 results) Presentation (14 results) (of which Int'l Joint Research: 5 results)

  • [Journal Article] Wide-area Operation Monitoring of Conveyors Using a Panoramic Vibration Camera2021

    • Author(s)
      Kohei Shimasaki, Zulhaj Aliansyah, Taku Senoo, Idaku Ishii, Tomohiko Ito
    • Journal Title

      ISIJ International

      Volume: 61 Issue: 10 Pages: 2587-2596

    • DOI

      10.2355/isijinternational.ISIJINT-2021-182

    • NAID

      130008104260

    • ISSN
      0915-1559, 1347-5460
    • Year and Date
      2021-10-15
    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Identification of Bridge Deterioration Using Rate of Change of Deflection Influence Lines and Deflection Curves2021

    • Author(s)
      市川辰旺, 宮濱晃一, 佐々木謙二, 出水亨, 古賀掲維, 島崎航平, 石井抱, 松田浩
    • Journal Title

      Journal of the Japanese Society for Experimental Mechanics

      Volume: 21 Issue: 2 Pages: 97-103

    • DOI

      10.11395/jjsem.21.97

    • NAID

      130008086183

    • ISSN
      1346-4930, 1884-4219
    • Year and Date
      2021-07-03
    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] A Simultaneous Multi-object Zooming System Using an Ultrafast Pan-tilt Camera2021

    • Author(s)
      Shaopeng Hu, Kohei Shimasaki, Mingjun Jiang, Taku Senoo, Idaku Ishii
    • Journal Title

      IEEE Sensors Journal

      Volume: 21 Issue: 7 Pages: 9436-9448

    • DOI

      10.1109/jsen.2021.3054425

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Projection-mapping-based object pointing using a high-frame-rate camera-projector system2021

    • Author(s)
      Deepak Kumar, Sushil Raut, Kohei Shimasaki, Taku Senoo, Idaku Ishii
    • Journal Title

      ROBOMECH Journal

      Volume: - Issue: 1 Pages: 8-8

    • DOI

      10.1186/s40648-021-00197-2

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Visual-Feedback-Based Frame-by-Frame Synchronization for 3000 fps Projector–Camera Visual Light Communication2021

    • Author(s)
      Atul Sharma,Sushil Raut, Kohei Shimasaki, Taku Senoo, and Idaku Ishii
    • Journal Title

      Electronics

      Volume: 10 Issue: 14 Pages: 1631-1631

    • DOI

      10.3390/electronics10141631

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Single-Camera-Based Bridge Structural Displacement Measurement with Traffic Counting2021

    • Author(s)
      Zulhaj Aliansyah, Kohei Shimasaki, Taku Senoo, Idaku Ishii, and Shuji Umemoto
    • Journal Title

      Sensors

      Volume: 21 Issue: 13 Pages: 4517-4517

    • DOI

      10.3390/s21134517

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] High-frame-rate Video-based Multicopter Tracking System Using Pixel-level Short-time Fourier Transform2021

    • Author(s)
      Kohei Shimasaki, Nagahiro Fujiwara, Shaopeng Hu, Taku Senoo, and Idaku Ishii
    • Journal Title

      Journal of Intelligent and Robotic Systems

      Volume: 103 Issue: 2 Pages: 36-36

    • DOI

      10.1007/s10846-021-01483-2

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] The method of calibration for the robot arm capable of adjusting position of the center of gravity and the evaluation of the motion in the air2021

    • Author(s)
      松永 望, 吉田 大哲, 島崎 航平, 妹尾 拓, 高木 健
    • Journal Title

      Transactions of the JSME (in Japanese)

      Volume: 87 Issue: 901 Pages: 21-00016-21-00016

    • DOI

      10.1299/transjsme.21-00016

    • NAID

      130008091875

    • ISSN
      2187-9761
    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] パノラマ振動カメラを用いた広域コンベア稼働モニタリング2021

    • Author(s)
      島崎航平, Zulhaj Aliansyah, 妹尾拓, 石井抱, 伊藤友彦
    • Journal Title

      鉄と鋼

      Volume: 107

    • NAID

      130008069698

    • Related Report
      2020 Research-status Report
    • Peer Reviewed
  • [Journal Article] A 500-fps Pan-tilt Tracking System with Deep-learning-based Object Detection2021

    • Author(s)
      Mingjun Jiang, Kohei Shimasaki, Shaopeng Hu, Taku Senoo, and Idaku Ishii
    • Journal Title

      IEEE Robotics and Automation Letters

      Volume: 6 Issue: 2 Pages: 691-698

    • DOI

      10.1109/lra.2020.3048653

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] 500-fps Omnidirectional Visual Tracking Using Three-Axis Active Vision System2021

    • Author(s)
      Mingjun Jiang, Ryo Sogabe, Kohei Shimasaki, Shaopeng Hu, Taku Senoo, and Idaku Ishii
    • Journal Title

      IEEE Transactions on Instrumentation and Measurement

      Volume: 70 Pages: 1-11

    • DOI

      10.1109/tim.2021.3053971

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] 高速ビジョンを用いたバーチャル触診システム2021

    • Author(s)
      島崎 航平, 高橋 裕之, 妹尾 拓, 石井 抱
    • Organizer
      日本機械学会 中国四国支部 第59期講演会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 超高速パンチルトカメラを用いたリモート振動モニタリングシステム2021

    • Author(s)
      島崎 航平,胡 少鵬,妹尾 拓,石井 抱
    • Organizer
      IIP2021 情報・知能・精密機器部門(IIP部門)講演会
    • Related Report
      2021 Annual Research Report
  • [Presentation] Vibration Detection Using Differential Multiple Exposure Imaging2021

    • Author(s)
      Mingjun Jiang, Kohei Shimasaki, Taku Senoo, Idaku Ishii
    • Organizer
      電子情報通信学会総合大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] Development of High-speed Miniature Pan-Tilt Embedded Vision System2021

    • Author(s)
      Sushil Raut, Idaku Ishii, Kohei Shimasaki, Taku Senoo, Akio Namiki
    • Organizer
      電気学会全国大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] Nvidia Jetson TX2を利用した実時間振動イメージングシステム2021

    • Author(s)
      島崎航平, Atul Kumar Sharma,妹尾 拓,石井 抱
    • Organizer
      電子情報通信学会総合大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] エリアセンシング技術による遠隔クレーンモニタリング2021

    • Author(s)
      石井 抱、島崎 航平、胡 少鵬、妹尾 拓、奥松 俊博、松田 浩
    • Organizer
      日本鉄鋼協会第182回講演大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 高速ビジョンを用いたアンローダークレーン振動モニタリング2021

    • Author(s)
      島崎 航平、胡 少鵬、妹尾 拓、石井 抱、伊藤友彦、松本愛
    • Organizer
      日本鉄鋼協会第182回講演大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] ロボットハンドを使用した加振によるねじ緩み判別2021

    • Author(s)
      立石侑也,島崎航平,妹尾 拓,石井 抱
    • Organizer
      第19回日本ロボット学会学術講演会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 分蜂を捉えるミツバチカメラ2021

    • Author(s)
      島﨑 航平, 妹尾 拓, 石井 抱, 荻原 麻理,芳山 三喜雄
    • Organizer
      第19回日本ロボット学会学術講演会
    • Related Report
      2021 Annual Research Report
  • [Presentation] View and Depth Expansion System for Microscope Photography Based on Dual Ultrafast Switching Mirror2021

    • Author(s)
      Shaopeng Hu, Wei Lu, Kohei Shimasaki, and Idaku Ishii
    • Organizer
      The 12th International Conference on Optics-photonics Design and Fabrication
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Multi-Person Authentication Using an Ultrafast Pan-Tilt Camera2021

    • Author(s)
      Liheng Shen, Shaopeng Hu, Kohei Shimasaki, and Idaku Ishii
    • Organizer
      The 12th International Conference on Optics-photonics Design and Fabrication
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A long-time automated honeybees count system using high-speed vision2021

    • Author(s)
      Hironori Yoshida, Kohei Shimasaki, Taku Senoo, Idaku Ishii, and Kazuhiko Yamamoto
    • Organizer
      2021 IEEE/SICE International Symposium on System Integration
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Vibration-feature-based Multicopter Detection with CNN-based Appearance Validation2021

    • Author(s)
      Raut Sushil, Kohei Shimasaki, Taku Senoo, and Idaku Ishii
    • Organizer
      7th IEEJ International Workshop on Sensing, Actuation, Motion Control, and Optimization
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] An Omnidirectional Multicopter Tracking System with HFR-Video-Based Vibration Source Localization2021

    • Author(s)
      Mingjun Jiang, Ryo Sogabe, Kohei Shimasaki, Taku Senoo, and Idaku Ishii
    • Organizer
      7th IEEJ International Workshop on Sensing, Actuation, Motion Control, and Optimization
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2020-04-28   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi