研究課題/領域番号 |
22KF0141
|
補助金の研究課題番号 |
22F22769 (2022)
|
研究種目 |
特別研究員奨励費
|
配分区分 | 基金 (2023) 補助金 (2022) |
応募区分 | 外国 |
審査区分 |
小区分20020:ロボティクスおよび知能機械システム関連
|
研究機関 | 東京工業大学 |
研究代表者 |
中臺 一博 東京工業大学, 工学院, 教授 (70436715)
|
研究分担者 |
YEN BENJAMIN 東京工業大学, 工学院, 外国人特別研究員
|
研究期間 (年度) |
2023-03-08 – 2025-03-31
|
研究課題ステータス |
交付 (2023年度)
|
配分額 *注記 |
2,200千円 (直接経費: 2,200千円)
2024年度: 600千円 (直接経費: 600千円)
2023年度: 1,100千円 (直接経費: 1,100千円)
2022年度: 500千円 (直接経費: 500千円)
|
キーワード | ドローン聴覚 / 音響信号処理 / 深層学習 |
研究開始時の研究の概要 |
This research aims to develop a drone intended for search and rescue. Equipped with "ears", the drone "listens" to an audible target and, in turn, promotes effective communication with them. "Listening" includes recognising, locating and recording the target sound "clearly" (i.e. free of noise from the drone's rotors and surroundings) under harsh, noisy environments, typical in search and rescue.
|
研究実績の概要 |
This research year, we developed and implemented a real-life sound source tracking system using drones equipped with microphone arrays. Previously, such systems were only demonstrated in simulations. Due to strict drone flight regulations in Japan, we designed an indoor system with miniature drones and custom microphones to navigate these restrictions. We also enhanced the system with a drone navigation setup that continuously adjusts drone positions to maximize sound tracking accuracy. Further modifications to the sound tracking algorithms were necessary to address real-life constraints and challenges. Additionally, we have advanced drone noise reduction techniques for improved sound source tracking, showing promising results in simulations. Real-life testing, however, unveiled unforeseen challenges not anticipated in the simulation phase, necessitating further simulations and experimental tests to refine our approach and meet these new requirements. These developments contribute to our smart drone audition research theme, utilizing multiple drones with autonomous navigation to enhance sound source tracking performance. This system not only aims to improve the accuracy of locating sound sources but also enhances the quality of recorded audio by minimizing drone noise interference. These advancements are expected to significantly benefit applications where audio clarity and quality are critical.
|
現在までの達成度 (区分) |
現在までの達成度 (区分)
2: おおむね順調に進展している
理由
Given that it is our understanding that until now, no one has developed a multi-drone system that is used to perform sound source tracking, it is under the expectation that developing such a system will be challenging and will take a considerable amount of time. Several components in the system required custom hardware, and many trial-and-errors were needed to overcome the practical challenges and issues that arose, of which many have very limited information or solutions available. Due to the time spent on developing this system, there has been limited development in the algorithm aspect of the research, which has impacted the research output in terms of publications. However, most of the challenges have finally been overcome, and we now have a working real-life system to perform the designated task. We now have a development platform to prototype and test any new algorithmic developments of sound source tracking, and even other drone audition-related algorithms. We expect the number of research outputs to increase from this point onwards.
|
今後の研究の推進方策 |
We intend to continue the smart drone audition research in the following ways: 1) We intend to make use of the newly developed indoor system to prototype new sound source tracking algorithms, and more importantly drone noise reduction techniques to improve the performance of multi-drone sound source tracking. Such algorithms include namely i) drone noise reduction techniques, ii) sound source recognition (for multiple sound source scenarios, where identifying and ensuring the correct sound source is tracked is important) and if possible, iii) implemented obstacle avoidance and environmental mapping functionalities to improve the drone’s self-reliant capabilities. 2) Using the experience and software developed from the indoor system, we intend to expand and develop a full-sized outdoor multi-drone system for practical sound source tracking. This not only includes development of relevant algorithms, but also design choices in the hardware of the full-sized system. We also intent to integrate the multi-drone sound source tracking system with other forms of robots to allow cooperative sound source tracking to be carried out.
|