• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Three dimensional cocktail party effect processor using audio-visual sensor fusion technique

Research Project

Project/Area Number 10650405
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Measurement engineering
Research InstitutionThe University of Electro-Communications

Principal Investigator

TAKAHASHI Kota  The University of Electro-Communications, Associate Professor, 電気通信学部, 助教授 (10188005)

Co-Investigator(Kenkyū-buntansha) 高橋 弘太  電気通信大学, 電気通信学部, 助教授 (10188005)
Project Period (FY) 1998 – 1999
Project Status Completed (Fiscal Year 1999)
Budget Amount *help
¥3,500,000 (Direct Cost: ¥3,500,000)
Fiscal Year 1999: ¥1,900,000 (Direct Cost: ¥1,900,000)
Fiscal Year 1998: ¥1,600,000 (Direct Cost: ¥1,600,000)
Keywordsimage processing / parallel processing / FPGA
Research Abstract

A psychological term "cocktail party effect" means biological special ability to extract an important signal from other ambient noises. In this technological research, the cocktail party effect is focused on in order to construct a new type of sensing system. Three dimensional array of logic elements for sensor fusion, i.e., three dimensional sensor fusion system which integrate audio signals and sequential images on time-space coordinates, is proposed in the research. Summaries of the research are as follows.
A prototype system with a three dimensional array of 16 x 16 x 8 fusion cells has been constructed. Sixteen 60,000 gate FPGAs are used in the prototype system. Results of experiments using this system demonstrated the advantages of the concept of the new 3D system.
The BPF-ICA technique was also developed in this year, which was used as a preliminary step of sound source localizations. Using this algorithm, improvements in the source localization were demonstrated experimentally, especially in the case of 3D sound source location.
As the consequence of these results, the advantages of the concept of three dimensional logic elements for sensor fusion on time-space coordinates were shown.

Report

(3 results)
  • 1999 Annual Research Report   Final Research Report Summary
  • 1998 Annual Research Report

URL: 

Published: 1998-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi