Construction of a Real-time High-precision Sound Field Auralization Platform
| Project/Area Number |
22K12123
|
|---|
| Research Category |
Grant-in-Aid for Scientific Research (C)
|
| Allocation Type | Multi-year Fund |
|---|
| Section | 一般 |
|---|
| Review Section |
Basic Section 61020:Human interface and interaction-related
|
|---|
| Research Institution | Iwate University |
|---|
Principal Investigator |
TAN Yiyu 岩手大学, 理工学部, 准教授 (70743243)
|
|---|
| Project Period (FY) |
2022-04-01 – 2025-03-31
|
| Project Status |
Granted (Fiscal Year 2023)
|
| Budget Amount *help |
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2024: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2023: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2022: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
|
|---|
| Keywords | Sound field auralization / FDTD / FPGA / sound auralization |
|---|
| Outline of Research at the Start |
This research will focus on the issues of low accuracy and slow computation and investigate a real-time high precision sound field auralization platform using FPGA, in which the FDTD scheme is applied to obtain accurate room impulse response, sound field rendering and binaural rendering are directly implemented by hardware to speed up computation. The research will create new technology of immersive perception in human-computer interaction.
|
| Outline of Annual Research Achievements |
This research investigates a real-time high precision sound field auralization platform through algorithm/architecture and software/hardware co-designs. During the second fiscal year, high performance sound field auralization platform was developed. More details and research results are shown as follows.
(1)dataflow analysis and hierarchical parallelism. Dataflow in sound field rendering with finite difference time domain (FDTD) methods was analyzed. Based on it, the processing element was designed, the spatial blocking and temporal blocking were optimized and applied to reduce the required memory bandwidth, buffer size, and reuse data.
(2)acceleration on sound field rendering and convolution. A sound field render based on the FDTD method was developed to compute the impulse response of a sound space. Furthermore, dedicated hardware support for convolution in sound auralization was investigated.
(3)architectural exploration and optimization. The systolic architecture and coarse-grained reconfigurable architecture were explored and optimized for the sound field auralization platform. Different stencil patterns were applied to compute the impulse response of a sound space in sound field renderer.
(4)development and evaluation of hardware prototype machine. The prototype machines based on different FDTD methods were designed using OpenCL programming language and implemented using the FPGA board DE10-Agilex. Their performances were evaluated and compared with the solutions on a desktop machine with an Intel Xeon Gold 6212U processor.
|
| Current Status of Research Progress |
Current Status of Research Progress
2: Research has progressed on the whole more than it was originally planned.
Reason
According to the schedule, high performance sound field auralization platform will be investigated in the second fiscal year. As described in the research outcome, the processing element was designed based on the sound field rendering algorithm with the FDTD methods and analysis of their data flow. Dedicated sound field renderer was developed to compute impulse response of a sound space. Furthermore, different architectures for sound field auralization platform were explored and optimized. Prototype machines were developed using OpenCL and their performances were evaluated and compared with other solutions. The related results have already been presented in international conferences. Based on the above, the project progressed smoothly as we expected.
|
| Strategy for Future Research Activity |
During the second fiscal year, the development of the sound field auralization platform was completed. In the coming year, a virtual concert hall will be developed to demonstrate the real performance, and the technology of high-fidelity auditory perception will be explored. To analyze sound propagation in a virtual concert hall, system optimization techniques will be investigated to speed up performance and improve sampling rate of the output sound.
|
Report
(2 results)
Research Products
(10 results)
