Development of multilingual-multizone generation system

• Project/Area Number: 15K21674
• Research Category: Grant-in-Aid for Young Scientists (B)
• Allocation Type: Multi-year Fund
• Research Field: Perceptual information processing; Design science
• Research Institution: National Institute of Information and Communications Technology
• Principal Investigator: Okamoto Takuma 国立研究開発法人情報通信研究機構, 先進的音声翻訳研究開発推進センター先進的音声技術研究室, 研究員 (10551567)
• Project Period (FY): 2015-04-01 – 2018-03-31
• Project Status: Completed (Fiscal Year 2017)
• Budget Amount: ¥4,030,000 (Direct Cost: ¥3,100,000、Indirect Cost: ¥930,000); Fiscal Year 2017: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000); Fiscal Year 2016: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000); Fiscal Year 2015: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
• Keywords: 音場制御 / スピーカアレイ / エリア再生 / 空間フーリエ変換 / マイクロホンアレイ / 音場変換 / スポット再生 / 局所再生 / 球面調和関数 / 角度スペクトル / 円筒調和解析 / マルチスポット再生 / 音場テレポーテーション / アンビソニックス / 円形アレイ / 窓関数 / 球面調和解析

Outline of Final Research Achievements

This research investigated several sound field control methods based on spatial Fourier transform for realizing multiple sound zones as below. (1) Spatial Fourier transform-based analytical approaches to generating multiple sound zones with a Hann window using linear and circular loudspeaker arrays have been provided and evaluated by using an actually implemented linear array of 64 loudspeakers. (2) Undesired propagation-free sound field control methods have been proposed for sound field synthesis in reverberant environments. (3) Analytical sound field conversion formulations between angular and circular/spherical harmonic spectrums have been derived and applied to generate multiple sound zones.
These results can expect to be useful for not only multilingual-multizone generation but also speech privacy, personal audio and other virtual reality applications.

Research Products

• [Journal Article] Horizontal local sound field propagation based on sound source dimension mismatch (2017)
  • Author(s): Takuma Okamoto
  • Journal Title: The Journal of information hiding and multimedia signal processing Volume: 8 Pages: 1609-1081
  • Peer Reviewed / Open Access
• [Journal Article] Localized sound zone generation based on external radiation canceller (2017)
  • Author(s): Takuma Okamoto
  • Journal Title: The Journal of information hiding and multimedia signal processing Volume: 8 Pages: 1335-1351
  • Peer Reviewed / Open Access
• [Journal Article] Experimental validation of spatial Fourier transform-based multiple sound zone generation with a linear loudspeaker array (2017)
  • Author(s): Takuma Okamoto and Atsushi Sakaguchi
  • Journal Title: The Journal of the Acoustical Society of America Volume: 141 Issue: 3 Pages: 1769-1780
  • DOI: 10.1121/1.4977995
  • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
• [Presentation] 剛球バッフルを用いた超接話アレイ処理 (2018)
  • Author(s): 岡本拓磨
  • Organizer: 日本音響学会2017年春季研究発表会
• [Presentation] モードマッチングに基づく円形二重アレイを用いた音場制御 (2017)
  • Author(s): 岡本拓磨
  • Organizer: 日本音響学会2017年春季研究発表会
  • Place of Presentation: 明治大学生田キャンパス，神奈川県川崎市
  • Year and Date: 2017-03-15
• [Presentation] Analytical approach to 2.5D sound field control using a circular double-layer array of fixed-directivity loudspeakers (査読あり) (2017)
  • Author(s): Takuma Okamoto
  • Organizer: 2017 International Conference on Acoustics, Speech and Signal Processing (ICASSP)
  • Place of Presentation: Hilton New Orleans Riverside, New Orleans, Louisiana, USA
  • Year and Date: 2017-03-05
  • Int'l Joint Research
• [Presentation] Angular spectrum decomposition-based 2.5D higher-order spherical harmonic sound field synthesis with a linear loudspeaker array (査読あり) (2017)
  • Author(s): Takuma Okamoto
  • Organizer: 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA)
  • Int'l Joint Research
• [Presentation] 球面調和展開から角度スペクトルへの解析的音場変換 (2017)
  • Author(s): 岡本拓磨
  • Organizer: 日本音響学会2017年秋季研究発表会
• [Presentation] 音場テレポーテーション (2016)
  • Author(s): 岡本拓磨
  • Organizer: 日本音響学会2016年秋季研究発表会
  • Place of Presentation: 富山大学．富山県富山市
  • Year and Date: 2016-09-14
• [Presentation] 2.5D higher-order Ambisonics for a sound field described by angular spectrum coefficients (査読あり) (2016)
  • Author(s): Takuma Okamoto
  • Organizer: 2016 International Conference on Acoustics, Speech and Signal Processing (ICASSP)
  • Place of Presentation: Shanghai International Convention Center, Shanghai, China
  • Year and Date: 2016-03-22
  • Int'l Joint Research
• [Presentation] 解析的音場変換に基づく円形アレイ内部におけるマルチスポット再生 (2016)
  • Author(s): 岡本拓磨
  • Organizer: 日本音響学会2016年春季研究発表会
  • Place of Presentation: 横浜桐蔭大学，神奈川県横浜市
  • Year and Date: 2016-03-09
• [Presentation] 角度スペクトルから円調和展開への解析的音場変換 (2016)
  • Author(s): 岡本拓磨
  • Organizer: 日本音響学会2016年春季研究発表会
  • Place of Presentation: 横浜桐蔭大学，神奈川県横浜市
  • Year and Date: 2016-03-09
• [Presentation] Analytical methods of generating multiple sound zones for open and baffled circular loudspeaker arrays (査読あり) (2015)
  • Author(s): Takuma Okamoto
  • Organizer: 2015 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA)
  • Place of Presentation: Mohonk Mountain House, New Paltz, NY, USA
  • Year and Date: 2015-10-18
  • Int'l Joint Research
• [Presentation] 中空・バッフル型円形アレイを用いたマルチスポット再生 (2015)
  • Author(s): 岡本拓磨
  • Organizer: 日本音響学会2015年秋季研究発表会
  • Place of Presentation: 会津大学，福島県会津若松市
  • Year and Date: 2015-09-16
• [Presentation] 空間フーリエ変換に基づくマルチスポット再生とその実装 (2015)
  • Author(s): 岡本拓磨，坂口敦
  • Organizer: 電子情報通信学会応用音響研究会 / 日本音響学会聴覚研究会
  • Place of Presentation: 東北大学，宮城県仙台市
  • Year and Date: 2015-08-03