• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A study on super-resolution sound field recording and reproduction for high-fidelity audio systems

Research Project

Project/Area Number 15H05312
Research Category

Grant-in-Aid for Young Scientists (A)

Allocation TypeSingle-year Grants
Research Field Perceptual information processing
Research InstitutionThe University of Tokyo

Principal Investigator

Koyama Shoichi  東京大学, 大学院情報理工学系研究科, 講師 (80734459)

Research Collaborator Daudet Laurent  
Chardon Gilles  
Project Period (FY) 2015-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥24,180,000 (Direct Cost: ¥18,600,000、Indirect Cost: ¥5,580,000)
Fiscal Year 2018: ¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2017: ¥5,720,000 (Direct Cost: ¥4,400,000、Indirect Cost: ¥1,320,000)
Fiscal Year 2016: ¥6,240,000 (Direct Cost: ¥4,800,000、Indirect Cost: ¥1,440,000)
Fiscal Year 2015: ¥8,060,000 (Direct Cost: ¥6,200,000、Indirect Cost: ¥1,860,000)
Keywords音場制御 / 音場計測 / バーチャルリアリティ / 圧縮センシング / 機械学習 / 音響情報処理 / 音響信号処理
Outline of Final Research Achievements

In this study, we addressed super-resolution sound field recording and reproduction for high-fidelity audio systems. Our achievements are summarized as follows: (1) For sound field reconstruction using a microphone array, we proposed a method based on harmonic analysis of infinite orders for estimating a sound field inside the source-free region. For estimating a sound field including sources, a sparse sound field decomposition method is proposed, and its efficacy is validated by experiments. (2) We proposed a sound field recording and reproduction method using the prior information of source locations and listening area. (3) A theory on the optimal loudspeaker and microphone placement method for sound field control is investigated.

Academic Significance and Societal Importance of the Research Achievements

本研究成果は,音空間を計測あるいは制御する上で,少数のマイクロフォンやスピーカのみを用いて高精度化を実現する信号処理手法について,理論構築と実験的な検証を行なったものである。これは臨場感の高い音響再生システムや,音の空間的な制御などに応用が可能な技術である。従来の方法では,再現可能な周波数の上限値や領域のサイズが,マイクロフォン・スピーカ素子数によって決まるため,システムが大規模化してしまうという問題があった。本研究成果により,このような素子数の削減が可能となり,より簡易的なシステムによって同様の効果が得られる可能性が示唆された。

Report

(5 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Annual Research Report
  • 2016 Annual Research Report
  • 2015 Annual Research Report
  • Research Products

    (45 results)

All 2019 2018 2017 2016 2015 Other

All Int'l Joint Research (3 results) Journal Article (8 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 6 results,  Open Access: 5 results) Presentation (34 results) (of which Int'l Joint Research: 17 results,  Invited: 5 results)

  • [Int'l Joint Research] Institut Langevin/CentraleSupelec(フランス)

    • Related Report
      2018 Annual Research Report
  • [Int'l Joint Research] Institut Langevin/CentraleSupelec(フランス)

    • Related Report
      2017 Annual Research Report
  • [Int'l Joint Research] Institut Langevin/CentraleSupelec(フランス)

    • Related Report
      2016 Annual Research Report
  • [Journal Article] Sparse Representation of a Spatial Sound Field in a Reverberant Environment2019

    • Author(s)
      Koyama Shoichi、Daudet Laurent
    • Journal Title

      IEEE Journal of Selected Topics in Signal Processing

      Volume: 13 Issue: 1 Pages: 172-184

    • DOI

      10.1109/jstsp.2019.2901127

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Sparse Representation Using Multidimensional Mixed-Norm Penalty With Application to Sound Field Decomposition2018

    • Author(s)
      Murata Naoki、Koyama Shoichi、Takamune Norihiro、Saruwatari Hiroshi
    • Journal Title

      IEEE Transactions on Signal Processing

      Volume: 66 Issue: 12 Pages: 3327-3338

    • DOI

      10.1109/tsp.2018.2830318

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Sparse sound field decomposition for super-resolution in recording and reproduction2018

    • Author(s)
      Koyama Shoichi、Murata Naoki、Saruwatari Hiroshi
    • Journal Title

      The Journal of the Acoustical Society of America

      Volume: 143 Issue: 6 Pages: 3780-3795

    • DOI

      10.1121/1.5042215

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Sound field recording using distributed microphones based on harmonic analysis of infinite order2018

    • Author(s)
      Natsuki Ueno, Shoichi Koyama, and Hiroshi Saruwatari
    • Journal Title

      IEEE signal processing letters

      Volume: 25 Issue: 1 Pages: 174-177

    • DOI

      10.1109/lsp.2017.2775242

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] 未来の音の収録・再生・編集技術の実現に向けて(創立100周年記念特集 「基礎・境界」が支えた100年,これからの100年)2017

    • Author(s)
      小山翔一
    • Journal Title

      電子情報通信学会誌

      Volume: 100 Pages: 474-478

    • Related Report
      2017 Annual Research Report
    • Open Access
  • [Journal Article] Analytical approach to transforming filter design for sound field recording and reproduction using circular arrays with a spherical baffle2016

    • Author(s)
      S. Koyama, K. Furuya, K. Wakayama, S. Shimauchi, and H. Saruwatari
    • Journal Title

      Journal of the acoustical society of america

      Volume: 139 Issue: 3 Pages: 1024-1036

    • DOI

      10.1121/1.4942590

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Source-location-informed sound field recording and reproduction2015

    • Author(s)
      S. Koyama, K. Furuya, Y. Haneda, and H. Saruwatari
    • Journal Title

      IEEE journal of selected topics in signal processing

      Volume: 9 Issue: 5 Pages: 881-894

    • DOI

      10.1109/jstsp.2015.2434319

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed
  • [Journal Article] スパース音場表現に基づく超解像型収音・再現2015

    • Author(s)
      小山翔一
    • Journal Title

      日本音響学会誌

      Volume: 71 Pages: 632-638

    • Related Report
      2015 Annual Research Report
  • [Presentation] Sparsity-based sound field reconstruction2018

    • Author(s)
      Shoichi Koyama
    • Organizer
      Tohoku universal acoustical communication month
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Kernel ridge regression with constraint of helmholtz equation for sound field interpolation2018

    • Author(s)
      Natsuki Ueno, Shoichi Koyama, Hiroshi Saruwatari
    • Organizer
      International workshop on acoustic signal enhancement (IWAENC)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Exterior and interior sound field separation using convex optimization: comparison of signal models2018

    • Author(s)
      Yuhta Takida, Shoichi Koyama, Natsuki Ueno, Hiroshi Saruwatari
    • Organizer
      European signal processing conference (EUSIPCO)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Gridless sound field decomposition based on reciprocity gap functional in spherical harmonic domain2018

    • Author(s)
      Yuhta Takida, Shoichi Koyama, Natsuki Ueno, Hiroshi Saruwatari
    • Organizer
      IEEE sensor array and multichannel signal processing workshop (SAM)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Sound field reproduction with exterior radiation cancellation using analytical weighting of harmonic coefficients2018

    • Author(s)
      Natsuki Ueno, Shoichi Koyama, Hiroshi Saruwatari
    • Organizer
      IEEE international conference on acoustics, speech, and signal processing (ICASSP)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Joint source and sensor placement for sound field control based on empirical interpolation method2018

    • Author(s)
      Shoichi Koyama, Gilles Chardon, Laurent Daudet
    • Organizer
      IEEE international conference on acoustics, speech, and signal processing (ICASSP)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 音場の補間に基づく分散配置マイクロフォンを用いたフィードフォワード型空間能動騒音制御2018

    • Author(s)
      伊東 勇登, 小山 翔一, 植野 夏樹, 猿渡 洋
    • Organizer
      日本音響学会春季研究発表会
    • Related Report
      2018 Annual Research Report
  • [Presentation] Annihilatingフィルタを用いた球面調和関数領域reciprocity gap functional: 複数周波数を用いたグリッドレス音場分解2018

    • Author(s)
      瀧田 雄太, 小山 翔一, 植野 夏樹, 猿渡 洋
    • Organizer
      第33回 信号処理シンポジウム
    • Related Report
      2018 Annual Research Report
  • [Presentation] 球面調和領域におけるreciprocity gap functional に基づくグリッドレス音場分解に関する実験的評価2018

    • Author(s)
      瀧田 雄太, 小山 翔一, 植野 夏樹, 猿渡 洋
    • Organizer
      日本音響学会秋季研究発表会
    • Related Report
      2018 Annual Research Report
  • [Presentation] 微分で求める!積分を用いない高次アンビソニックス係数の導出2018

    • Author(s)
      植野 夏樹, 小山 翔一, 猿渡 洋
    • Organizer
      日本音響学会秋季研究発表会
    • Related Report
      2018 Annual Research Report
  • [Presentation] 凸最適化による信号分離を用いたグリッドレス音場分解の性能向上2018

    • Author(s)
      瀧田雄太, 小山翔一, 植野夏樹, 猿渡洋
    • Organizer
      電子情報通信学会技術研究報告
    • Related Report
      2017 Annual Research Report
  • [Presentation] 調和スペクトルの解析的重み付けに基づく音場再現と放射抑圧2018

    • Author(s)
      植野夏樹, 小山翔一, 猿渡洋
    • Organizer
      日本音響学会春季研究発表会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Empirical interpolation method に基づく音場制御における音源・センサ配置法2018

    • Author(s)
      小山翔一, Gilles Chardon, Laurent Daudet
    • Organizer
      日本音響学会春季研究発表会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 内部・外部音場分離のための信号モデルの比較2018

    • Author(s)
      瀧田雄太, 小山翔一, 猿渡洋
    • Organizer
      日本音響学会春季研究発表会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Effect of multipole dictionary in sparse sound field decomposition for super-resolution in recording and reproduction2017

    • Author(s)
      Shoichi Koyama, Naoki Murata, and Hiroshi Saruwatari
    • Organizer
      International congress on sound and vibration (ICSV)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Comparison of reverberation models for sparse sound field decomposition2017

    • Author(s)
      Shoichi Koyama and Laurent Daudet
    • Organizer
      IEEE workshop on applications of signal processing to audio and acoustics (WASPAA)
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 複数球状マイクロフォンアレイを用いたグリッドレス音場分解の検討2017

    • Author(s)
      瀧田雄太, 小山翔一, 植野夏樹, 猿渡洋
    • Organizer
      日本音響学会秋季研究発表会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 無限次元調和解析に基づく音場補間とそのカーネル回帰としての解釈2017

    • Author(s)
      植野夏樹, 小山翔一, 猿渡洋
    • Organizer
      日本音響学会秋季研究発表会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Listening-area-informed sound field reproduction with gaussian prior based on circular harmonic expansion2017

    • Author(s)
      Natsuki Ueno, Shoichi Koyama, and Hiroshi Saruwatari
    • Organizer
      Hands-free speech communication and microphone arrays (HSCMA)
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Listening-area-informed sound field reproduction based on circular harmonic expansion2017

    • Author(s)
      Natsuki Ueno, Shoichi Koyama, and Hiroshi Saruwatari
    • Organizer
      IEEE international conference on acoustics, speech, and signal processing (ICASSP)
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Spatio-temporal sparse sound field decomposition considering acoustic source signal characteristics2017

    • Author(s)
      Naoki Murata, Shoichi Koyama, Norihiro Takamune, and Hiroshi Saruwatari
    • Organizer
      IEEE international conference on acoustics, speech, and signal processing (ICASSP)
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 受聴エリア事前情報を用いた音場再現 ~ 任意のスピーカ配置と指向特性における検証 ~2017

    • Author(s)
      植野夏樹, 小山翔一, 猿渡洋
    • Organizer
      電子情報通信学会技術研究報告
    • Related Report
      2016 Annual Research Report
  • [Presentation] Sound field decomposition in reverberant environment using sparse and low-rank signal models2016

    • Author(s)
      S. Koyama and H. Saruwatari
    • Organizer
      IEEE international conference on acoustics, speech, and signal processing (ICASSP)
    • Place of Presentation
      Shanghai (中華人民共和国)
    • Year and Date
      2016-03-20
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Sparse sound field decomposition with multichannel extension of complex NMF2016

    • Author(s)
      N. Murata, S. Koyama, H. Kameoka, N. Takamune, and H. Saruwatari
    • Organizer
      IEEE international conference on acoustics, speech, and signal processing (ICASSP)
    • Place of Presentation
      Shanghai (中華人民共和国)
    • Year and Date
      2016-03-20
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 音源位置事前情報を用いた球状アレイによる音場収音・再現2016

    • Author(s)
      伊藤光一郎, 小山翔一, 猿渡洋
    • Organizer
      日本音響学会春季研究発表会
    • Place of Presentation
      桐蔭横浜大学(神奈川県横浜市)
    • Year and Date
      2016-03-09
    • Related Report
      2015 Annual Research Report
  • [Presentation] Source-location-informed sound field recording and reproduction: a generalization to arrays of arbitrary geometry2016

    • Author(s)
      Shoichi Koyama
    • Organizer
      2016 AES international conference on sound field control
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Super-resolution in sound field recording and reproduction based on sparse representation2016

    • Author(s)
      Shoichi Koyama, Naoki Murata, and Hiroshi Saruwatari
    • Organizer
      5th joint meeting of the acoustical society of america and acoustical society of japan
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 受聴エリア事前情報を用いた音場再現 -直線状アレイによる検証-2016

    • Author(s)
      植野夏樹, 小山翔一, 猿渡洋
    • Organizer
      日本音響学会秋季研究発表会
    • Related Report
      2016 Annual Research Report
  • [Presentation] 多重極辞書を用いたスパース音場分解の検討2016

    • Author(s)
      村田直毅, 小山翔一, 高宗典玄, 猿渡洋
    • Organizer
      日本音響学会秋季研究発表会
    • Related Report
      2016 Annual Research Report
  • [Presentation] 音源信号の特性を考慮した時空間スパース音場分解の検討2016

    • Author(s)
      村田直毅, 小山翔一, 高宗典玄, 猿渡洋
    • Organizer
      第31回 信号処理シンポジウム
    • Related Report
      2016 Annual Research Report
  • [Presentation] Sparse sound field decomposition using group sparse bayesian learning2015

    • Author(s)
      S. Koyama, A. Matsubayashi, N. Murata, and H. Saruwatari
    • Organizer
      Asia-pacific signal and information processing association annual summit and conference (APSIPA ASC)
    • Place of Presentation
      Hong Kong (中華人民共和国)
    • Year and Date
      2015-12-16
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Source-location-informed sound field recording and reproduction with spherical arrays2015

    • Author(s)
      S. Koyama, K. Ito, and H. Saruwatari
    • Organizer
      IEEE workshop on applications of signal processing to audio and acoustics (WASPAA)
    • Place of Presentation
      New Paltz (アメリカ合衆国)
    • Year and Date
      2015-10-18
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] スパース音場分解における時間周波数領域低ランクモデルの導入2015

    • Author(s)
      村田直毅, 小山翔一, 亀岡弘和, 高宗典玄, 猿渡洋
    • Organizer
      日本音響学会秋季研究発表会
    • Place of Presentation
      会津大学(福島県会津若松市)
    • Year and Date
      2015-09-16
    • Related Report
      2015 Annual Research Report
  • [Presentation] スパース性と低ランク性に基づく信号表現による音場分解2015

    • Author(s)
      小山翔一, 猿渡洋
    • Organizer
      日本音響学会秋季研究発表会
    • Place of Presentation
      会津大学(福島県会津若松市)
    • Year and Date
      2015-09-16
    • Related Report
      2015 Annual Research Report

URL: 

Published: 2015-04-16   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi