• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of free-listening-point 3D sound systems based on ADVISE theory

Research Project

Project/Area Number 16H01736
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Research Field Human interface and interaction
Research InstitutionTohoku University

Principal Investigator

SUZUKI Yoiti  東北大学, 電気通信研究所, 教授 (20143034)

Co-Investigator(Kenkyū-buntansha) 行場 次朗  東北大学, 文学研究科, 教授 (50142899)
平原 達也  富山県立大学, 工学部, 教授 (80395087)
坂本 修一  東北大学, 電気通信研究所, 准教授 (60332524)
本多 明生  静岡理工科大学, 情報学部, 准教授 (80433564)
Research Collaborator TREVIÑO Jorge  
Project Period (FY) 2016-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥44,070,000 (Direct Cost: ¥33,900,000、Indirect Cost: ¥10,170,000)
Fiscal Year 2018: ¥11,830,000 (Direct Cost: ¥9,100,000、Indirect Cost: ¥2,730,000)
Fiscal Year 2017: ¥15,340,000 (Direct Cost: ¥11,800,000、Indirect Cost: ¥3,540,000)
Fiscal Year 2016: ¥16,900,000 (Direct Cost: ¥13,000,000、Indirect Cost: ¥3,900,000)
Keywords音空間 / 聴覚ディスプレイ / アクティブリスニング / ADVISE / 球状マイクロフォンアレイ / ARD / 高次アンビソニックス / spherical audio / マイクロフォンアレイ / 音空間技術 / バーチャルリアリティ / 音空間知覚 / 仮想球モデル / マルチモーダルインタフェース / 認知科学 / 音響情報処理
Outline of Final Research Achievements

Our aim is to develop high-definition, 3D sound systems that can control a free-listening point in order to support human active listening. To this end, we developed an advanced and high-precision 3D auditory display based on the theory of ADVISE, i.e. using the virtual sphere model proposed by the project's PI. We succeeded in refining the theory behind sound field synthesis within a virtual sphere. We then considered the sound field outside of the sphere, i.e. sound propagation throughout the room or hall that was virtually presented to the listeners based on ARD. Combining these results, we succeeded in developing a 3D auditory display based on ADVISE.
As a complement to these technologies, we also developed high-definition and efficient systems for the acquisition of 3D spatial sound information using compact, spherical microphone arrays. Moreover, we also investigated the perceptual aspects of spatial hearing in humans under active listening conditions to accumulate new knowledge.

Academic Significance and Societal Importance of the Research Achievements

本研究により,自由視聴点型音空間情報処理技術の基盤構築を研究代表者の独自技術であるADVISEに基づいて実現することができた。この技術は空間の把握に効果的なアクティブリスニング下で有効に機能することから,現実空間とサイバー空間の境界をシームレスにつなぐ音空間技術として大きな意義を有する.また,開発したアルゴリズムは,教室程度の部屋であれば,既に現状の高性能コンピュータを用いることにより実時間の計算も可能であることが示された.これは,今後の音に関するVR技術を根本的に高度化するシリコンコンサートホール技術の実現基盤を構築しえたものとして極めて大きな学術的,かつ社会的意義を有する.

Report

(4 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Annual Research Report
  • 2016 Annual Research Report
  • Research Products

    (36 results)

All 2019 2018 2017 2016 Other

All Int'l Joint Research (1 results) Journal Article (13 results) (of which Peer Reviewed: 7 results,  Open Access: 4 results) Presentation (21 results) (of which Int'l Joint Research: 3 results,  Invited: 5 results) Funded Workshop (1 results)

  • [Int'l Joint Research] ケンブリッジ大学(英国)

    • Related Report
      2018 Annual Research Report
  • [Journal Article] The effect of head orientation on the sound-image localization of a sound source near a reflective wall2019

    • Author(s)
      Shunya Kurachi, Daisuke Morikawa, Tatsuya Hirahara
    • Journal Title

      Acoust. Sci. & Tech.

      Volume: 40

    • NAID

      130007782734

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Measuring sound-image trajectory of a moving sound source approaching a reflective wall in steps2019

    • Author(s)
      Shunya Kurachi, Daisuke Morikawa, Tatsuya Hirahara
    • Journal Title

      Acoust. Sci. & Tech.

      Volume: 40

    • NAID

      130007672211

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Modeling head-related transfer functions with spherical wavelets2019

    • Author(s)
      Shichao Hu, Jorge Trevino, Cesar Salvador, Shuichi Sakamoto, Yoiti Suzuki
    • Journal Title

      Applied Acoustics

      Volume: 146 Pages: 81-88

    • DOI

      10.1016/j.apacoust.2018.10.026

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 高臨場感空間音響技術の最新動向と将来展望2018

    • Author(s)
      鈴木陽一,トレビーニョ ホルヘ,坂本修一
    • Journal Title

      電子情報通信学会IEICE会誌

      Volume: 101 Pages: 786-792

    • Related Report
      2018 Annual Research Report
  • [Journal Article] 日本における音響心理物理学の源流2018

    • Author(s)
      平原達也
    • Journal Title

      日本音響学会誌

      Volume: 74 Pages: 185-186

    • NAID

      130007491433

    • Related Report
      2018 Annual Research Report
  • [Journal Article] Effects of listener's whole-body rotation and sound duration on horizontal sound localization2018

    • Author(s)
      Akio Honda, Sayaka Tsunokake, Shuichi Sakamoto and Yoiti Suzuki
    • Journal Title

      Acoust. Sci. & Tech.

      Volume: 39 Pages: 305-307

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Boundary matching filters for spherical microphone and loudspeaker arrays2018

    • Author(s)
      Cesar Salvador, Shuichi Sakamoto, Jorge Trevino, and Yoiti Suzuki
    • Journal Title

      IEEE/ACM Transactions on Audio, Speech, and Language Processing

      Volume: 26 Issue: 3 Pages: 461-474

    • DOI

      10.1109/taslp.2017.2778562

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Enhancement of spatial sound recordings by adding virtual microphones to spherical microphone arrays2017

    • Author(s)
      Cesar D Salvador, Shuichi Sakamoto, Jorge Trevino, Yoiti Suzuki
    • Journal Title

      J. Inf. Hiding and Multimedia. Signal Process

      Volume: 8 Pages: 1392-1404

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Design theory for binaural synthesis: combining microphone array recordings and head-related transfer function datasets2017

    • Author(s)
      Cesar Salvador, Shuichi Sakamoto, Jorge Trevino and Yoiti Suzuki
    • Journal Title

      Acoust. Sci. & Tech.

      Volume: 38 Pages: 51-62

    • NAID

      130006038359

    • Related Report
      2016 Annual Research Report
  • [Journal Article] Distance-varying filters to synthesize head-related transfer functions in the horizontal plane from circular boundary values2017

    • Author(s)
      Cesar Salvador, Shuichi Sakamoto, Jorge Trevino and Yoiti Suzuki
    • Journal Title

      Acoust. Sci. & Tech.

      Volume: 38 Pages: 1-13

    • NAID

      130005239584

    • Related Report
      2016 Annual Research Report
  • [Journal Article] Spatial accuracy of binaural synthesis from rigid spherical microphone array recordings2017

    • Author(s)
      Cesar Salvador, Shuichi Sakamoto, Jorge Trevino and Yoiti Suzuki
    • Journal Title

      Acoust. Sci. & Tech.

      Volume: 38 Pages: 23-30

    • NAID

      130005239579

    • Related Report
      2016 Annual Research Report
  • [Journal Article] Sound image movement of approaching and retreating sounds2016

    • Author(s)
      Tatsuya Hirahara, Shuhei Okada
    • Journal Title

      J. Acoust. Soc. Am.

      Volume: 140 Pages: 3101-3101

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Detection of Sound Image Movement During Horizontal Head Rotation2016

    • Author(s)
      Honda, A., Ohba, K., Iwaya, Y., & Suzuki, Y.
    • Journal Title

      i-Perception

      Volume: 7 Pages: 1-10

    • Related Report
      2016 Annual Research Report
  • [Presentation] 情報の質と富化について ~ 将来の高精細空間音響システムを見据えて ~2019

    • Author(s)
      鈴木陽一
    • Organizer
      電子情報通信学会・マルチメディア情報ハイディング・エンリッチメント研究会(EMM)
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Presentation] 高精細3次元音空間情報システムの実現を目指して - アクティブリスニングの理解と,それを活かすシステムづくり-2018

    • Author(s)
      鈴木陽一
    • Organizer
      日本音響学会聴覚研究会・電気音響変換機器
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Presentation] The effect of head orientation on the sound-image localization of a sound source near a reflective wall2018

    • Author(s)
      Shunya Kurachi, Daisuke Morikawa, Tatsuya Hirahara
    • Organizer
      International Symposium on Universal Acoustical Communication 2018
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] The sound image trajectory of a moving sound approaching a reflective wall2018

    • Author(s)
      Shunya Kurachi, Daisuke Morikawa, Tatsuya Hirahara
    • Organizer
      176th Acoust. Soc. Amer. Meeting
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 音像位置の「計算」に用いられる音響てがかりについての論考2018

    • Author(s)
      平原達也
    • Organizer
      日本音響学会 聴覚研究会資料
    • Related Report
      2018 Annual Research Report
  • [Presentation] 頭部の向きが反射壁近傍における音像定位に与える影響2018

    • Author(s)
      倉地俊哉, 森川大輔, 平原達也
    • Organizer
      日本音響学会 2018年秋季研究発表会
    • Related Report
      2018 Annual Research Report
  • [Presentation] 耳と音響実験機器のエージング2018

    • Author(s)
      平原達也
    • Organizer
      日本音響学会聴覚研究会
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Presentation] 頭部伝達関数に含まれるノッチによる音色の変化と聴覚興奮パターンの関係2018

    • Author(s)
      日吉啓,鈴木陽一,坂本修一,MOORE Brian
    • Organizer
      電子情報通信学会・マルチメディア情報ハイディング・エンリッチメント研究会(EMM)
    • Related Report
      2018 Annual Research Report
  • [Presentation] Revisiting the Theory of Auditory Displays based on the Virtual Sphere Model2018

    • Author(s)
      Jorge Trevino, Shuichi Sakamoto, Yoiti Suzuki,
    • Organizer
      Seminar on the spatial aspects of hearing and their applications
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Enhancing binaural reconstruction from rigid circular microphone array recordings by using virtual microphones2018

    • Author(s)
      CD Salvador, S Sakamoto, J Trevino, Y Suzuki
    • Organizer
      2018 AES International Conference on Audio for Virtual and Augmented Reality
    • Related Report
      2018 Annual Research Report
  • [Presentation] 反射壁近傍における移動音源の音像軌跡の測定2018

    • Author(s)
      倉地俊哉, 森川大輔, 平原達也
    • Organizer
      日本音響学会 2018年春季研究発表会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Enhancing the binaural synthesis from spherical microphone array recordings by using virtual microphones2017

    • Author(s)
      C SALVADOR, S SAKAMOTO, J TREVINO, Y SUZUKI
    • Organizer
      日本音響学会聴覚研究会,電気音響研究会,電子情報通信学会応用音響研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 音源近傍の反射壁によるインパルス応答波形の変化2017

    • Author(s)
      倉地俊哉, 森川大輔, 平原達也
    • Organizer
      平成29年度電気関係学会北陸支部連合大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 音源近傍の反射壁による両耳特徴の変化2017

    • Author(s)
      倉地俊哉, 森川大輔, 平原達也
    • Organizer
      日本音響学会 2017年秋季研究発表会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 音源近傍の反射壁が両耳特徴に及ぼす影響2017

    • Author(s)
      倉地俊哉, 森川大輔, 平原達也
    • Organizer
      日本音響学会 聴覚研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Presenting spatial sound to moving listeners using high-order Ambisonics2016

    • Author(s)
      Jorge Trevino, Shuichi Sakamoto and Yoiti Suzuki
    • Organizer
      Proc. 2016 AES International Conference on Sound Field Control
    • Related Report
      2016 Annual Research Report
  • [Presentation] Sound source separation in complex environments using an array-of-arrays microphone system2016

    • Author(s)
      Jorge Trevino, Cesar Salvador, Virgilijus Braciulis, Shuichi Sakamoto, Yoiti Suzuki, Kyoji Yoshikawa, Takashi Yamasaki and Kenichi Kidokoro
    • Organizer
      Proc. The 22nd International Congress on Acoustics
    • Related Report
      2016 Annual Research Report
  • [Presentation] A nested beamforming approach to sound source separation using an array-of-arrays recording system2016

    • Author(s)
      Jorge Trevino, Shuichi Sakamoto and Yoiti Suzuki
    • Organizer
      Proc. 5th Joint Meeting of the Acoustical Society of America and the Acoustical Society of Japan,
    • Related Report
      2016 Annual Research Report
  • [Presentation] 複数の球状マイクロフォンアレイによる音源分離性能の基礎的検討2016

    • Author(s)
      愛知秀斗,ブラチリウス ビルギリウス,トレビーニョ ホルヘ,サルバドル セザル,坂本修一,鈴木陽一,吉川教治,山崎隆志,樹所賢一
    • Organizer
      電子情報通信学会技術研究報告,EA2016-45
    • Related Report
      2016 Annual Research Report
  • [Presentation] Accuracy of binaural synthesis from rigid spherical microphone array recordings2016

    • Author(s)
      Cesar Salvador, Shuichi Sakamoto, Jorge Trevino and Yoiti Suzuki
    • Organizer
      Proc. 2016 AES International Conference on Headphone Technology, 3-1
    • Related Report
      2016 Annual Research Report
  • [Presentation] Performance analysis of a compact spherical microphone array on sound-space sensing for binaural presentation2016

    • Author(s)
      Shuichi Sakamoto and Yoiti Suzuki
    • Organizer
      Proc. The 22nd International Congress on Acoustics, ICA2016-253
    • Related Report
      2016 Annual Research Report
    • Invited
  • [Funded Workshop] International Symposium on Universal Acoustical Communication 20182018

    • Related Report
      2018 Annual Research Report

URL: 

Published: 2016-04-21   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi