• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A Study on Audio Augmented Reality Based on Sound Scene Decomposition, Synthesis, and Modification

Research Project

Project/Area Number 15300035
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Media informatics/Database
Research InstitutionNara Institute of Science and Technology

Principal Investigator

SARUWATARI Hiroshi  Nara Institute of Science and Technology, Graduate School of Information Science, Associate Professor, 情報科学研究科, 助教授 (30324974)

Co-Investigator(Kenkyū-buntansha) SHIKANO Kiyohiro  Nara Institute of Science and Technology, Graduate School of Information Science, Professor, 情報科学研究科, 教授 (00263426)
KAWANAMI Hiromichi  Nara Institute of Science and Technology, Graduate School of Information Science, Assistant Professor, 情報科学研究科, 助手 (80335489)
TODA Tomoki  Nara Institute of Science and Technology, Graduate School of Information Science, Assistant Professor, 情報科学研究科, 助手 (90403328)
李 晃伸  奈良先端科学技術大学院大学, 情報科学研究科, 助手 (80332766)
Project Period (FY) 2003 – 2006
Project Status Completed (Fiscal Year 2006)
Budget Amount *help
¥13,900,000 (Direct Cost: ¥13,900,000)
Fiscal Year 2006: ¥3,100,000 (Direct Cost: ¥3,100,000)
Fiscal Year 2005: ¥2,800,000 (Direct Cost: ¥2,800,000)
Fiscal Year 2004: ¥3,600,000 (Direct Cost: ¥3,600,000)
Fiscal Year 2003: ¥4,400,000 (Direct Cost: ¥4,400,000)
KeywordsSound scene / Blind signal processing / Source separation / Binaural / Audio augmented reality / Speech processing / 音響拡張現実
Research Abstract

In this research, we resolve a source separation problem, which was considered within acoustics problem, by combining information theory and acoustic signal processing theory. Also we mainly aim to construct a general system consisting of "sound scene decomposition, synthesis, and modification," unlike a simple elemental technology of source separation. As a result, in particular, we successfully realize the various sound-scene-processing system which is based on SIMO-ICA algorithm, binaural-type independent component analysis, as follows :
(1) We can realize the blind source separation system which combines information theory and spatial acoustic signal processing.
(2) We conducted a theoretical analysis of SIMO-ICA-based blind source separation algorithm, and developed the real-time implementation. Also the evaluations on the system were carried out under realistic acoustic environments.
(3) We prepared a specific database for binaural sound source separation experiment.
(4) We can show an SIMO-ICA's applicability to hands-free speech recognition via evaluation of efficacy of sound source separation and speech recognition performances.
(5) Sound scene decomposition-synthesis system (binaural hearing-aid system) can be developed by using the real-time ICA unit.
The related publications to this research project are as follows : 17 journal papers, 53 reviewed international conference papers, 8 invited talks, and 53 domestic conferences, including 11 scientific awards.

Report

(5 results)
  • 2006 Annual Research Report   Final Research Report Summary
  • 2005 Annual Research Report
  • 2004 Annual Research Report
  • 2003 Annual Research Report
  • Research Products

    (42 results)

All 2007 2006 2005 2004 2003 Other

All Journal Article (37 results) Publications (5 results)

  • [Journal Article] Evaluation of Blind Source Separation Combining SIMO-ICA and SIMO-Model-Based Binary Masking in Noisy Environment2007

    • Author(s)
      Yoshimitsu Mori
    • Journal Title

      Proc. 2007 RISP International Workshopon Nonlinear Circuits and Signal Processing (NCSP 07) Vol. I

      Pages: 225-228

    • Related Report
      2006 Annual Research Report
  • [Journal Article] High-Presence Hearing-Aid System Using DSP-Based Real-Time Blind Source Separation Module2007

    • Author(s)
      Yoshimitsu Mori
    • Journal Title

      Proc. ICASSP 2007 Vol. 4

      Pages: 609-612

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Blind source separation based on fast-convergence algorithm combining ICA and beamforming2006

    • Author(s)
      Hiroshi Saruwatari
    • Journal Title

      IEEE Transactions on Speech, Audio, and Language Processing Vol. 14

      Pages: 666-678

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Blind Separation of Acoustic Signals Combining SIMO-Model-Based Independent Component Analysis and Binary Masking2006

    • Author(s)
      Yoshimitsu Mori
    • Journal Title

      EURASIP Journal on Applied Signal Processing Vol. 2006. ID-No. 34970

      Pages: 17-17

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Blind source separation based on fast-convergence algorithm combining ICA and beamforming2006

    • Author(s)
      Hiroshi Saruwatari
    • Journal Title

      IEEE Transact ions on Speech, Audio, and Language Processing Vol.14

      Pages: 666-678

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Blind Separation of Acoustic Signals Combining SIMO-Model-Based Independent Component Analysis and Binary Masking2006

    • Author(s)
      Yoshimitsu Mori
    • Journal Title

      EURASIP Journal on Applied Signal Processing Vol.2006, ID-No.34970

      Pages: 17-17

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Blind Scparation of Acoustic Signals Combining SIMO-Model-Based Independent Component Analysis and Binary Masking2006

    • Author(s)
      Yoshimitsu Mori
    • Journal Title

      EURASIP Journal on Applied Signal Processing, vol.2006. ID-No.34970

      Pages: 17-17

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 聞きたい音だけを瞬時に抽出 -リアルタイムブラインド音源分離モジュールの開発-,2006

    • Author(s)
      猿渡洋
    • Journal Title

      電子情報通信学会誌 Vol.89, No.4

      Pages: 354-354

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Blind Source Separation Combining SIMO-ICA and SIMO-Model-Based Binary Masking2006

    • Author(s)
      Yoshimitsu Mori
    • Journal Title

      Proc. ICASSP 2006 Vol. V

      Pages: 81-84

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Blind source separation based on fast-convergence algorithm combining ICA and beamforming2006

    • Author(s)
      Hiroshi Saruwatari
    • Journal Title

      IEEE Transactions on Speech and Audio Processing Vol.14(印刷中)

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Multistage SIMO-based blind source separation combining frequency-domain ICA and time-domain ICA2005

    • Author(s)
      Satoshi Ukai
    • Journal Title

      IEICE Transactions Fundamentals Vol. E88-A

      Pages: 642-650

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] A self-generator method for initial filters of SIMO-ICA applied to blind separation of binaural sound mixtures2005

    • Author(s)
      Tomoya Takatani
    • Journal Title

      IEICE Transactions Fundamentals Vol. E88-A

      Pages: 1673-1682

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Blind separation speech by fixed-point ICA with source adaptive negentropy approximation2005

    • Author(s)
      Raikishore Prasad
    • Journal Title

      IEICE Transactions Fundamentals Vol. E88-A

      Pages: 1683-1692

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Blind separation and deconvolution for convolutive mixture of speech combining SIMO-model-based ICA and multichannel inverse filtering2005

    • Author(s)
      Hiroshi Saruwatari
    • Journal Title

      IEICE Transactions Fundamentals Vol. E88-A

      Pages: 2389-2400

    • NAID

      110003213592

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Effect of Central Limit Theorem non-compliance on blind separation of speech by negentropy maximization2005

    • Author(s)
      Raikishore Prasad
    • Journal Title

      Acoustical Science and Technology Vol. 26

      Pages: 511-522

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Estimation of shape parameter of GGD function by negentropy matching2005

    • Author(s)
      Raikishore Prasad
    • Journal Title

      Neural Processing Letters Vol. 22

      Pages: 377-389

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Multistage SIMO-based blind source separation combining frequency-domain ICA and time-domain ICA2005

    • Author(s)
      Satoshi Ukai
    • Journal Title

      IEICE Transactions Fundamentals Vol.E88-A

      Pages: 642-650

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary 2004 Annual Research Report
  • [Journal Article] A self-generator method for initial filters of SIMO-ICA applied to blind separation of binaural sound mixtures2005

    • Author(s)
      Tomoya Takatani
    • Journal Title

      IEICE Transactions Fundamentals Vol.E88-A

      Pages: 1673-1682

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary 2005 Annual Research Report
  • [Journal Article] Blind separation speech by fixed-point ICA with source adaptive negentropy approximation2005

    • Author(s)
      Rajkishore Prasad
    • Journal Title

      IEICE Transactions Fundamentals Vol.E88-A

      Pages: 1683-1692

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary 2005 Annual Research Report
  • [Journal Article] Blind separation and deconvolution for convolutive mixture of speech combining SIMO-model-based ICA and multichannel inverse filtering2005

    • Author(s)
      Hiroshi Saruwatari
    • Journal Title

      IEICE Transactions Fundamentals Vol.E88-A

      Pages: 2389-2400

    • NAID

      110003213592

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary 2005 Annual Research Report
  • [Journal Article] Effect of Central Limit Theorem non-compliance on blind separation of speech by negentropy maximization2005

    • Author(s)
      Rajkishore Prasad
    • Journal Title

      Acoustical Science and Technology Vol.26

      Pages: 511-522

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary 2005 Annual Research Report
  • [Journal Article] Estimation of shape parameter of GGD function by negentropy matching2005

    • Author(s)
      Rajkishore Prasad
    • Journal Title

      Neural Processing Letters Vol.22

      Pages: 377-389

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary 2005 Annual Research Report
  • [Journal Article] Blind source separation based on fast-convergence algorithm combining ICA and beamforming2005

    • Author(s)
      Hiroshi Saruwatari
    • Journal Title

      IEEE Transactions on Speech and Audio Processing (採録済)(印刷中)

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Probability distribution of time-series of speech spectral components2004

    • Author(s)
      Rajkishore Prasad
    • Journal Title

      IEICE Transactions Fundamentals Vol.E87-A

      Pages: 584-597

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Overdetermined Blind Separation for Real Convolutive Mixtures of Speech Based on Multistage ICA Using Subarray Processing2004

    • Author(s)
      Tsuyoki Nishikawa
    • Journal Title

      IEICE Transactions Fundamentals Vol. E87-A

      Pages: 1924-1932

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] High-fidelity blind separation of acoustic signals using SIMO-mo del-based independent component analysis2004

    • Author(s)
      Tomoya Takatani
    • Journal Title

      IEICE Transactions Fundamentals Vol. E87-A

      Pages: 2063-2072

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Robot That Can Hear, Understand and Talk2004

    • Author(s)
      Raikishore Prasad
    • Journal Title

      Advanced Robotics Vol. 18

      Pages: 533-564

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Negentropy based voice-activity detection for noise estimation in very low SNR condition2004

    • Author(s)
      Raikishore Prasad
    • Journal Title

      IEICE Electronics Express (ELEX) Vol. 1

      Pages: 495-500

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] An ICA Algorithm for Separation of Convolutive Mixture of Speech Signals2004

    • Author(s)
      Raikishore Prasad
    • Journal Title

      International Journal on Signal Processing Vol. 1

      Pages: 250-259

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Overdetermined Blind Separation for Real Convolutive Mixtures of Speech Based on Multistage ICA Using Subarray Processing2004

    • Author(s)
      Tsuyoki Nishikawa
    • Journal Title

      IEICE Transactions Fundamentals Vol.E87-A

      Pages: 1924-1932

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary 2004 Annual Research Report
  • [Journal Article] High-fidelity blind separation of acoustic signals using SIMO-model-based independent component analysis2004

    • Author(s)
      Tomoya Takatani
    • Journal Title

      IEICE Transactions Fundamentals Vol.E87-A

      Pages: 2063-2072

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary 2004 Annual Research Report
  • [Journal Article] Robot That Can Hear, Understand and Talk2004

    • Author(s)
      Rajkishore Prasad
    • Journal Title

      Advanced Robotics Vol.18

      Pages: 533-564

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Negentropy based voice-activity detection for noise estimation in very low SNR condition2004

    • Author(s)
      Rajkishore Prasad
    • Journal Title

      IEICE Electronics Express (ELEX) Vol.1

      Pages: 495-500

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary 2004 Annual Research Report
  • [Journal Article] An ICA Algorithm for Separation of Convolutive Mixture of Speech Signals2004

    • Author(s)
      Rajkishore Prasad
    • Journal Title

      International Journal on Signal Processing Vol.1

      Pages: 250-259

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Blind source separation of acoustic signals based on multistage ICA combining frequency-domain ICA and time-domain ICA2003

    • Author(s)
      Tsuyoki Nishikawa
    • Journal Title

      IEICE Transactions Fundamentals Vol.E86-A

      Pages: 846-858

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Stable learning algorithm for blind separation of temporally correlated acoustic signals combining multistage ICA and linear prediction2003

    • Author(s)
      Tsuyoki Nishikawa
    • Journal Title

      IEICE Transactions Fundamentals Vol.E86-A

      Pages: 2028-2036

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Blind source separation combining independent component analysis and beamforming2003

    • Author(s)
      Hiroshi Saruwatari
    • Journal Title

      EURASIP Journal on Applied Signal Processing Vol.2003

      Pages: 1135-1146

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Publications] Tsuyoki Nishikawa: "Blind source separation of acoustic signals based on multistage ICA combining frequency-domain ICA and time-domain ICA"IEICE Transactions Fundamentals. Vol.E86-A. 846-858 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Tsuyoki Nishikawa: "Stable learning algorithm for blind separation of temporally correlated acoustic signals combining multistage ICA and linear prediction"IEICE Transactions Fundamentals. Vol.E86-A. 2028-2036 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Hiroshi Saruwatari: "Blind source separation combining independent component analysis and beamforming"EURASIP Journal on Applied Signal Processing. Vol.2003. 1135-1146 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Rajkishore Prasad: "Probability distribution of time-series of speech spectral components"IEICE Transactions Fundamentals. Vol.E87-A. 584-597 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] Tomoya Takatani: "High-fidelity blind separation of acoustic signals using SIMO-model-based independent component analysis"IEICE Transactions Fundamentals. (採録決定).

    • Related Report
      2003 Annual Research Report

URL: 

Published: 2003-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi