• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Prototyping of environment sound recognition assist system by developing a sound identification method which can output recognition results as early as possible every moment with streaming processing

Research Project

Project/Area Number 16K00352
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Intelligent robotics
Research InstitutionNiigata University

Principal Investigator

Mamoru Iwaki  新潟大学, 自然科学系, 准教授 (20262595)

Project Period (FY) 2016-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
Fiscal Year 2018: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2017: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2016: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Keywords音認識 / 漸次的な認識法 / ベイズ推定 / ベイズ更新 / 環境音データベース / 感情音声 / 行動支援 / 骨導ヘッドフォン / 音環境認知支援 / データベース / 音源方向知覚 / 骨導ヘッドホン / 漸次的な音認識 / 音声等認識 / 行動環境認識 / 人間情報学 / 情報学
Outline of Final Research Achievements

(1) We conducted a one-week-long investigation of indoor environmental sounds for each research subject. Sounds which had an influence on the behavior after the sounds were selected and recorded to construct a sound database. The database was labelled by sound impression based on hearing experiment.
(2) We developed a sound recognition method which can output recognition results every moment and update degree of belief about the result as the following part of the sounds arrives, which was examined in both emotional speech recognition and environment sound recognition experiments. According to computer simulations, it was confirmed that the method had the intended property.
(3) We examined bone-conduction headphones as a presentation device for information of occurring sounds. Because perceived sounds direction through bone-conduction headphones had a tendency to slip off, we developed a correction method.

Academic Significance and Societal Importance of the Research Achievements

自然な音声インターフェースのにとって、非言語情報の自動認識は重要な課題である。この認識は音の聴取と同時進行しなければならない。既存の手法は全収録後に認識といったバッチ処理的であるという欠点がある。本研究の特色は、この要件を満たす漸次的な認識手法を開発することである。その原型は、時々刻々と得られる短時間フレーム毎の認識をベイズ更新によって取り込みそれまでの認識結果を逐次更新していくことである。聴覚障がい者の行動支援機器の開発や、会話の進行に応じて適切な相槌を打ったり、話し手の感情を察して次の発話に備えたりすることができる、人間にとって自然な音声インターフェースの開発などに応用できる。

Report

(4 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Research-status Report
  • 2016 Research-status Report
  • Research Products

    (10 results)

All 2019 2018 2017 2016

All Presentation (10 results) (of which Int'l Joint Research: 3 results)

  • [Presentation] 骨導音の非同時マスキング効果における周波数依存性の計測2019

    • Author(s)
      碓井崚,岩城護
    • Organizer
      日本音響学会
    • Related Report
      2018 Annual Research Report
  • [Presentation] 骨導音の非同時マスキング効果の計測 ―狭いノッチ幅の場合―2018

    • Author(s)
      碓井崚,岩城護
    • Organizer
      電子情報通信学会
    • Related Report
      2018 Annual Research Report
  • [Presentation] Sound-Recognition Method for Helping Us Respond Appropriately to Sounds in Daily Life2018

    • Author(s)
      Mamoru Iwaki, Shun Nakayama
    • Organizer
      IEEE
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 骨導ヘッドフォン聴取における純音の音源知覚方向のズレとILDとの関係(ILDをパラメータとした骨導ヘッドフォンにおける音源知覚方向のズレ計測)2018

    • Author(s)
      清水理博,岩城護
    • Organizer
      日本音響学会
    • Related Report
      2017 Research-status Report
  • [Presentation] 骨導ヘッドフォン聴取における純音の音源知覚方向のズレとITDとの関係2017

    • Author(s)
      清水理博,岩城護
    • Organizer
      電子情報通信学会
    • Related Report
      2017 Research-status Report
  • [Presentation] 情動パラメータから成る感情空間における感情音声の分布について2017

    • Author(s)
      田村美友貴,岩城護
    • Organizer
      電子情報通信学会
    • Related Report
      2017 Research-status Report
  • [Presentation] Environmental Sound Database Focusing on Listener Impressions in Indoor Daily Life and Its Characteristics2017

    • Author(s)
      Mamoru Iwaki, Shun Nakayama
    • Organizer
      IEEE
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] 人が自宅内で聴取する生活環境音の種類に関する調査2017

    • Author(s)
      中山俊, 岩城護
    • Organizer
      日本音響学会
    • Place of Presentation
      明治大学(神奈川)
    • Related Report
      2016 Research-status Report
  • [Presentation] 聴取印象によるラベル付けに基づいた環境音データベース作成の試み2016

    • Author(s)
      中山俊, 岩城護
    • Organizer
      日本音響学会
    • Place of Presentation
      富山大学(富山)
    • Related Report
      2016 Research-status Report
  • [Presentation] A sound recognition method with incrementally taking sound stream into consideration2016

    • Author(s)
      Mamoru Iwaki, Shun Nakayama
    • Organizer
      IEEE
    • Place of Presentation
      京都メルパルク(京都)
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2016-04-21   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi