• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research assisting environment of speech communication based on interactive visualization and sonification

Research Project

Project/Area Number 16K12464
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Perceptual information processing
Research InstitutionWakayama University

Principal Investigator

Kawahara Hideki  和歌山大学, 学内共同利用施設等, 名誉教授 (40294300)

Co-Investigator(Kenkyū-buntansha) 入野 俊夫  和歌山大学, システム工学部, 教授 (20346331)
森勢 将雅  山梨大学, 大学院総合研究部, 准教授 (60510013)
Co-Investigator(Renkei-kenkyūsha) TODA Tomoki  名古屋大学, 情報基盤センター, 教授 (90403328)
SAKAKIBARA Ken-Ichi  北海道医療大学, リハビリテーション科学部, 准教授 (80396168)
HANEISHI Eri  昭和音楽大学, 音楽学部, 教授 (70350684)
BANNO Hideki  名城大学, 理工学部, 准教授 (20335003)
Research Collaborator Patterson Roy D.  Cambridge大学
Schweinberger Stefan  Jena大学
Ellis Dan  Columbia大学
McDermott Josh  MIT
Project Period (FY) 2016-04-01 – 2018-03-31
Project Status Completed (Fiscal Year 2017)
Budget Amount *help
¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000)
Fiscal Year 2017: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2016: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Keywords音声分析 / 音声合成 / 聴覚 / 感情音声 / 音声コミュニケーション / 対話的研究環境 / オープンソース / 音声情報処理 / 非言語 / 感情
Outline of Final Research Achievements

We developed infrastructures of speech analysis, modification, and synthesis based on interference-free representations of speech parametric representations. In addition to our STRAIGHT-based infrastructure, which is a defacto standard in speech research, we developed a set of new independent algorithms. We made these algorithms as open-source. We elaborated on building supporting tools for promoting academic research using STRAIGHT systems. In addition to these planned accomplishments, we also established application infrastructure based on WaveNet, which revolutionalized speech applications based on deep learning.

Report

(3 results)
  • 2017 Annual Research Report   Final Research Report ( PDF )
  • 2016 Research-status Report
  • Research Products

    (28 results)

All 2018 2017 2016 Other

All Journal Article (2 results) (of which Peer Reviewed: 2 results,  Open Access: 2 results) Presentation (21 results) (of which Int'l Joint Research: 7 results,  Invited: 2 results) Remarks (5 results)

  • [Journal Article] Sound quality comparison among high-quality vocoders by using re-synthesized speech2018

    • Author(s)
      Masanori Morise, Yusuke Watanabe
    • Journal Title

      Acoustical Science and Technology

      Volume: 39 Issue: 3 Pages: 263-265

    • DOI

      10.1250/ast.39.263

    • NAID

      130006730841

    • ISSN
      0369-4232, 1346-3969, 1347-5177
    • Year and Date
      2018-05-01
    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Pitfalls in digital signal processing2017

    • Author(s)
      河原 英紀
    • Journal Title

      THE JOURNAL OF THE ACOUSTICAL SOCIETY OF JAPAN

      Volume: 73 Issue: 9 Pages: 592-599

    • DOI

      10.20697/jasj.73.9_592

    • NAID

      130006407062

    • ISSN
      0369-4232, 2432-2040
    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] 対数領域パルスによる声帯音源モデルの拡張について2018

    • Author(s)
      河原 英紀、榊原健一
    • Organizer
      日本音響学会2018年春季研究発表会
    • Related Report
      2017 Annual Research Report
  • [Presentation] velvet noiseとその変種の聴覚心理・生理研究への応用可能性について2018

    • Author(s)
      河原 英紀、津崎 実、坂野秀樹、森勢将雅、松井淑恵、入野俊夫
    • Organizer
      日本音響学会聴覚研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Incorporating absolute threshold and a cochlear noise floor into the GammaChirp model of masking2018

    • Author(s)
      Toshio Irino, Kenji Yokota, Toshie Matsui, and Roy D. Patterson
    • Organizer
      ARO 41st midwinter meeting
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Application of the velvet noise and its variant for synthetic speech and singing2018

    • Author(s)
      河原 英紀
    • Organizer
      第118回音楽情報科学研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] エリアシングの無い声帯音源モデルおよび対話的音声生成シミュレータの拡張について2017

    • Author(s)
      河原英紀、榊原健一
    • Organizer
      日本音響学会春季研究発表会
    • Place of Presentation
      明治大学生田キャンパス、神奈川県川崎市
    • Year and Date
      2017-03-15
    • Related Report
      2016 Research-status Report
  • [Presentation] 瞬時周波数および群遅延に基づく非周期成分推定法再考2017

    • Author(s)
      河原 英紀、榊原 健一、森勢 将雅、坂野 秀樹
    • Organizer
      情報処理学会音楽情報科学研究会
    • Place of Presentation
      ヤマハ株式会社、静岡県浜松市
    • Year and Date
      2017-02-27
    • Related Report
      2016 Research-status Report
  • [Presentation] 音源の周期性を表す指標の実時間分析と表示について2017

    • Author(s)
      河原 英紀、榊原健一
    • Organizer
      電子情報通信学会音声研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Realtime feedback of singing voice information for assisting students learning music therapy2017

    • Author(s)
      Hideki Kawahara, Eri Haneishi, Kaori Hagiwara
    • Organizer
      2017 International Conference on Orange Technologies
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Making speech tangible for better understanding of human speech communication2017

    • Author(s)
      Hideki Kawahara
    • Organizer
      The 21th International Conference on Asian Language Processing
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 分析合成音を用いた音声分析合成方式の性能比較2017

    • Author(s)
      渡邊優介,森勢将雅
    • Organizer
      日本音響学会2017年秋季研究発表会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Characterization of subharmonic voices using phase derivatives2017

    • Author(s)
      Hideki Kawahara and Ken-Ichi Sakakibara
    • Organizer
      Pan-European Voice Conference
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A new cosine series antialiasing function and its application to aliasing-free glottal source models for speech and singing synthesis2017

    • Author(s)
      Hideki Kawahara, K. Sakakibara, H. Banno, M. Morise, T. Toda, T. Irino
    • Organizer
      Interspeech 2017
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 基本周波数再訪2017

    • Author(s)
      河原 英紀、榊原健一
    • Organizer
      電子情報通信学会音声研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] VOCODER再訪 ~ なぜ元の音声の位相を保存したくないのか ~2017

    • Author(s)
      河原 英紀
    • Organizer
      電子情報通信学会応用音響研究会
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] 高品質音声分析合成を用いた基本周波数の 実時間操作インタフェースの実装2017

    • Author(s)
      渡邊優介,森勢 将雅,小澤賢司
    • Organizer
      情報処理学会音楽情報科学研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 高齢難聴者の文聴取における文節休止の効果 ―模擬難聴システムによる検討―2017

    • Author(s)
      長谷川純, 畑山春菜,吐師道子,松井淑恵,入野俊夫
    • Organizer
      第18回日本言語聴覚学会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 模擬難聴システムの教育・臨床・研究への適用2017

    • Author(s)
      長谷川純,吐師道子,山下祐季,畑山春菜,松井淑恵,入野俊夫
    • Organizer
      広島県言語聴覚士会学術集会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 模擬難聴システムを用いた言語聴覚士養成課程での 演習と Web アプリ化の検討2017

    • Author(s)
      米満麻弥, 入野俊夫, 松井淑恵, 西村竜一,吐師道子, 長谷川 純
    • Organizer
      電子情報通信学会ヒューマン情報処理研究会 (合同研究会)
    • Related Report
      2017 Annual Research Report
  • [Presentation] Aliasing-free Fujisaki-Ljungqvist model and its application to voice quality perception2017

    • Author(s)
      Hideki Kawahara, Minoru Tsuzaki, Toshie Matsui, Toshio Irino, Ken-Ichi Sakakibara
    • Organizer
      日本音響学会聴覚研究会
    • Place of Presentation
      京都市立芸大、京都府京都市
    • Related Report
      2016 Research-status Report
  • [Presentation] Realtime and interactive tools for speech and hearing science education2016

    • Author(s)
      Hideki Kawahara, Masanori Morise, Ryuichi Nisimura, Toshio Irino
    • Organizer
      ASA/ASJ Joint meeting
    • Place of Presentation
      Honolulu, USA
    • Year and Date
      2016-11-28
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] SparkNG: Interactive MATLAB tools for introduction to speech production, perception and processing fundamentals and application of the aliasing-free LF model component2016

    • Author(s)
      Hideki Kawahara
    • Organizer
      Interspeech 2017
    • Place of Presentation
      SanFransisco, USA
    • Year and Date
      2016-09-08
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Remarks] Hideki Kawahara, Emeritus Professor

    • URL

      http://www.wakayama-u.ac.jp/~kawahara/index-e.html

    • Related Report
      2017 Annual Research Report
  • [Remarks] Hideki Kawahara, Emeritus Professor

    • URL

      http://www.wakayama-u.ac.jp/~kawahara

    • Related Report
      2017 Annual Research Report
  • [Remarks] 音声分析変換合成システムWORLD

    • URL

      https://github.com/mmorise/World

    • Related Report
      2017 Annual Research Report
  • [Remarks] SparkNG (Spark New Generation)

    • URL

      https://github.com/HidekiKawahara/SparkNG

    • Related Report
      2017 Annual Research Report
  • [Remarks] SparkNG: Matlab realtime speech tools and

    • URL

      http://www.wakayama-u.ac.jp/~kawahara/SparkNG/

    • Related Report
      2016 Research-status Report

URL: 

Published: 2016-04-21   Modified: 2019-03-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi