• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Functional speech design framework based on auditory information representation

Research Project

Project/Area Number 26540087
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Perceptual information processing
Research InstitutionWakayama University

Principal Investigator

KAWAHARA Hideki  和歌山大学, 学内共同利用施設等, 名誉教授 (40294300)

Co-Investigator(Kenkyū-buntansha) IRINO Toshio  和歌山大学, システム工学部, 教授 (20346331)
MATSUI Toshie  和歌山大学, システム工学部, 助教 (10510034)
MORISE Masanori  山梨大学, 総合研究部, 助教 (60510013)
Project Period (FY) 2014-04-01 – 2016-03-31
Project Status Completed (Fiscal Year 2015)
Budget Amount *help
¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2015: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2014: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Keywords音声情報処理 / 音声分析 / 音声変換 / パラ言語情報 / 信号処理 / 音声生成 / 音声知覚 / 非言語音声情報 / GUI / 声帯音源 / 好感度
Outline of Final Research Achievements

We introduced a new foundation of interactive investigation of functional speech sounds, based on our inventions, STRAIGHT, a speech analysis, modification and resynthesis framework, and a generalised morphing framework, which can morph arbitrarily many voices with individual and temporal control of constituent attributes. We also introduced a set of realtime interactive tools for providing understanding of speech production physics, physiology of voicing and articulatory organs, auditory perception and engineering representations. We also made the latter tools open sourced. Finally, we implemented a system to add glowl-like impression to any singing voices as an example of our proposed framework.

Report

(3 results)
  • 2015 Annual Research Report   Final Research Report ( PDF )
  • 2014 Research-status Report
  • Research Products

    (34 results)

All 2016 2015 2014 Other

All Journal Article (4 results) (of which Peer Reviewed: 4 results,  Acknowledgement Compliant: 4 results,  Open Access: 2 results) Presentation (24 results) (of which Int'l Joint Research: 2 results,  Invited: 5 results) Book (1 results) Remarks (5 results)

  • [Journal Article] Error evaluation of an F0-adaptive spectral envelope estimator in robustness against the additive noise and F0 error2015

    • Author(s)
      Masanori Morise
    • Journal Title

      IEICE transactions on information and systems

      Volume: E98-D Pages: 1405-1408

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Speaker identification framework by peripheral and central auditory models2015

    • Author(s)
      Masanori Morise, Kenzi Ozawa
    • Journal Title

      Acoustical Science and Technology

      Volume: 36 Issue: 4 Pages: 340-343

    • DOI

      10.1250/ast.36.340

    • NAID

      130005086489

    • ISSN
      0369-4232, 1346-3969, 1347-5177
    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] CheapTrick, a spectral envelope estimator for high-quality speech synthesis2015

    • Author(s)
      Masanori Morise
    • Journal Title

      Speech Communication

      Volume: 67 Pages: 1-7

    • DOI

      10.1016/j.specom.2014.09.003

    • Related Report
      2014 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] 音声の実時間表示とモーフィングで探る声の多様性2014

    • Author(s)
      河原英紀
    • Journal Title

      音声研究

      Volume: 18 Pages: 578-588

    • NAID

      110009912844

    • Related Report
      2014 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] GetWild:音声生成過程を考慮したグロウル系歌唱の印象付与システム2016

    • Author(s)
      溝渕翔平, 入野俊夫, 西村竜一, 松井淑恵, 河原英紀
    • Organizer
      日本音響学会2016年春季研究発表会
    • Place of Presentation
      桐蔭横浜大学
    • Year and Date
      2016-03-09
    • Related Report
      2015 Annual Research Report
  • [Presentation] 好感度の男女差に着目した女性発話のスペクトル分析2016

    • Author(s)
      横森文哉,二宮大和,森勢将雅,田中章浩,小澤賢司
    • Organizer
      日本音響学会2016年春季研究発表会
    • Place of Presentation
      桐蔭横浜大学
    • Year and Date
      2016-03-09
    • Related Report
      2015 Annual Research Report
  • [Presentation] 基本波検出に基づくF0推定法の耐雑音性向上2016

    • Author(s)
      森勢将雅
    • Organizer
      情報処理学会音声言語情報処理研究会
    • Place of Presentation
      富山県上市町
    • Year and Date
      2016-02-05
    • Related Report
      2015 Annual Research Report
  • [Presentation] Aliasing-free implementation of discrete-time glottal source models and their applications to speech synthesis and F0 extractor evaluation2015

    • Author(s)
      H. Kawahara, K. Sakakibara, H. Banno, M. Morise, T. Toda and T. Irino
    • Organizer
      APSIPA ASC 2015
    • Place of Presentation
      Taipei, Taiwan
    • Year and Date
      2015-12-16
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 目指せ音声分析合成マスター!~「よくわからない」から「ちょっとわかる」へのチュートリアル~2015

    • Author(s)
      森勢将雅
    • Organizer
      日本音響学会聴覚研究会
    • Place of Presentation
      甲州市勝沼 ぶどうの丘
    • Year and Date
      2015-11-13
    • Related Report
      2015 Annual Research Report
    • Invited
  • [Presentation] 女性発話を対象とした好感度評価の男女差の検討2015

    • Author(s)
      横森文哉,二宮大和,森勢将雅,田中章浩,小澤賢司
    • Organizer
      日本音響学会聴覚研究会
    • Place of Presentation
      甲州市勝沼 ぶどうの丘
    • Year and Date
      2015-11-13
    • Related Report
      2015 Annual Research Report
  • [Presentation] 好感度に着目した発話音声の音響的特徴分析の検討2015

    • Author(s)
      横森文哉,森勢将雅,小澤賢司
    • Organizer
      日本音響学会2015年秋季研究発表会
    • Place of Presentation
      会津大学
    • Year and Date
      2015-09-16
    • Related Report
      2015 Annual Research Report
  • [Presentation] 音声科学教育用対話的ツールのためのエリアシングの無いL-Fモデルの実装について2015

    • Author(s)
      河原英紀、 榊原健一 、坂野秀樹
    • Organizer
      日本音響学会聴覚研究会
    • Place of Presentation
      東北大学
    • Year and Date
      2015-08-03
    • Related Report
      2015 Annual Research Report
  • [Presentation] 帯域毎の非周期性指標推定法とその誤差評価2015

    • Author(s)
      森勢将雅
    • Organizer
      電子情報通信学会技術研究報告
    • Place of Presentation
      新潟大学
    • Year and Date
      2015-06-18
    • Related Report
      2015 Annual Research Report
  • [Presentation] The effect of peripheral compression on syllable perception measured with a hearing impairment simulator2015

    • Author(s)
      Toshie Matsui, Toshio Irino, Misaki Nagae, Hideki Kawahara, and Roy D. Patterson
    • Organizer
      17th International Symposium on Hearing
    • Place of Presentation
      Groningen, Netherlands
    • Year and Date
      2015-06-15
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] スペクトル包絡情報を入力としたDeep Neural Networkに基づく歌声のための声質評価2015

    • Author(s)
      横森文哉,大柴まりや,森勢将雅,小澤賢司
    • Organizer
      情報処理学会音楽情報科学研究会
    • Place of Presentation
      東京
    • Year and Date
      2015-05-23
    • Related Report
      2015 Annual Research Report
  • [Presentation] 音声の好感度に対する声道形状および音源情報操作の効果について2015

    • Author(s)
      吉元 照貴,西村 竜一,入野 俊夫,河原 英紀
    • Organizer
      日本音響学会:春季研究発表会講演論文集
    • Place of Presentation
      中央大学、東京
    • Year and Date
      2015-03-16 – 2015-03-18
    • Related Report
      2014 Research-status Report
  • [Presentation] 声道形状と声帯音源特性を利用したグロウル系歌唱音声への変換について2015

    • Author(s)
      溝渕 翔平,西村 竜一,入野 俊夫,河原 英紀
    • Organizer
      日本音響学会:春季研究発表会講演論文集
    • Place of Presentation
      中央大学、東京
    • Year and Date
      2015-03-16 – 2015-03-18
    • Related Report
      2014 Research-status Report
  • [Presentation] 音声の好感度改善補助ツールの開発を目指した好感度改善方法の検討2015

    • Author(s)
      吉元 照貴 , 西村 竜一 , 入野 俊夫 , 河原 英紀
    • Organizer
      情報処理学会研究報告. [音楽情報科学]
    • Place of Presentation
      甲府
    • Year and Date
      2015-03-02 – 2015-03-03
    • Related Report
      2014 Research-status Report
  • [Presentation] 声道形状と声帯音源特性を用いたグロウル系歌唱音声への実時間変換の提案2015

    • Author(s)
      溝渕 翔平 , 西村 竜一 , 入野 俊夫 , 河原 英紀
    • Organizer
      情報処理学会研究報告. [音楽情報科学]
    • Place of Presentation
      甲府
    • Year and Date
      2015-03-02 – 2015-03-03
    • Related Report
      2014 Research-status Report
  • [Presentation] Speech Analysis Modification and Synthesis tool STRAIGHT and extended voice morphing2015

    • Author(s)
      Hideki Kawahara
    • Organizer
      ARO midwinter meeting
    • Place of Presentation
      Baltimore USA
    • Year and Date
      2015-02-21 – 2015-02-25
    • Related Report
      2014 Research-status Report
    • Invited
  • [Presentation] Excitation source design for high-quality speech manipulation systems based on a temporally static group delay representation of periodic signals2014

    • Author(s)
      Hideki Kawahara, Masanori Morise, Ken-Ichi Sakakibara, Tomoki Toda, Hideki Banno Ryuichi Nisimura, Toshio Irino
    • Organizer
      APSIPA ASC 2014
    • Place of Presentation
      Siem Reap, Cambodia
    • Year and Date
      2014-12-09 – 2014-12-12
    • Related Report
      2014 Research-status Report
  • [Presentation] STRAIGHT speech analysis2014

    • Author(s)
      Hideki Kawahara
    • Organizer
      Tutorial of APSIPA ASC 2014
    • Place of Presentation
      Siem Reap, Cambodia
    • Year and Date
      2014-12-09 – 2014-12-12
    • Related Report
      2014 Research-status Report
    • Invited
  • [Presentation] 周期信号の静的表現に基づく音声処理2014

    • Author(s)
      河原 英紀
    • Organizer
      電子情報通信学会技術研究報告(音声)
    • Place of Presentation
      白浜
    • Year and Date
      2014-10-23 – 2014-10-24
    • Related Report
      2014 Research-status Report
    • Invited
  • [Presentation] Vocal tract length estimation based on vowels using a database consisting of 385 speakers and a database with MRI-based vocal tract shape information2014

    • Author(s)
      Hideki Kawahara, Tatsuya Kitamura, Hironori Takemoto, Ryuichi Nisimura, Toshio Irino
    • Organizer
      Interspeech 2014
    • Place of Presentation
      Singapore
    • Year and Date
      2014-09-14 – 2014-09-18
    • Related Report
      2014 Research-status Report
  • [Presentation] 線形予測分析を用いた声道断面積関数推定のための前処理について2014

    • Author(s)
      伊佐 衣代,西村 竜一,入野 俊夫,河原 英紀
    • Organizer
      日本音響学会:秋季研究発表会講演論文集
    • Place of Presentation
      札幌
    • Year and Date
      2014-09-03 – 2014-09-05
    • Related Report
      2014 Research-status Report
  • [Presentation] 声道形状と音源情報に注目した音声の好感度改善システムの検討について2014

    • Author(s)
      吉元 照貴,伊佐 衣代,溝渕 翔平,西村 竜一,入野 俊夫,河原 英紀
    • Organizer
      日本音響学会:秋季研究発表会講演論文集
    • Place of Presentation
      札幌
    • Year and Date
      2014-09-03 – 2014-09-05
    • Related Report
      2014 Research-status Report
  • [Presentation] Matlabのリアルタイム処理を利用した音声聴覚教育用ツールについて2014

    • Author(s)
      河原英紀
    • Organizer
      日本音響学会:秋季研究発表会講演論文集
    • Place of Presentation
      札幌
    • Year and Date
      2014-09-03 – 2014-09-05
    • Related Report
      2014 Research-status Report
  • [Presentation] 音声・聴覚の理解と信号処理2014

    • Author(s)
      河原 英紀
    • Organizer
      音学シンポジウム
    • Place of Presentation
      日本大学、東京
    • Year and Date
      2014-05-24 – 2014-05-25
    • Related Report
      2014 Research-status Report
    • Invited
  • [Book] Speech Prosody in Speech Synthesis: Modeling and generation of prosody for high quality and flexible speech synthesis2015

    • Author(s)
      Hideki Kawahara
    • Total Pages
      213
    • Publisher
      Springer Berlin Heidelberg
    • Related Report
      2014 Research-status Report
  • [Remarks] SparkNG: Matlab realtime speech tools and ...

    • URL

      http://www.wakayama-u.ac.jp/~kawahara/MatlabRealtimeSpeechTools/

    • Related Report
      2015 Annual Research Report
  • [Remarks] A high-quality speech analysis ...

    • URL

      https://github.com/mmorise/World

    • Related Report
      2015 Annual Research Report
  • [Remarks] WORLD

    • URL

      http://ml.cs.yamanashi.ac.jp/world/

    • Related Report
      2015 Annual Research Report
  • [Remarks] Matlab realtime speech tools

    • URL

      http://www.wakayama-u.ac.jp/~kawahara/MatlabRealtimeSpeechTools/

    • Related Report
      2014 Research-status Report
  • [Remarks] 音声分析変換合成法STRAIGHT

    • URL

      http://www.wakayama-u.ac.jp/~kawahara/STRAIGHTadv/index_j.html

    • Related Report
      2014 Research-status Report

URL: 

Published: 2014-04-04   Modified: 2017-05-10  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi