• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Study on the measurement and modeling from higher-order functions to peripheral functions involved in speech production

Research Project

Project/Area Number 22500150
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionJapan Advanced Institute of Science and Technology

Principal Investigator

TOH Takeshi  北陸先端科学技術大学院大学, 情報科学研究科, 教授 (80334796)

Co-Investigator(Kenkyū-buntansha) TOKUDA Isao  立命館大学, 理工学部・機械工学科, 教授 (00261389)
SUEMITSU Atsuo  北陸先端科学技術大学院大学, 情報科学研究科, 助教 (20422199)
Project Period (FY) 2010 – 2012
Project Status Completed (Fiscal Year 2012)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2012: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2011: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2010: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
Keywords音声生成 / 生理学的モデル / 学習過程 / 調音計測 / 復唱による学習 / 言語習得 / 聴覚誘導の音声生成関数 / 変形聴覚フィードバック / Quantal Theory / 脳活動計測 / fMRI
Research Abstract

In this study, we constructed a neuro-computational model by refining the previous physiological articulatory model as a peripheral organ model, where a mapping was established between high-level motor representation to low-level motor representation. The neuro-computational model was confirmed by simulating the speech learning in babbling stage. The results of the vowel learning experiment imply that when perceiving an unfamiliar speech sound, subjects seem to build up a virtual target by projecting the sound to their own acoustic space of the native language, and then approach the target during the learning process.

Report

(4 results)
  • 2012 Annual Research Report   Final Research Report ( PDF )
  • 2011 Annual Research Report
  • 2010 Annual Research Report
  • Research Products

    (60 results)

All 2013 2012 2011 2010 Other

All Journal Article (11 results) (of which Peer Reviewed: 11 results) Presentation (48 results) Remarks (1 results)

  • [Journal Article] Correlation between three-dimensional visual depth and N2 component: Evidence from event-related potential study2013

    • Author(s)
      B. Liu, X. Meng, G. Wu, J. Dang
    • Journal Title

      Neuroscience

      Volume: Vol. 237 Pages: 161-169

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] Correlation between three-dimensional visual depth and N2 component: Evidence from event-related potential study2013

    • Author(s)
      Baolin Liu, Xianyao Meng, Guangning Wu, Jianwu Dang
    • Journal Title

      Neuroscience

      Volume: 237 Pages: 161-169

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Metrical structure and production of English rhythm2012

    • Author(s)
      Erickson D, Suemitsu A, Shibuya Y,Tiede M
    • Journal Title

      Phonetica

      Volume: Vol. 69 Pages: 180-190

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] Metrical structure and production of English rhythm2012

    • Author(s)
      Erickson D, Suemitsu A, Shibuya Y, Tiede M.
    • Journal Title

      Phonetica

      Volume: 69 Pages: 180-190

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Voice Activity Detection Based On An Unsupervised Learning Framework2011

    • Author(s)
      D. Ying, Y. Yan, J. Dang, and F. Soong
    • Journal Title

      IEEE trans

      Volume: Vol. 19, No.8 Pages: 2624-2633

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] Investigation of Auditory-Guide Speech Production while Learning Unfamiliar Speech Sounds2011

    • Author(s)
      K. Fujii, Q. Fang and J. Dang
    • Journal Title

      Journal of Signal Processing

      Volume: Vol. 15,No. 4 Pages: 287-290

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] Study of Control Strategy Mimicking Speech Motor Learning for a Physiological Articulatory Model2011

    • Author(s)
      X. Wu, J. Wei and J. Dang
    • Journal Title

      Journal of Signal Processing

      Volume: Vol. 15, No. 4 Pages: 295-298

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] A model-based investigation on one-to-many relationship between speech sound and articulations2011

    • Author(s)
      A. Nishikido and J. Dang
    • Journal Title

      J.Acoust. Soc. Jpn

      Volume: Vol.67,No.1 Pages: 1-12

    • NAID

      110008006753

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] Voice Activity Detection Based On An Unsupervised Learning Framework2011

    • Author(s)
      D.Ying, Y.Yan, J.Dang, F.Soong
    • Journal Title

      IEEE Trans.Audio, Speech and Language Processing

      Volume: 19 Issue: 8 Pages: 2624-2633

    • DOI

      10.1109/tasl.2011.2125953

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Investigation of Auditory-Guided Speech Production while Learning Unfamiliar Speech Sounds2011

    • Author(s)
      Kazuya Fujii, Qiang Fang, Jianwu Dang
    • Journal Title

      Journal of Signal Processing

      Volume: 15 Pages: 287-290

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Study of Control Strategy Mimicking Speech Motor Learning for a Physiological Articulatory Model2011

    • Author(s)
      Xiyu Wu, Jianguo Wei, Jianwu Dang
    • Journal Title

      Journal of Signal Processing

      Volume: 15 Pages: 295-298

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Presentation] 発話機構モデルを用いた茎突舌筋の形態・機能学的検討2013

    • Author(s)
      西村,川本,党
    • Organizer
      日本音響学会春季研究発表会
    • Place of Presentation
      東京工科大学、東京
    • Year and Date
      2013-03-13
    • Related Report
      2012 Final Research Report
  • [Presentation] 発話機構モデルを用いた茎突舌筋の形態・機能学的検討2013

    • Author(s)
      西村奈々,川本真一,党 建武
    • Organizer
      日本音響学会全国大会
    • Place of Presentation
      東京工科大学八王子キャンパス
    • Related Report
      2012 Annual Research Report
  • [Presentation] A research of dependencies between frequency components and speaker characteristics based on phoneme mean F-ratio contribution2012

    • Author(s)
      S. Hyon, H. Wang, J. Dang
    • Organizer
      ISCSLP 2012
    • Place of Presentation
      Hong Kong, China
    • Year and Date
      2012-12-07
    • Related Report
      2012 Final Research Report
  • [Presentation] TONGUE SHAPE SYNTHESIS BASED ON ACTIVE SHAPE MODEL2012

    • Author(s)
      C. Song, J. Wei, Q. Fang, Y. Wang, J. Dang
    • Organizer
      ISCSLP 2012
    • Place of Presentation
      Hong Kong
    • Year and Date
      2012-12-06
    • Related Report
      2012 Final Research Report
  • [Presentation] Detailed morphological analysis of Mandarin sustained vowels2012

    • Author(s)
      Y. Wang, H. Wang, J. Gao, J. Wei, J. Dang
    • Organizer
      ISCSLP
    • Place of Presentation
      Hong Kong, China
    • Year and Date
      2012-12-06
    • Related Report
      2012 Final Research Report
  • [Presentation] Efficient feature extraction of speaker identification using phoneme mean F-ratio for Chinese2012

    • Author(s)
      C. Zhao, H. Wang, S. Hyon, J. Wei, J. Dang
    • Organizer
      ISCSLP 2012
    • Place of Presentation
      Hong Kong, China
    • Year and Date
      2012-12-05
    • Related Report
      2012 Final Research Report
  • [Presentation] An Anisotropic Diffusion Filter for Reducing Speckle Noise of Ultrasound Images Based on Separability2012

    • Author(s)
      C. Liu, J. Wei, B. Feng, J. Dang
    • Organizer
      APSIPA
    • Place of Presentation
      Hoolywood. USA
    • Year and Date
      2012-12-03
    • Related Report
      2012 Final Research Report
  • [Presentation] Mandarin vowel synthesis based on 2D and 3D vocal tract model by finite-difference time-domain method2012

    • Author(s)
      Y. Wang, H. Wang, J. Wei, J. Dang
    • Organizer
      APSIPA
    • Place of Presentation
      Hoolywood. USA
    • Year and Date
      2012-12-03
    • Related Report
      2012 Final Research Report
  • [Presentation] 母語による第二言語音韻知覚への影響に関する考察2012

    • Author(s)
      藤井,末光,党
    • Organizer
      日本音響学会秋季研究発表会
    • Place of Presentation
      信州大学, 長野
    • Year and Date
      2012-09-19
    • Related Report
      2012 Final Research Report
  • [Presentation] 解剖学的知見に基づく生理学的発話機構モデルの筋配置の個人化に関する検証2012

    • Author(s)
      西村, 川本, 党
    • Organizer
      日本音響学会秋季研究発表会
    • Place of Presentation
      信州大学, 長野
    • Year and Date
      2012-09-19
    • Related Report
      2012 Final Research Report
  • [Presentation] A method of speaker identification based on phoneme mean F-ratio contribution2012

    • Author(s)
      S. Hyon, H. Wang, C. Zhao, J. Wei, J. Dang
    • Organizer
      Interspeech
    • Place of Presentation
      Portland, USA
    • Year and Date
      2012-09-13
    • Related Report
      2012 Final Research Report
  • [Presentation] MR 画像に基づいた変形による生理学的発話機構モデルの個人化2012

    • Author(s)
      西村, 川本, 党
    • Organizer
      日本音響学会聴覚研究会資料
    • Place of Presentation
      NTT 厚木研究開発センタ
    • Year and Date
      2012-06-14
    • Related Report
      2012 Final Research Report
  • [Presentation] Successive Addition Boundary Tone in Chinese Disgust Intonation2012

    • Author(s)
      A. Li, Q. Fang, Y. Jia and J. Dang
    • Organizer
      NACCL24
    • Place of Presentation
      San Francisco, USA
    • Year and Date
      2012-06-09
    • Related Report
      2012 Final Research Report
  • [Presentation] Emotional Expressiveness of Successive Addition Boundary Tone in Mandarin Chinese2012

    • Author(s)
      A. Li, Q. Fang, J. Dang
    • Organizer
      Speech Prosody 2012
    • Place of Presentation
      Shanghai, China
    • Year and Date
      2012-05-22
    • Related Report
      2012 Final Research Report
  • [Presentation] Noise Estimation Using a Constrained Sequential HMM In Log-Spectral Domain2012

    • Author(s)
      D. Ying, X. Lu, J. Li, Y. Yan, J. Dang,F. Soong
    • Organizer
      ICASSP 2012
    • Place of Presentation
      Kyoto, Japan
    • Year and Date
      2012-03-27
    • Related Report
      2012 Final Research Report 2011 Annual Research Report
  • [Presentation] 形態学的情報に基づく個人化発話機構モデルの構築2012

    • Author(s)
      西村, 川本, 党
    • Organizer
      日本音響学会春季研究発表会
    • Place of Presentation
      神奈川大
    • Year and Date
      2012-03-13
    • Related Report
      2012 Final Research Report
  • [Presentation] 形態学的情報に基づく個人化発話機構モデルの構築2012

    • Author(s)
      西村奈々, 川本真一, 党建武
    • Organizer
      日本音響学会2012年春季研究発表会講演論文
    • Place of Presentation
      神奈川大(神奈川)
    • Year and Date
      2012-03-13
    • Related Report
      2011 Annual Research Report
  • [Presentation] Investigation of perceptual effects during learning process via vowel imitation2012

    • Author(s)
      K. Fujii, A. Suemitsu, J. Dang
    • Organizer
      RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing
    • Place of Presentation
      Hawaii, USA
    • Year and Date
      2012-03-05
    • Related Report
      2012 Final Research Report
  • [Presentation] Morphological personalization according to human mechanism using MR images2012

    • Author(s)
      N. Nishimura, S. Kawamoto and J. Dang
    • Organizer
      RISP International workshop on Nonlinear Circuits, Communications and Signal Processing (NCSP12)
    • Place of Presentation
      Hawaii, USA
    • Year and Date
      2012-03-05
    • Related Report
      2012 Final Research Report
  • [Presentation] Morphological personalization according to human mechanismusing MR images2012

    • Author(s)
      Nana Nishimura, Shin-ichi Kawamoto, Jianwu Dang
    • Organizer
      Proc.2012 RISP International workshop on Nonlinear Circuits, Communications and Signal Processing (NCSP12)
    • Place of Presentation
      Hawaii, USA
    • Year and Date
      2012-03-05
    • Related Report
      2011 Annual Research Report
  • [Presentation] Investigation of perceptual effects during learning process viavowel imitation2012

    • Author(s)
      Kazuya Fujii, Atsuo Suemitsu, Jianwu Dang
    • Organizer
      Proc.2012 RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing (NCSP'12)
    • Place of Presentation
      Hawaii, USA
    • Year and Date
      2012-03-05
    • Related Report
      2011 Annual Research Report
  • [Presentation] Acoustic analysis of the vocal tract from a 3D physiological articulatory model by finite-difference time-domain method2012

    • Author(s)
      Y. Wang, H. Wang, J. Wei, and J. Dang
    • Organizer
      The Inter.Conference on Automatic Control and Artificial Intelligence
    • Place of Presentation
      Xiamen, China
    • Related Report
      2012 Final Research Report
  • [Presentation] Successive Addition Boundary Tone in Chinese Disgust Intonation2012

    • Author(s)
      Aijun Li, Qiang Fang, Yuan Jia and Jianwu Dang
    • Organizer
      The 24th North American Conference on Chinese Linguistics
    • Place of Presentation
      San Francisco, USA
    • Related Report
      2012 Annual Research Report
  • [Presentation] Emotional Expressiveness of Successive Addition Boundary Tone in Mandarin Chinese2012

    • Author(s)
      Aijun Li, Qiang Fang, Jianwu Dang.
    • Organizer
      International Conference on Speech Prosody 2012
    • Place of Presentation
      Shanghai, China
    • Related Report
      2012 Annual Research Report
  • [Presentation] A method of speaker identification based on phoneme mean F-ratio contribution2012

    • Author(s)
      Songgun Hyon, Hongcui Wang, Chen Zhao, Jianguo Wei, Jianwu Dang
    • Organizer
      Interspeech 2012
    • Place of Presentation
      Portland, USA
    • Related Report
      2012 Annual Research Report
  • [Presentation] 母語による第二言語音韻知覚への影響に関する考察2012

    • Author(s)
      藤井一哉,末光厚夫,党 建武
    • Organizer
      日本音響学会全国大会
    • Place of Presentation
      信州大学長野(工学)キャンパス
    • Related Report
      2012 Annual Research Report
  • [Presentation] 解剖学的知見に基づく生理学的発話機構モデルの筋配置の個人化に関する検証2012

    • Author(s)
      西村 奈々,川本 真一,党 建武
    • Organizer
      日本音響学会全国大会
    • Place of Presentation
      信州大学長野(工学)キャンパス
    • Related Report
      2012 Annual Research Report
  • [Presentation] MR画像に基づいた変形による生理学的発話機構モデルの個人化2012

    • Author(s)
      西村奈々, 川本真一, 党建武
    • Organizer
      音響学会聴覚研究会
    • Place of Presentation
      日本, 神奈川
    • Related Report
      2012 Annual Research Report
  • [Presentation] Noise Power Estimation Based on a Sequential Hidden Markov Model2011

    • Author(s)
      D. YING, Y. YAN, J. DANG, F. SOONG
    • Organizer
      the 8th International Conference on Information, Comm. And Signal Processing (ICICS 2011)
    • Place of Presentation
      Singapore
    • Year and Date
      2011-12-15
    • Related Report
      2012 Final Research Report
  • [Presentation] Noise Power Estimation Based on a Sequential Hidden Markov Model2011

    • Author(s)
      Dongwen YING, Yonghong YAN, Jianwu DANG, Frank K.SOONG
    • Organizer
      the 8th International Conference on Information, Communications and Signal Processing (ICICS 2011)
    • Place of Presentation
      Singapore
    • Year and Date
      2011-12-15
    • Related Report
      2011 Annual Research Report
  • [Presentation] 復唱による母音学習過程における音声知覚に関する考察2011

    • Author(s)
      藤井,末光,党
    • Organizer
      聴覚研究会資料
    • Place of Presentation
      熊本県立大
    • Year and Date
      2011-12-11
    • Related Report
      2012 Final Research Report
  • [Presentation] 復唱による母音学習過程における音声知覚に関する考察2011

    • Author(s)
      藤井一哉, 末光厚夫, 党建武
    • Organizer
      聴覚研究会資料vol.41,no.9,pp.689-694
    • Place of Presentation
      熊本県立大(熊本)
    • Year and Date
      2011-12-11
    • Related Report
      2011 Annual Research Report
  • [Presentation] Comparative Electromagnetic Articulographic (EMA) study of English rhythm as produced by native and non-native speakers2011

    • Author(s)
      Erickson, D., Suemitsu, A., Shibuya, Y., Lee, S., Tanaka Y.
    • Organizer
      Proc.162nd Meeting of the Acoustical Society of America (ASA), CA.130.4.2.2, pp.2567
    • Place of Presentation
      San Diego, USA
    • Year and Date
      2011-11-04
    • Related Report
      2011 Annual Research Report
  • [Presentation] Voice Activity Detection Based on a Sequential Gaussian Mixture Model2011

    • Author(s)
      D. Ying, J. Li, Q. Fu, Y. Yan and J. Dang
    • Organizer
      the APSIPA Annual Summit and Conference
    • Place of Presentation
      Xi'an, China
    • Year and Date
      2011-10-20
    • Related Report
      2012 Final Research Report
  • [Presentation] Noise Power Estimation Based on a Sequential Gaussian Mixture Model2011

    • Author(s)
      D. Ying, Y. Yan, J. Dang and Soong F
    • Organizer
      the 4th International Conference on Image and Signal Processing
    • Place of Presentation
      Shanghai, China
    • Year and Date
      2011-10-16
    • Related Report
      2012 Final Research Report
  • [Presentation] Emotional intonation in a tone language: experimental evidence from Chinese2011

    • Author(s)
      Li, A., Fang, Q. & Dang, J.
    • Organizer
      ICPhS'2011
    • Place of Presentation
      Hong Kong, China
    • Year and Date
      2011-08-18
    • Related Report
      2012 Final Research Report
  • [Presentation] Emotional intonation in a tone language : experimental evidence from Chinese2011

    • Author(s)
      Li, A., Fang, Q., Dang, J.
    • Organizer
      ICPhS'2011
    • Place of Presentation
      Hong Kong, China
    • Year and Date
      2011-08-18
    • Related Report
      2011 Annual Research Report
  • [Presentation] Rhythm and emphasis in American English : Comparison of native and non-native speakers' productions2011

    • Author(s)
      Erickson, D., Shibuya, Y., Suemitsu, A.
    • Organizer
      Proc.2011 International Seminar on Speech Production (ISSP'11), pp.345-352
    • Place of Presentation
      Montreal, Canada
    • Year and Date
      2011-06-22
    • Related Report
      2011 Annual Research Report
  • [Presentation] Inverse estimation of motor command based on a 3D physiological articulatory model2011

    • Author(s)
      X. WU, Q. FANG and J. DANG
    • Organizer
      Spring Meeting of Acoustic Society of Japan
    • Place of Presentation
      Tokyo, Japan
    • Year and Date
      2011-03-09
    • Related Report
      2012 Final Research Report
  • [Presentation] Inverse estimation of motor command based on a 3D physiological articulatory model2011

    • Author(s)
      X.WU, Q.FANG , J.DANG
    • Organizer
      National conference of Acoust.Soec.Of Japan
    • Place of Presentation
      Tokyo, Japan
    • Year and Date
      2011-03-09
    • Related Report
      2010 Annual Research Report
  • [Presentation] Investigation of Auditory-Guided Speech Production for during Learning a New Speech Sound (優秀論文賞)2011

    • Author(s)
      K.Fuj ii, Q.Fang, J.Dang
    • Organizer
      RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing(NCSP'11)
    • Place of Presentation
      Tianjin, China
    • Related Report
      2010 Annual Research Report
  • [Presentation] Simulation of Speech Babbling Based on a Physiological Articulatory Model(優秀論文賞)2011

    • Author(s)
      X.Wu, Q.Li, J.Wei, J.Dang
    • Organizer
      RISP International Workshop on Nonlinear Circuits, Communi cations and Signal Processing(NCSP'll)
    • Place of Presentation
      Tianjin, China
    • Related Report
      2010 Annual Research Report
  • [Presentation] Influences of transformed auditory feedback with first three formant frequencies2011

    • Author(s)
      Tsungming Shih, Atsuo Suemitsu , Masato Akagi
    • Organizer
      RISP International Workshop on Nonlinear Circuits Communications and Signal Processing(NCSP'11)
    • Place of Presentation
      Tianjin, China
    • Related Report
      2010 Annual Research Report
  • [Presentation] Influences of real-time auditory feedback on formant perturbations2010

    • Author(s)
      Tsungming Shih, Atsuo Suemitsu , Masato Akagi
    • Organizer
      日本音響学会聴覚研究会資料40(8), 671-676
    • Place of Presentation
      Tokyo, Japan
    • Year and Date
      2010-10-16
    • Related Report
      2010 Annual Research Report
  • [Presentation] Investigation of vowel structure and its learning process2010

    • Author(s)
      党建武(Jianwu Dang)
    • Organizer
      The Ninth Phonetic Conference of China(PCC 2010)
    • Place of Presentation
      Tianj in, China(招待講演)
    • Year and Date
      2010-05-26
    • Related Report
      2010 Annual Research Report
  • [Presentation] The relationship between speech production and perception in the process of learning vowels2010

    • Author(s)
      K.Fujii, J.Wei, A.Suemitsu, J.Dang
    • Organizer
      The 7th International Conference on Cognitive Science
    • Place of Presentation
      Beijing, China
    • Related Report
      2010 Annual Research Report
  • [Presentation] Discrimination between Natural and Unnatural Articulations based on Articulatory Structure2010

    • Author(s)
      A.NISHIKIDO, S.KAWAMOTO , J.DANG
    • Organizer
      International Symposium on Chinese Spoken Language Processing (ISCSLP 2010)
    • Place of Presentation
      Tainan, Taiwan
    • Related Report
      2010 Annual Research Report
  • [Presentation] Investigation of Muscle Activation in Speech Production Basedon an Articulatory Model2010

    • Author(s)
      X.WU, Q.FANG , J.DANG
    • Organizer
      International Symposium on Chinese Spoken Language Processing (ISCSLP 2010)
    • Place of Presentation
      Tainan, Taiwan
    • Related Report
      2010 Annual Research Report
  • [Remarks] http://www.jaist.ac.jp/~jdang

    • Related Report
      2012 Annual Research Report

URL: 

Published: 2010-08-23   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi