• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2015 Fiscal Year Annual Research Report

発話過程の神経生理学的制御モデルの構築に関する研究

Research Project

Project/Area Number 25330190
Research InstitutionJapan Advanced Institute of Science and Technology

Principal Investigator

党 建武  北陸先端科学技術大学院大学, 情報科学研究科, 教授 (80334796)

Co-Investigator(Kenkyū-buntansha) 田中 宏和  北陸先端科学技術大学院大学, 情報科学研究科, 准教授 (00332320)
末光 厚夫  北陸先端科学技術大学院大学, 情報科学研究科, 助教 (20422199)
川本 真一  群馬工業高等専門学校, 電子情報工学科, 講師 (70418507)
Project Period (FY) 2013-04-01 – 2016-03-31
Keywords音声認知の過程 / フィードバックメカニズム / 発話運動計画 / 音声生成 / 神経学計算モデル
Outline of Annual Research Achievements

本研究は、計算機上で発話の過程を模擬する生理学的発話機構モデルを基に、脳イメージングや筋電図および磁気センサーシステムなどによる神経生理学的知見を加えて、音声生成過程における発話計画、運動指令、筋肉の収縮、発話器官の動作、音波伝播、音波の生成とその聴覚フィードバックなどのモジュールを含む発話運動制御モデルを構築し、発話運動制御メカニズムを明らかにすることを目的とする。
平成27年度では、我々は脳電図(EEG)信号に基にしたソース再構築方法を用いて音声を知覚する時脳内における音声信号処理の流れを調査することにより、ミラーニューロンによる音声生成と音声知覚との相互作用を考察した。さらに動詞と名詞を知覚する際、同様なソース再構築手法により、知覚処理と語意認知過程を調べた。その結果、知覚処理と語意認知過程は大体初期処理、中期処理と高等処理の三つのフェイズを分けることができる。フェイズ毎に脳の活動がよく似ていることが分かった。それは、音声の語意の認知は初期処理における50msの時点から始まっていることを示唆した。
音声発声時に音響フィードバック以外の通路が存在するかについて、皮膚や神経の伝達通路を調べたところ、発声の基本周波数の制御に対して、声帯振動の触覚求心性情報によるフィードバックは音響のそれより遅延が短いことが分かった。
また発話計画に用いる単位について研究を行った。中国語とフランス語の母音ー子音ー母音(V1CV2)を用いて発話運動の調音結合の影響範囲を調べた。その結果、CV2の境界内部では、二つの言語とも強い調音結合は見られた。それに対して、CV2の境界を超えた場合、先読みの調音結合はフランス語の発話運動にはよくみられるが、中国語の発話運動にはあまり見られていない。これらの現象は、中国語の発話制御には、音節が発話計画の基本単位として使われることを示唆した。

  • Research Products

    (34 results)

All 2016 2015 Other

All Int'l Joint Research (4 results) Journal Article (8 results) (of which Int'l Joint Research: 7 results,  Peer Reviewed: 8 results,  Open Access: 8 results,  Acknowledgement Compliant: 4 results) Presentation (20 results) (of which Int'l Joint Research: 19 results,  Invited: 2 results) Book (1 results) Remarks (1 results)

  • [Int'l Joint Research] Haskins Laboratories/University of California San Diego(米国)

    • Country Name
      U.S.A.
    • Counterpart Institution
      Haskins Laboratories/University of California San Diego
  • [Int'l Joint Research] CNRS, GIPSA-Lab,/Univ.Grenoble Alpes(フランス)

    • Country Name
      FRANCE
    • Counterpart Institution
      CNRS, GIPSA-Lab,/Univ.Grenoble Alpes
  • [Int'l Joint Research] Aachen University(ドイツ)

    • Country Name
      GERMANY
    • Counterpart Institution
      Aachen University
  • [Int'l Joint Research] Tianjin University/FudanUniversity(中国)

    • Country Name
      CHINA
    • Counterpart Institution
      Tianjin University/FudanUniversity
  • [Journal Article] A study on transvelar coupling for non-nasalized sounds2016

    • Author(s)
      Jianwu Dang, Jianguo Wei, and Kiyoshi Honda, and Takayoshi Nakai
    • Journal Title

      J. Acoust. Soc. Am.

      Volume: 139 Pages: 441- 454

    • DOI

      http://dx.doi.org/10.1121/1.4939964

    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Coordinate Systems in the Motor System: Computational Modeling and EEG Experiment2016

    • Author(s)
      Tanaka, H., Miyakoshi, M., & Makeig, S.
    • Journal Title

      Advances in Cognitive Neurodynamics (V)

      Volume: V Pages: 85-92

    • DOI

      10.1007/978-981-10-0207-6_14

    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Modeling the motor cortex: Optimality, recurrent neural networks, and spatial dynamics2016

    • Author(s)
      Tanaka, H.
    • Journal Title

      Neuroscience Research

      Volume: 104 Pages: 64-71

    • DOI

      10.1016/j.neures.2015.10.012

    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Strength of syllabic influences on articulation in Mandarin Chinese and French: Insights from a motor control approach2015

    • Author(s)
      Liang Ma, Pascal Perrier, and Jianwu Dang
    • Journal Title

      Journal of Phonetics

      Volume: 53 Pages: 101-124

    • DOI

      10.1016/j.wocn.2015.09.005

    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] A control strategy of a physiological articulatory model for speech production2015

    • Author(s)
      X. Wu, J. Dang
    • Journal Title

      Journal of Chinese Linguistics

      Volume: 43 Pages: 337-363

    • DOI

      10.1353/jcl.2015.0038

    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Generalized Finite Difference Time Domain Method and Its Application to Acoustics2015

    • Author(s)
      Jianguo Wei, Song Wang, Qingzhi Hou, and Jianwu Dang
    • Journal Title

      Mathematical Problems in Engineering

      Volume: 2015 Pages: 1-13

    • DOI

      http://dx.doi.org/10.1155/2015/640305

    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] A real-time articulatory visual feedback approach with target presentation for second language pronunciation learning2015

    • Author(s)
      Suemitsu, A., Dang, J., Ito, T., Tiede, M.,
    • Journal Title

      J. Acoust. Soc. Am.

      Volume: 138, EL382 Pages: 1-6

    • DOI

      http://dx.doi.org/10.1121/1.4931827

    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Edge prominence and declination in Japanese jaw displacement patterns: a view from the C/D model2015

    • Author(s)
      Kawahara, S., Erickson, D., Suemitsu, A.
    • Journal Title

      Journal of Phonetic Society of Japan

      Volume: 19 Pages: 33-43

    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] INVESTIGATIONS INTO VOWEL AND CONSONANT STRUCTURES IN ARTICULATORY AND AUDITORY SPACES USING LAPLACIAN EIGENMAPS2016

    • Author(s)
      Jianwu Dang, Shengbei Wang, Masashi Unoki
    • Organizer
      The 41st IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2016)
    • Place of Presentation
      Shanghai, China
    • Year and Date
      2016-03-20 – 2016-03-25
    • Int'l Joint Research
  • [Presentation] Influences of Auditory and Vibrotactile Information on Vocal F0 Responses2015

    • Author(s)
      Xiaozhen Wang, Kiyoshi Honda, Jianwu Dang, Hongcui Wang and Jianguo Wei
    • Organizer
      APSIPA Annual Summit and Conference 2015
    • Place of Presentation
      Hong Kong, China
    • Year and Date
      2015-12-16 – 2015-12-19
    • Int'l Joint Research
  • [Presentation] Investigation of Learning Trajectory of Mandarin for Tibetan Speakers2015

    • Author(s)
      Huixia Wang, Jianwu Dang, Hui Feng, Hongcui Wang, Yang Yu, Kiyoshi Honda
    • Organizer
      APSIPA Annual Summit and Conference 2015
    • Place of Presentation
      Hong Kong, China
    • Year and Date
      2015-12-16 – 2015-12-19
    • Int'l Joint Research
  • [Presentation] Automatic Tongue Contour Tracking in Ultrasound Sequences without Manual Initialization2015

    • Author(s)
      Hongcui Wang, Siyu Wang, Bruce Denby, Jianwu Dang
    • Organizer
      APSIPA Annual Summit and Conference 2015
    • Place of Presentation
      Hong Kong, China
    • Year and Date
      2015-12-16 – 2015-12-19
    • Int'l Joint Research
  • [Presentation] Vowel Normalization by Articulatory Information2015

    • Author(s)
      Jingshu Zhang, Jianguo Wei, Wenhuan Lu, Qiang Fang, Kiyoshi Honda and Jianwu Dang
    • Organizer
      APSIPA Annual Summit and Conference 2015
    • Place of Presentation
      Hong Kong, China
    • Year and Date
      2015-12-16 – 2015-12-19
    • Int'l Joint Research
  • [Presentation] Investigation of relation between speech perception and production based on EEG source reconstruction2015

    • Author(s)
      Guancheng Li, Jianwu Dang, Gaoyan Zhang, Zhilei Liu, Hongcui Wang,
    • Organizer
      APSIPA Annual Summit and Conference 2015
    • Place of Presentation
      Hong Kong, China
    • Year and Date
      2015-12-16 – 2015-12-19
    • Int'l Joint Research
  • [Presentation] Is movement duration predetermined in visually guided reaching? A comparison of finite- and infinite-horizon optimal feedback control2015

    • Author(s)
      Li L., Imamizu H. and Tanaka H.
    • Organizer
      International Conference on Advanced Mechatronics (ICAM2015)
    • Place of Presentation
      Waseda Univ., Tokyo, Japan
    • Year and Date
      2015-12-06 – 2015-12-06
    • Int'l Joint Research
  • [Presentation] Formation of internal forward model with sensory and reward prediction errors: A behavioral confirmation2015

    • Author(s)
      Satou H., Sasaki A., Nozaki D. and Tanaka H.
    • Organizer
      International Conference on Advanced Mechatronics (ICAM2015)
    • Place of Presentation
      Waseda Univ., Tokyo, Japan
    • Year and Date
      2015-12-06 – 2015-12-06
    • Int'l Joint Research
  • [Presentation] Articulation of phrasal stress in Mandarin Chinese2015

    • Author(s)
      岩田 礼,エリクソン ドナ,澁谷 良穂,末光 厚夫
    • Organizer
      日本音響学会2015年秋季研究発表会
    • Place of Presentation
      日本会津大学 (福島県会津若松市)
    • Year and Date
      2015-09-16 – 2015-09-19
  • [Presentation] Combined Cine- and Tagged-MRI for Tracking Landmarks on the Tongue Surface2015

    • Author(s)
      H. Bao, W. Lu, K. Honda, J. Wei, Q. Fang, J. Dang,
    • Organizer
      INTERSPEECH2015
    • Place of Presentation
      Dresden, Germany
    • Year and Date
      2015-09-06 – 2015-09-10
    • Int'l Joint Research
  • [Presentation] Measuring Oral and Nasal Airflow in Production of Chinese Plosive2015

    • Author(s)
      Y. Chi, K. Honda, J. Wei, H. Feng, J. Dang
    • Organizer
      INTERSPEECH2015
    • Place of Presentation
      Dresden, Germany
    • Year and Date
      2015-09-06 – 2015-09-10
    • Int'l Joint Research
  • [Presentation] How motor cortex represents body movements: Optimality, recurrent neural networks and spatial dynamics2015

    • Author(s)
      Tanaka, H., Miyakoshi, M. and Makeig, S.
    • Organizer
      IEEE The 24th International Symposium on Robot and Human Interactive Communication (RO-MAN)
    • Place of Presentation
      Kobe International Conferece Center, Kobe, Japan
    • Year and Date
      2015-08-31 – 2015-08-31
    • Int'l Joint Research
  • [Presentation] The perception of English vowel contrasts by Chinese EFL learners and native English speakers2015

    • Author(s)
      A. Zhang, H. Feng, X. Zheng, Z. Xu, J. Dang
    • Organizer
      The 18th International Congress of Phonetic Science (ICPhS 2015)
    • Place of Presentation
      Glasgow, UK
    • Year and Date
      2015-08-10 – 2015-08-14
    • Int'l Joint Research
  • [Presentation] A lip protrusion mechanism examined by magnetic resonance imaging and finite element modeling2015

    • Author(s)
      T. Li, K. Honda, J. Wei, J. Dang
    • Organizer
      The 18th International Congress of Phonetic Science (ICPhS 2015)
    • Place of Presentation
      Glasgow, UK
    • Year and Date
      2015-08-10 – 2015-08-14
    • Int'l Joint Research
  • [Presentation] Bridging articulation and perception: The C/D model and contrastive emphasis2015

    • Author(s)
      Erickson, D., Kim, J., Kawahara, S., Wilson, I., Menezes, C., Suemitsu, A., Moore, J.
    • Organizer
      The 18th International Congress of Phonetic Sciences (ICPhS 2015)
    • Place of Presentation
      Glasgow, UK
    • Year and Date
      2015-08-08 – 2015-08-12
    • Int'l Joint Research
  • [Presentation] Relation between laryngeal movements and fundamental frequency2015

    • Author(s)
      J. Dang
    • Organizer
      International Conference on Prosodic Studies: Challenges and Prospects
    • Place of Presentation
      Tianjin, China
    • Year and Date
      2015-06-12 – 2015-06-14
    • Int'l Joint Research / Invited
  • [Presentation] Movement Representation in the Motor System: Computational Modeling and EEG experiment2015

    • Author(s)
      Tanaka, H., Miyakoshi, M. and Makeig, S.
    • Organizer
      Brain Connectivity Workshop
    • Place of Presentation
      San Diego, U.S.A.
    • Year and Date
      2015-06-12 – 2015-06-12
    • Int'l Joint Research
  • [Presentation] Coordinate Systems in the Motor System: Computational Modeling and EEG experiment2015

    • Author(s)
      Tanaka, H., Miyakoshi, M. and Makeig, S.
    • Organizer
      The 5th International Conference on Cognitive Neurodynamics
    • Place of Presentation
      Sanya, China
    • Year and Date
      2015-06-04 – 2015-06-04
    • Int'l Joint Research
  • [Presentation] Estimation of Vocal Tract Shape from Speech Sounds via a Physiological Articulatory Model2015

    • Author(s)
      J. Dang
    • Organizer
      China-Germany Joint Symposium on Speech Technology
    • Place of Presentation
      Shanghai, China
    • Year and Date
      2015-05-18 – 2015-05-19
    • Int'l Joint Research / Invited
  • [Presentation] VOCAL RESPONSES TO FREQUENCY MODULATED COMPOSITE SINEWAVES VIA AUDITORY AND VIBROTACTILE PATHWAYS2015

    • Author(s)
      X. Wang, K. Honda, J. Dang, J. Wei.
    • Organizer
      The 41st IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2015)
    • Place of Presentation
      Brisbane, Australia
    • Year and Date
      2015-04-19 – 2015-04-24
    • Int'l Joint Research
  • [Book] 音声合成技術の現状と展望(総説), 進化するヒトと機械の音声コミュニケーション2015

    • Author(s)
      党 建武
    • Total Pages
      125-140
    • Publisher
      株式会社ニッケイ印刷
  • [Remarks] publication list - JAIST 北陸先端科学技術大学院大学

    • URL

      http://www.jaist.ac.jp/is/labs/dang-lab/paper/?lang=ja&type=category

URL: 

Published: 2017-01-06   Modified: 2022-02-03  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi