• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

An attempt to establish acoustic phonology: Temporal changes of spectra and syllable formation in English speech

Research Project

Project/Area Number 17H06197
Research Category

Grant-in-Aid for Challenging Research (Pioneering)

Allocation TypeSingle-year Grants
Research Field Psychology and related fields
Research InstitutionKyushu University

Principal Investigator

Nakajima Yoshitaka  九州大学, 芸術工学研究院, 教授 (90127267)

Co-Investigator(Kenkyū-buntansha) Remijn GerardB.  九州大学, 芸術工学研究院, 准教授 (40467098)
高木 英行  九州大学, 芸術工学研究院, 教授 (50274543)
上田 和夫  九州大学, 芸術工学研究院, 准教授 (80254316)
Project Period (FY) 2017-06-30 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥25,350,000 (Direct Cost: ¥19,500,000、Indirect Cost: ¥5,850,000)
Fiscal Year 2019: ¥8,840,000 (Direct Cost: ¥6,800,000、Indirect Cost: ¥2,040,000)
Fiscal Year 2018: ¥9,230,000 (Direct Cost: ¥7,100,000、Indirect Cost: ¥2,130,000)
Fiscal Year 2017: ¥7,280,000 (Direct Cost: ¥5,600,000、Indirect Cost: ¥1,680,000)
Keywords音素 / 聴覚体制化 / 音節 / スペクトル / 因子分析 / 鳴音性 / リズム / コミュニケーション / 音声 / 聴覚 / 音韻論 / スペクトル変化 / 英語 / ポーズ / 多変量解析 / 英語音声 / 音節形成
Outline of Final Research Achievements

Phonology is a field in linguistics that focuses on how speech sounds are separated from and related to one another. This field should be closely connected to auditory psychology, which deals with how sounds in the environment are organized perceptually. We aimed at this, and first created an English speech database, on which this project was to be based. The commercial database we had used for our previous research had some technical problems including the poor recording quality, and they were fixed in our new database, for which original speech samples were used. The close relationship between frequency components around 1 kHz and sonority was confirmed. Frequency components around 2.5 kHz also turned out to be important. The role of pauses in English paragraphs read aloud was investigated employing native and non-native speakers of English. It turned out that to give a fixed pause of 0.6 s to every punctuation point makes the speech sound natural.

Academic Significance and Societal Importance of the Research Achievements

人間を他の動物と区別する言語コミュニケーションの根本は、母音や子音をどのように区別し、どのようにまとめあげてゆくかにある。このことに関連して、世界の言語に共通するスペクトル変化の因子を確認し、音節がどのように形成されるかについて実証的に考えを進める枠組みが得られた。この枠組みの中で、音声のリズムについて考察することも可能になり、今後は言語を超えた人間同士のコミュニケーションについても研究対象を拡げてゆくことができる。一方、ここで得られた知見に基づいて音声の伝達効率を評価し、音声を聴きとりやすいように加工するという、社会にとって有益な技術につながった。

Report

(4 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Annual Research Report
  • 2017 Annual Research Report
  • Research Products

    (53 results)

All 2019 2018 2017 Other

All Int'l Joint Research (5 results) Journal Article (7 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 4 results,  Open Access: 5 results) Presentation (38 results) (of which Int'l Joint Research: 33 results,  Invited: 2 results) Book (1 results) Patent(Industrial Property Rights) (1 results) Funded Workshop (1 results)

  • [Int'l Joint Research] アイルランド国立大学ゴールウェイ校(アイルランド)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] 北京大学(中国)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] 北京大学/大連外国語大学(中国)

    • Related Report
      2018 Annual Research Report
  • [Int'l Joint Research] アイルランド国立大学ゴールウェイ校(アイルランド)

    • Related Report
      2018 Annual Research Report
  • [Int'l Joint Research] アイルランド国立大学ゴールウェイ校(アイルランド)

    • Related Report
      2017 Annual Research Report
  • [Journal Article] Accelerating Evolutionary Computation Using a Convergence Point Estimated by Weighted Moving Vectors2019

    • Author(s)
      YU Jun, LI Yuhao, PEI Yan, and TAKAGI Hideyuki
    • Journal Title

      Complex and Intelligent Systems

      Volume: 6 Issue: 1 Pages: 55-65

    • DOI

      10.1007/s40747-019-0111-6

    • NAID

      120006630505

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] English as a medium of instruction at a Japanese university: Preferences and opinions of domestic and international students2019

    • Author(s)
      Remijn, G.B., Fuyuno, M., Blanco Cortes, L., Ono, A.
    • Journal Title

      Bulletin of KIKAN Education

      Volume: 5 Pages: 75-85

    • Related Report
      2018 Annual Research Report
  • [Journal Article] How sonority appears in speech analyses2018

    • Author(s)
      Nakajima Yoshitaka、Ueda Kazuo、Remijn Gerard B.、Yamashita Yuko、Kishida Takuya
    • Journal Title

      Acoustical Science and Technology

      Volume: 39 Issue: 3 Pages: 179-181

    • DOI

      10.1250/ast.39.179

    • NAID

      130006730834

    • ISSN
      0369-4232, 1346-3969, 1347-5177
    • Year and Date
      2018-05-01
    • Related Report
      2018 Annual Research Report
    • Open Access / Int'l Joint Research
  • [Journal Article] Temporal Resolution Needed for Auditory Communication: Measurement With Mosaic Speech2018

    • Author(s)
      Nakajima Yoshitaka、Matsuda Mizuki、Ueda Kazuo、Remijn Gerard B.
    • Journal Title

      Frontiers in Human Neuroscience

      Volume: 12(149) Pages: 1-8

    • DOI

      10.3389/fnhum.2018.00149

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Frequency specificity of amplitude envelope patterns in noise-vocoded speech2018

    • Author(s)
      Ueda Kazuo、Araki Tomoya、Nakajima Yoshitaka
    • Journal Title

      Hearing Research

      Volume: 367 Pages: 169-181

    • DOI

      10.1016/j.heares.2018.06.005

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] 音声分析に現れる鳴音性2018

    • Author(s)
      中島祥好,上田和夫,G. B. レメイン,山下友子,岸田拓也
    • Journal Title

      日本音響学会誌

      Volume: 74〈2〉 Pages: 93-96

    • NAID

      130007429203

    • Related Report
      2017 Annual Research Report
  • [Journal Article] English phonology and an acoustic language universal2017

    • Author(s)
      Nakajima Yoshitaka、Ueda Kazuo、Fujimaru Shota、Motomura Hirotoshi、Ohsaka Yuki
    • Journal Title

      Scientific Reports

      Volume: 7 Issue: 1 Pages: 46049-46049

    • DOI

      10.1038/srep46049

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] Auditory psychology and phonology2019

    • Author(s)
      Yoshitaka Nakajima
    • Organizer
      35th Annual Meeting of the International Society for Psychophysics.
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Temporal resolution needed for auditory communication: Measurement with mosaic speech2019

    • Author(s)
      Yoshitaka Nakajima
    • Organizer
      Music Performance Theory International Summit, Shanghai Conservatory of Music
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Perceptual restoration of interrupted locally time-reversed speech: Effects of noise levels and segment duration2019

    • Author(s)
      Kazuo Ueda, Valter Ciocca, Gerard B. Remijn, and Yoshitaka Nakajima
    • Organizer
      35th Annual Meeting of the International Society for Psychophysics
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A quantitative analysis to characterize verbal and non-verbal behavior in public speaking performance2019

    • Author(s)
      Yuko Yamashita, Miharu Fuyuno, Yoshitaka Nakajima, Stanislava Antonijevic-Elliott, Mark A. Elliott, and Sophia Arndt:
    • Organizer
      35th Annual Meeting of the International Society for Psychophysics
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Pause duration influences impressions of English speech style rated by native and non-native speakers2019

    • Author(s)
      Shimeng Liu , Yoshitaka Nakajima, Mark A. Elliott, Lihan Chen, Gerard B. Remijn, Sophia Arndt, and Zhuoyue Pang
    • Organizer
      35th Annual Meeting of the International Society for Psychophysics
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Factor analyses of speech and an acoustic language universal2018

    • Author(s)
      Ueda, K.
    • Organizer
      Research Colloquium at Technische Universitaet Darmstadt
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 英語における頭子音連結の多変量解析2018

    • Author(s)
      張 一新,中島 祥好,于 暁陽,上田 和夫,岸田 拓也, Arndt, S., Elliott, M. A.
    • Organizer
      言語資源活用ワークショップ2018
    • Related Report
      2018 Annual Research Report
  • [Presentation] 英語における前置詞句についての音響分析2018

    • Author(s)
      于 暁陽,中島 祥好,張 一新,上田 和夫,岸田 拓也
    • Organizer
      言語資源活用ワークショップ2018
    • Related Report
      2018 Annual Research Report
  • [Presentation] 日本語ピッチアクセント音声データベースの構築. Japanese Pitch Accent Speech Database.2018

    • Author(s)
      Ono, A., Remijn, G.B.
    • Organizer
      Proceedings of the Auditory Research Meeting
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 異なる音声形式における音の大きさの知覚. Perception of loudness in different speech modes.2018

    • Author(s)
      Oya, J., Remijn, G.B., Nakajima, Y., Ueda, K.
    • Organizer
      Proceedings of the Acoustical Society of Japan
    • Related Report
      2018 Annual Research Report
  • [Presentation] 放送音声の音響的特徴に関する研究. A study on acoustic parameters of broadcasting voices.2018

    • Author(s)
      Nakayama, T., Nakajima, Y., Ueda, K., Remijn, G.B.
    • Organizer
      Proceedings of the Acoustical Society of Japan
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Accelerating the Fireworks Algorithm with an Estimated Convergence Point2018

    • Author(s)
      Jun Yu, Ying Tan, and Hideyuki Takagi
    • Organizer
      9th Int. Conf. on Swarm Intelligence
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Multi-layer Explosion Based Fireworks Algorithm2018

    • Author(s)
      Yu Jun、Takagi Hideyuki、Tan Ying
    • Organizer
      International Journal of Swarm Intelligence and Evolutionary Computation
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Competitive Strategies for Differential Evolution2018

    • Author(s)
      Jun Yu, Yan Pei and Hideyuki Takagi
    • Organizer
      2018 IEEE Int. Conf. on Systems, Man, and Cybernetics (SMC2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Pause duration influences impressions of speech style in English public speaking2018

    • Author(s)
      Shimeng Liu, Yoshitaka Nakajima, and Mark A. Elliott
    • Organizer
      Fechner Day 2018
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] An acoustic analysis of preposition phrases in English2018

    • Author(s)
      Xiaoyang Yu, Yoshitaka Nakajima, Yixin Zhang, Takuya Kishida, and Kazuo Ueda
    • Organizer
      Fechner Day 2018
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Multivariate acoustic analysis of initial consonant clusters in English2018

    • Author(s)
      Yixin Zhang, Yoshitaka Nakajima, Xiaoyang Yu, Kazuo Ueda, Takuya Kishida, Gerard B. Remijn, Sophia Arndt, and Mark A. Elliott
    • Organizer
      Fechner Day 2018
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Critical thinking in the monolingual and bilingual population2018

    • Author(s)
      Sophia Arndt, Shimeng Liu, Yuko Yamashita, Yoshitaka Nakajima, Stanislava Antonijevic-Elliott, and Mark A. Elliott
    • Organizer
      Fechner Day 2018
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A spectral-change factor related to sonority makes noise-vocoded Japanese speech intelligible2018

    • Author(s)
      Takuya Kishida, Yoshitaka Nakajima, Kazuo Ueda, Gerard B. Remijn, and Seiya Umemoto
    • Organizer
      Fechner Day 2018
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] パワースペクトル因子を用いて合成した雑音駆動音声の知覚:鳴音性と明瞭度との関係2018

    • Author(s)
      岸田拓也,中島祥好,上田和夫,G. B. Remijn, 梅本晟弥
    • Organizer
      日本音響学会聴覚研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Phonology and psychophysics: Is sonority real?2017

    • Author(s)
      Yoshitaka Nakajima, Kazuo Ueda, Gerard Remijn, Yuko Yamashita, Takuya KISHIDA
    • Organizer
      The 33rd Annual Meeting of the International Society for Psychophysics
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] ケプストラム分析を用いた音声の因子分析2017

    • Author(s)
      上田和夫,岸田拓也,中島祥好
    • Organizer
      YPS 2017
    • Related Report
      2017 Annual Research Report
  • [Presentation] Demonstrations of Locally Time-Reversed Choral Music in Four Different Languages2017

    • Author(s)
      Kazuo Ueda, Yoshitaka Nakajima
    • Organizer
      The 6th Conference of the Asia-Pacific Society for the Cognitive Sciences of Music
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Intelligibility of English noise-vocoded speech resynthesized from spectral-change factors2017

    • Author(s)
      Takuya Kishida, Yoshitaka Nakajima, Kazuo Ueda, Gerard Remijn, Sophia Arndt, Mark A. Elliott
    • Organizer
      The 33rd Annual Meeting of the International Society for Psychophysics
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Irrelevant sound effects with locally time-reversed speech2017

    • Author(s)
      Wolfgang Ellermeier, Florian Kattner, Kazuo Ueda, Yoshitaka Nakajima
    • Organizer
      The 33rd Annual Meeting of the International Society for Psychophysics
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] The perception and recognition of auditory icons by Japanese drivers2017

    • Author(s)
      Joao Paulo Cabral, Yoshitaka Nakajima, Kazuo Ueda, Gerard Remijn
    • Organizer
      The 33rd Annual Meeting of the International Society for Psychophysics
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Perceptual restoration of interrupted locally time-reversed speech2017

    • Author(s)
      Kazuo Ueda, Nozomi Inui, Kaisei Shiraki, Valter Ciocca, Yoshitaka Nakajima, Gerard Remijn
    • Organizer
      The 33rd Annual Meeting of the International Society for Psychophysics
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Irrelevant sound effects with locally time-reversed speech: Real performance difference between German and Japanese native speakers?2017

    • Author(s)
      Kazuo Ueda, Akie Shibata, Yoshitaka Nakajima, Katharina Rost, Florian Kattner, Wolfgang Ellermeier
    • Organizer
      The 33rd Annual Meeting of the International Society for Psychophysics
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Temporal resolution needed for auditory communication: Measurement with mosaic speech2017

    • Author(s)
      Yoshitaka Nakajima, Mizuki Matsuda, Kazuo Ueda, Gerard Remijn
    • Organizer
      The 33rd Annual Meeting of the International Society for Psychophysics
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Acceleration for Fireworks Algorithm Based on Amplitude Reduction Strategy and Local Optima-based Selection Strategy2017

    • Author(s)
      Jun Yu and Hideyuki Takagi
    • Organizer
      8th International Conference on Swarm Intelligence
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Estimation of Convergence Points of Population Using an Individual Pool2017

    • Author(s)
      Jun Yu and Hideyuki Takagi
    • Organizer
      10th International Workshop on Computational Intelligence & Applications
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Discrepancies between notated rhythms and performed rhythms2017

    • Author(s)
      Keita Yamazaki and Yoshitaka Nakajima
    • Organizer
      The 6th Conference of the Asia-Pacific Society for the Cognitive Sciences of Music
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Quantitative analysis of English public speaking presented by Japanese EFL learners2017

    • Author(s)
      Shimeng Liu, Yoshitaka Nakajima, Yuko Yamashita and Miharu Fuyuno
    • Organizer
      The 6th Conference of the Asia-Pacific Society for the Cognitive Sciences of Music
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Time-shrinking as observed in contexts close to music2017

    • Author(s)
      Goshi Takeshita and Yoshitaka Nakajima
    • Organizer
      The 6th Conference of the Asia-Pacific Society for the Cognitive Sciences of Music
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Is the acoustic language universal really universal?2017

    • Author(s)
      Yoshitaka Fujii, Yoshitaka Nakajima, Takuya Kishida and Takeharu Seno
    • Organizer
      The 33rd Annual Meeting of the International Society for Psychophysics
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Effects of sound marker durations on the perception of inter-onset time intervals: A study with real and synthesized piano sounds2017

    • Author(s)
      Emi Hasuo, Yoshitaka Nakajima, Michiko Wakasugi, and Takuya Fujioka
    • Organizer
      The 33rd Annual Meeting of the International Society for Psychophysics
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] The effect of virtual eyes on psychological nervousness of public speakers2017

    • Author(s)
      Miharu Fuyuno, Yuko Yamashita, and Yoshitaka Nakajima
    • Organizer
      The 33rd Annual Meeting of the International Society for Psychophysics
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Critical thinking in two languages: Bilingualism and second language competency as determinants of performance2017

    • Author(s)
      Sophia Arndt, Ethan Keeney, Kaori Kojima, Sarah Volkmer, Zhimin Bao, Shimeng Liu, Stanislava Antonijevic, Yoshitaka Nakajima, and Mark A. Elliott
    • Organizer
      The 33rd Annual Meeting of the International Society for Psychophysics
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Book] Auditory time perception. In Rolf BADER (ed.): Springer Handbook of Systematic Musicology.2018

    • Author(s)
      Simon GRONDIN, Emi HASUO, Tsuyoshi KURODA, Yoshitaka NAKAJIMA
    • Total Pages
      18
    • Publisher
      Cham: Springer
    • Related Report
      2018 Annual Research Report
  • [Patent(Industrial Property Rights)] 音声伝達環境評価システム及び感覚刺激提示装置2018

    • Inventor(s)
      中島祥好、上田和夫、G. B. Remijn ほか
    • Industrial Property Rights Holder
      九州大学
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2018-204056
    • Filing Date
      2018
    • Related Report
      2018 Annual Research Report
  • [Funded Workshop] Theme Session: Psychophysics of Language (in the 35th Annual Meeting of the International Society for Psychophysics)2019

    • Related Report
      2019 Annual Research Report

URL: 

Published: 2017-07-21   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi