• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

How does the brain restore missing speech information?

Research Project

Project/Area Number 17K18705
Research Category

Grant-in-Aid for Challenging Research (Exploratory)

Allocation TypeMulti-year Fund
Research Field Psychology and related fields
Research InstitutionKyushu University

Principal Investigator

Ueda Kazuo  九州大学, 芸術工学研究院, 准教授 (80254316)

Co-Investigator(Kenkyū-buntansha) Remijn GerardB.  九州大学, 芸術工学研究院, 准教授 (40467098)
中島 祥好  九州大学, 芸術工学研究院, 教授 (90127267)
Project Period (FY) 2017-06-30 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥6,370,000 (Direct Cost: ¥4,900,000、Indirect Cost: ¥1,470,000)
Fiscal Year 2019: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
Fiscal Year 2018: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
Fiscal Year 2017: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Keywords劣化音声知覚 / 音声修復 / 連続聴錯覚 / 局部時間反転音声 / 断続音声 / 音韻修復 / 実験系心理学 / 精神物理学 / 劣化音声
Outline of Final Research Achievements

Intelligibility of temporally degraded speech was investigated with locally time-reversed speech (LTR) and its interrupted version (ILTR). Control stimuli comprising interrupted speech (I) were also included. Speech stimuli consisted of 200 Japanese meaningful sentences. In interrupted stimuli, speech segments were alternated with either silent gaps or pink noise bursts. The noise bursts had a level of -10, 0 or +10 dB relative to the speech level. Segment duration varied from 20 to 160 ms for ILTR sentences, but was fixed at 160 ms for I sentences. At segment durations of 40 and 80 ms, severe reductions in intelligibility were observed for ILTR sentences, compared with LTR sentences. A substantial improvement in intelligibility (30-33%) was observed when 40-ms silent gaps in ILTR were replaced with 0- and +10 dB noise. Noise with a level of -10-dB had no effect on the intelligibility.

Academic Significance and Societal Importance of the Research Achievements

音声を用いたコミュニケーションは,日常生活においては他の音声や音声以外の音が存在する中で行われることが普通である。そのような環境では,音声は他の音によって遮られたり,残響の影響を受けたりするが,それでも音声知覚は正常に行われている。本研究で行われた劣化音声の知覚に関する研究は,どのような劣化条件で知覚的修復が行われるのかを明らかにしたものである。音声知覚の仕組みを解明するという学術的意義に加えて,日常生活で用いられる人工内耳が満たすべき要件,あるいは限られた情報量で音声を伝送するための要件を明らかにする,という社会的意義がある。

Report

(4 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (55 results)

All 2020 2019 2018 2017 Other

All Int'l Joint Research (6 results) Journal Article (9 results) (of which Int'l Joint Research: 4 results,  Peer Reviewed: 7 results,  Open Access: 6 results) Presentation (26 results) (of which Int'l Joint Research: 13 results,  Invited: 3 results) Book (7 results) Remarks (5 results) Patent(Industrial Property Rights) (1 results) Funded Workshop (1 results)

  • [Int'l Joint Research] The University of British Columbia(カナダ)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] Technische Universitaet Darmstadt(ドイツ)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] University of British Columbiah(カナダ)

    • Related Report
      2018 Research-status Report
  • [Int'l Joint Research] Technische Universitaet Darmstadt(ドイツ)

    • Related Report
      2018 Research-status Report
  • [Int'l Joint Research] University of British Columbia(Canada)

    • Related Report
      2017 Research-status Report
  • [Int'l Joint Research] Technische Universitaet Darmstadt(Germany)

    • Related Report
      2017 Research-status Report
  • [Journal Article] Irrelevant speech effects with locally time-reversed speech: Native vs non-native language2019

    • Author(s)
      Ueda Kazuo, Nakajima Yoshitaka, Kattner Florian, Ellermeier Wolfgang
    • Journal Title

      The Journal of the Acoustical Society of America

      Volume: 145 Issue: 6 Pages: 3686-3694

    • DOI

      10.1121/1.5112774

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Auditory icons: Design and physical characteristics2019

    • Author(s)
      Cabral Joao Paulo、Remijn Gerard Bastiaan
    • Journal Title

      Applied Ergonomics

      Volume: 78 Pages: 224-239

    • DOI

      10.1016/j.apergo.2019.02.008

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] English as a medium of instruction at a Japanese university: Preferences and opinions of domestic and international students2019

    • Author(s)
      Remijn, G.B., Fuyuno, M., Blanco Cortes, L., Ono, A.
    • Journal Title

      Bulletin of KIKAN Education

      Volume: 5 Pages: 75-85

    • Related Report
      2019 Annual Research Report
    • Open Access
  • [Journal Article] How sonority appears in speech analyses2018

    • Author(s)
      Nakajima Yoshitaka、Ueda Kazuo、Remijn Gerard B.、Yamashita Yuko、Kishida Takuya
    • Journal Title

      Acoustical Science and Technology

      Volume: 39 Issue: 3 Pages: 179-181

    • DOI

      10.1250/ast.39.179

    • NAID

      130006730834

    • ISSN
      0369-4232, 1346-3969, 1347-5177
    • Year and Date
      2018-05-01
    • Related Report
      2018 Research-status Report
    • Open Access / Int'l Joint Research
  • [Journal Article] Frequency specificity of amplitude envelope patterns in noise-vocoded speech2018

    • Author(s)
      Ueda Kazuo、Araki Tomoya、Nakajima Yoshitaka
    • Journal Title

      Hearing Research

      Volume: 367 Pages: 169-181

    • DOI

      10.1016/j.heares.2018.06.005

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Temporal Resolution Needed for Auditory Communication: Measurement With Mosaic Speech2018

    • Author(s)
      Nakajima Yoshitaka、Matsuda Mizuki、Ueda Kazuo、Remijn Gerard B.
    • Journal Title

      Frontiers in Human Neuroscience

      Volume: 12(149) Pages: 1-8

    • DOI

      10.3389/fnhum.2018.00149

    • Related Report
      2018 Research-status Report 2017 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Intelligibility of locally time-reversed speech: A multilingual comparison2017

    • Author(s)
      Ueda Kazuo、Nakajima Yoshitaka、Ellermeier Wolfgang、Kattner Florian
    • Journal Title

      Scientific Reports

      Volume: 7 Issue: 1 Pages: 1782-1782

    • DOI

      10.1038/s41598-017-01831-z

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Altered human voice processing in the frontal cortex and a developmental language delay in 3- to 5-year-old children with autism spectrum disorder2017

    • Author(s)
      Yoshimura Yuko、Kikuchi Mitsuru、Hayashi Norio、Hiraishi Hirotoshi、Hasegawa Chiaki、Takahashi Tetsuya、Oi Manabu、Remijn Gerard B.、Ikeda Takashi、Saito Daisuke N.、Kumazaki Hirokazu、Minabe Yoshio
    • Journal Title

      Scientific Reports

      Volume: 7 Issue: 1 Pages: 17116-17116

    • DOI

      10.1038/s41598-017-17058-x

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] A NIRS study on cortical hemodynamic responses to normal and whispered speech in 3- to 7-year-old children2017

    • Author(s)
      Remijn, G.B., Kikuchi, M., Shitamichi, K., Ueno, S., Yoshimura, Y., Tsubokawa, T., Kojima, H., Higashida, H., Minabe, Y.
    • Journal Title

      Journal of Speech, Language and Hearing Research

      Volume: 60 Pages: 465-470

    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Presentation] 局部時間ランダマイズ・モザイク音声の明瞭度2020

    • Author(s)
      江口 輝, 上田 和夫, レメイン ジェラード B., 中島 祥好,
    • Organizer
      日本音響学会春季研究発表会
    • Related Report
      2019 Annual Research Report
  • [Presentation] Locally time-scrambled mosaic speech2019

    • Author(s)
      Hikaru EGUCHI, Kazuo UEDA, Gerard B. REMIJN, Yoshitaka NAKAJIMA
    • Organizer
      日本音響学会聴覚研究会
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 聴力検査の利用に向けたモザイク音声の明瞭度について2019

    • Author(s)
      尾中達郎,中島祥好,上田和夫,ジェラード B. レメイン
    • Organizer
      日本音響学会聴覚研究会
    • Related Report
      2019 Annual Research Report
  • [Presentation] Perceptual restoration of interrupted locally time-reversed speech: Effects of noise levels and segment duration2019

    • Author(s)
      Kazuo Ueda, Valter Ciocca, Gerard B. Remijn, and Yoshitaka Nakajima
    • Organizer
      Fechner Day 2019: the 35th Annual Meeting of the International Society for Psychophysics
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Perceptual restoration of interrupted locally time-reversed speech: Effects of noise levels2019

    • Author(s)
      Kazuo Ueda, Valter Ciocca, Gerard B. Remijn, and Yoshitaka Nakajima
    • Organizer
      The 83rd Annual Convention of the Japanese Psychological Association
    • Related Report
      2019 Annual Research Report
  • [Presentation] Irrelevant speech effects with locally time-reversed speech: Native vs. non-native language2018

    • Author(s)
      Ueda, K., Nakajima, Y., Kattner, F., and Ellermeier, W.
    • Organizer
      The 176th Meeting of the Acoustical Society of America and 2018 Acoustics Week in Canada in Victoria
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Irrelevant speech effects with locally time-reversed speech: Native vs. non-native language with German and Japanese participants2018

    • Author(s)
      Ueda, K., Nakajima, Y., Kattner, F., and Ellermeier, W.
    • Organizer
      Lunch Talk in Dept. Ophthalmology & Visual Sciences
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Factor analyses of speech and an acoustic language universal2018

    • Author(s)
      Ueda, K.
    • Organizer
      Research Colloquium at Technische Universitaet Darmstadt
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Irrelevant sound effects with locally time-reversed speech: Speech reversal and language familiarity2018

    • Author(s)
      Ueda, K., Nakajima, Y., Kattner, F., and Ellermeier, W.
    • Organizer
      日本心理学会第 82 回大会
    • Related Report
      2018 Research-status Report
  • [Presentation] モザイク処理を施した日本語名詞句音声の明瞭度について2018

    • Author(s)
      尾中達郎,中島祥好, 上田和夫, Gerard B. Remijn
    • Organizer
      日本音響学会2018年秋季研究発表会
    • Related Report
      2018 Research-status Report
  • [Presentation] 臨界帯域フィルターを通した合唱音楽のパワー変動の因子分析:通常音声と歌唱音声の違い2018

    • Author(s)
      上田和夫,中島祥好
    • Organizer
      日本音響学会2018年秋季研究発表会
    • Related Report
      2018 Research-status Report
  • [Presentation] 英語における頭子音連結の多変量解析2018

    • Author(s)
      張 一新,中島 祥好,于 暁陽,上田 和夫,岸田 拓也, Arndt, S., Elliott, M. A.
    • Organizer
      言語資源活用ワークショップ2018
    • Related Report
      2018 Research-status Report
  • [Presentation] 英語における前置詞句についての音響分析2018

    • Author(s)
      于 暁陽,中島 祥好,#張 一新,上田 和夫,岸田 拓也
    • Organizer
      言語資源活用ワークショップ2018
    • Related Report
      2018 Research-status Report
  • [Presentation] Irrelevant sound effects with locally time-reversed speech: Effects of native language2018

    • Author(s)
      Kazuo UEDA, Yoshitaka NAKAJIMA, Florian KATTNER, Wolfgang ELLERMEIER
    • Organizer
      日本音響学会春季研究発表会
    • Related Report
      2017 Research-status Report
  • [Presentation] パワースペクトル因子を用いて合成した雑音駆動音声の知覚:鳴音性と明瞭度との関係2018

    • Author(s)
      岸田拓也,中島祥好,上田和夫,G. B. Remijn, 梅本晟弥
    • Organizer
      日本音響学会聴覚研究会
    • Related Report
      2017 Research-status Report
  • [Presentation] Demonstrations of Locally Time-Reversed Choral Music in Four Different Languages2017

    • Author(s)
      Kazuo UEDA, Yoshitaka NAKAJIMA
    • Organizer
      The 6th Conference of the Asia-Pacific Society for the Cognitive Sciences of Music, Kyoto.
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Intelligibility of English noise-vocoded speech resynthesized from spectral-change factors2017

    • Author(s)
      Takuya KISHIDA, Yoshitaka NAKAJIMA, Kazuo UEDA, Gerard Remijn, Sophia Arndt, Mark A. Elliott
    • Organizer
      Fechner Day 2017: The 33rd Annual Meeting of the International Society for Psychophysics, Fukuoka, Japan.
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Irrelevant sound effects with locally time-reversed speech2017

    • Author(s)
      Wolfgang Ellermeier, Florian Kattner, Kazuo UEDA, Yoshitaka NAKAJIMA
    • Organizer
      Fechner Day 2017: The 33rd Annual Meeting of the International Society for Psychophysics, Fukuoka, Japan.
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] The perception and recognition of auditory icons by Japanese drivers2017

    • Author(s)
      Joao Paulo Cabral, Yoshitaka NAKAJIMA, Kazuo UEDA, Gerard REMIJN
    • Organizer
      Fechner Day 2017: The 33rd Annual Meeting of the International Society for Psychophysics, Fukuoka, Japan.
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Perceptual restoration of interrupted locally time-reversed speech2017

    • Author(s)
      Kazuo UEDA, Nozomi INUI, Kaisei SHIRAKI, Valter CIOCCA, Yoshitaka NAKAJIMA, Gerard REMIJN
    • Organizer
      Fechner Day 2017: The 33rd Annual Meeting of the International Society for Psychophysics, Fukuoka, Japan.
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Irrelevant sound effects with locally time-reversed speech: Real performance difference between German and Japanese native speakers?2017

    • Author(s)
      Kazuo UEDA, Akie SHIBATA, Yoshitaka NAKAJIMA, Katharina ROST, Florian KATTNER, Wolfgang ELLEMEIER
    • Organizer
      Fechner Day 2017: The 33rd Annual Meeting of the International Society for Psychophysics, Fukuoka, Japan.
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Temporal resolution needed for auditory communication: Measurement with mosaic speech2017

    • Author(s)
      Yoshitaka NAKAJIMA, Mizuki MATSUDA, Kazuo UEDA, Gerard REMIJN
    • Organizer
      Fechner Day 2017: The 33rd Annual Meeting of the International Society for Psychophysics, Fukuoka, Japan.
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Phonology and psychophysics: Is sonority real?,2017

    • Author(s)
      Yoshitaka NAKAJIMA, Kazuo UEDA, Gerard REMIJN, Yuko YAMASHITA, Takuya KISHIDA
    • Organizer
      Fechner Day 2017: The 33rd Annual Meeting of the International Society for Psychophysics, Fukuoka, Japan.
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] 臨界帯域フィルターを通した合唱音楽のパワー変動の因子分析:ケプストラム分析の適用2017

    • Author(s)
      上田和夫,中島祥好
    • Organizer
      日本音楽知覚認知学会秋季研究発表会
    • Related Report
      2017 Research-status Report
  • [Presentation] 多変量解析と劣化音声知覚から見た多言語音声の共通性2017

    • Author(s)
      上田和夫
    • Organizer
      Kの会 第108回例会
    • Related Report
      2017 Research-status Report
    • Invited
  • [Presentation] ケプストラム分析を用いた音声の因子分析2017

    • Author(s)
      上田和夫,岸田拓也,中島祥好
    • Organizer
      YPS 2017
    • Related Report
      2017 Research-status Report
  • [Book] 知覚・認知心理学2020

    • Author(s)
      箱田裕司 編,光藤宏行,上田和夫,河邉隆寛,河原純一郎,広瀬雄彦,改田明子,中村奈良江,中村國則,小松佐穂子,岩原昭彦
    • Total Pages
      192
    • Publisher
      遠見書房
    • ISBN
      9784866160573
    • Related Report
      2019 Annual Research Report
  • [Book] 美しさと魅力の心理2019

    • Author(s)
      三浦 佳世,河原 純一郎 編著,上田和夫,他 50 名
    • Total Pages
      216
    • Publisher
      ミネルヴァ書房
    • ISBN
      9784623086597
    • Related Report
      2019 Annual Research Report
  • [Book] 生き物と音の事典2019

    • Author(s)
      生物音響学会編,上田和夫,松尾行雄,他 132 名
    • Total Pages
      464
    • Publisher
      朝倉書店
    • ISBN
      9784254171679
    • Related Report
      2019 Annual Research Report
  • [Book] 聴知覚(箱田裕司編,野島一彦・繁桝算男監修,公認心理師の基礎と実践,第7巻,知覚・認知心理学,第4章)2019

    • Author(s)
      上田和夫
    • Publisher
      東京:遠見書房
    • Related Report
      2018 Research-status Report
  • [Book] 声の魅力(三浦佳世,河原純一郎編,美と魅力の心理学)2019

    • Author(s)
      上田和夫
    • Publisher
      京都:ミネルヴァ書房
    • Related Report
      2018 Research-status Report
  • [Book] 有斐閣 現代心理学辞典(子安増生・丹野義彦・箱田裕司監修),執筆項目:音響心理学,音声知覚など16項目2019

    • Author(s)
      上田和夫
    • Publisher
      有斐閣
    • Related Report
      2018 Research-status Report
  • [Book] 生き物の音の事典2018

    • Author(s)
      生物音響学会編, 上田 和夫
    • Publisher
      朝倉書店
    • Related Report
      2017 Research-status Report
  • [Remarks] Ueda Laboratory

    • URL

      http://www.design.kyushu-u.ac.jp/~ueda/research.html

    • Related Report
      2018 Research-status Report
  • [Remarks] Ueda Laboratory

    • URL

      http://www.design.kyushu-u.ac.jp/~ueda/index.html

    • Related Report
      2017 Research-status Report
  • [Remarks] Ueda Laboratory: 九州大学大学院芸術工学研究院 上田研究室

    • URL

      http://www.design.kyushu-u.ac.jp/~ueda/uedalab_home_j.html

    • Related Report
      2017 Research-status Report
  • [Remarks] Kyushu University: research activities

    • URL

      http://hyoka.ofc.kyushu-u.ac.jp/search/details/K002356/english.html#Academic_Activities

    • Related Report
      2017 Research-status Report
  • [Remarks] 九州大学:研究者情報

    • URL

      http://hyoka.ofc.kyushu-u.ac.jp/search/details/K002356/index.html

    • Related Report
      2017 Research-status Report
  • [Patent(Industrial Property Rights)] 音声伝達状況評価システム及び音声伝達状況評価方法2019

    • Inventor(s)
      中島 祥好,上田 和夫,ジェラード ビー レメイン,他 4 名
    • Industrial Property Rights Holder
      中島 祥好,上田 和夫,ジェラード ビー レメイン,他 4 名
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2019-026825
    • Filing Date
      2019
    • Related Report
      2018 Research-status Report
  • [Funded Workshop] Fechner Day 2017: The 33rd Annual Meeting of the International Society for Psychophysics, Fukuoka, Japan.2017

    • Related Report
      2017 Research-status Report

URL: 

Published: 2017-07-21   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi