Mathematical and Computational Analysis of Context Effects on Musical Expectancy: Chord Sequences and Brain Activities

2016 Fiscal Year Annual Research Report

• Project/Area Number: 26540145
• Research Institution: Kyushu University
• Principal Investigator: 中島 祥好 九州大学, 芸術工学研究院, 教授 (90127267)
• Co-Investigator(Kenkyū-buntansha): Remijn GerardB. 九州大学, 芸術工学研究院, 准教授 (40467098) ; 高木 英行 九州大学, 芸術工学研究院, 教授 (50274543)
• Project Period (FY): 2014-04-01 – 2017-03-31
• Keywords: 時間的規則性 / 事象関連電位 / 音脈 / リズム知覚

Outline of Annual Research Achievements

昨年度末に西洋音楽における和音進行に関する研究には一応のまとめがつき、その成果を国際学術誌に載せることができたので、最終年度には音楽のリズムに重点を置いて研究を行った。特に、規則的な時間パターンがごく短い音によって反復して呈示されるときに、反復とともにリズムの知覚がどのように変化するかを、聴取者が楽譜に示したリズムを作るために、音符の始まりから次の音符の始まりまでの時間長を調整することができるような手続きによって調べた。その結果、先行する時間間隔によって、その後に呈示される物理的に少し長めの時間間隔が過小評価されることがあるという「時間縮小錯覚」の影響が見られ、この錯覚現象が音楽のリズムを模したやや複雑なリズム・パターンにおいても生ずることが判った。それ以外にも、一拍がどのような比率に分割されて聴こえるかについて、拍のくり返しが知覚にどのような影響を及ぼすかを調べた。さらに、音声の一部を切りとって何度もくり返して呈示することによって、その音声が歌であるように聴こえるという「歌化錯覚」が、日本語音声に関しても生ずることを確かめた。全体として、音楽の知覚において反復が重要な役割を果たしていることが認められた。
これまでに得た知見と、過去の知見とを総合し、さらに実際の音楽を分析することによって、音楽における緊張感がどのような仕組みによって生ずるかについて考察した。その結果、音脈形成における多義性、時間的規則性の枠組みからの逸脱、調性の枠組みからの逸脱が緊張感を生ずることが多いとの見解に達した。そこで、これを示すための聴覚デモンストレーションを作成し国際学会において発表した。

Research Products

• [Journal Article] A NIRS study on cortical hemodynamic responses to normal and whispered speech in 3- to 7-year-old children. (2017)
  • Author(s): Remijn, G.B., Kikuchi, M., Shitamichi, K., Ueno, S., Yoshimura, Y., Tsubokawa, T., Kojima, H., Higashida, H., & Minabe, Y.
  • Journal Title: Journal of Speech, Language and Hearing Research Volume: 60 Pages: 465-470
  • Peer Reviewed / Open Access
• [Journal Article] Elderly listeners with low intelligibility scores under reverberation show degraded subcortical representation of reverberant speech. (2017)
  • Author(s): Fujihira, H., Shiraishi, K., & Remijn, G.B.
  • Journal Title: Neuroscience Letters Volume: 637 Pages: 102-107
  • Peer Reviewed
• [Journal Article] Synchrony of auditory brain responses predicts behavioral ability to keep still in children with autism spectrum disorder. (2016)
  • Author(s): Yoshimura, Y., Kikuchi, M., Hiraishi, H., Hasegawa, C., Takahashi, T., Remijn, G.B., Oi, M., Munesue, T., Higashida, H., & Minabe, Y.
  • Journal Title: NeuroImage: Clinical Volume: 12 Pages: 300-305
  • DOI: 10.1016/j.nicl.2016.07.009
  • Peer Reviewed
• [Journal Article] Three factors are critical in order to synthesize intelligible noise-vocoded Japanese speech. (2016)
  • Author(s): Kishida, T., Nakajima, Y., Ueda, K., & Remijn, G.B.
  • Journal Title: Frontiers in Psychology Volume: 7 Pages: -
  • DOI: 10.3389/fpsyg.2016.00517
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Accelerating Evolutionary Computation Using Estimated Convergence Point (2016)
  • Author(s): Jun Yu, Yan Pei and Hideyuki Takagi
  • Journal Title: IEEE Congress on Evolutionary Computation Volume: - Pages: 1438-1444
  • Peer Reviewed
• [Presentation] 日本語における歌化錯覚 (2016)
  • Author(s): 小野明日香, 中島祥好, 上田 和夫, Gerard B. Remijn
  • Organizer: 日本音響学会聴覚研究会
  • Place of Presentation: 福岡，日本
  • Year and Date: 2016-12-17 – 2016-12-18
• [Presentation] 局所個体群のfitnessに基づくfitness景観の勾配推定を導入した花火アルゴリズム (2016)
  • Author(s): 余俊，高木英行
  • Organizer: 進化計算シンポジウム2016
  • Place of Presentation: 九十九里, 日本
  • Year and Date: 2016-12-10 – 2016-12-11
• [Presentation] Perceptual interactions between adjacent time intervals marked by sound bursts. (2016)
  • Author(s): Nakajima, Y.
  • Organizer: 5th Joint Meeting of the Acoustical Society of America and Acoustical Society of Japan
  • Place of Presentation: Honolulu, Hawaii
  • Year and Date: 2016-11-28 – 2016-12-02
  • Int'l Joint Research / Invited
• [Presentation] Auditory brainstem responses to anechoic and reverberant two-syllable speech sounds in elderly listeners. (2016)
  • Author(s): Fujihira, H., Shiraishi, K., & Remijn, G.B.
  • Organizer: 5th joint meeting of the Acoustical Society of American and Acoustical Society of Japan
  • Place of Presentation: Honolulu, Hawaii
  • Year and Date: 2016-11-28 – 2016-12-02
  • Int'l Joint Research
• [Presentation] 受容度に基づく多数目的探索のお部屋探し (2016)
  • Author(s): 井上誠, 高橋瑞稀, 裴岩, 高木英行
  • Organizer: 第11回進化計算研究会
  • Place of Presentation: 神戸, 日本
  • Year and Date: 2016-09-14 – 2016-09-15
• [Presentation] Perceptual Validity and Analytical Advantages of Non-Negative Bases Extracted from Factor Analyses of Japanese Speech (2016)
  • Author(s): Nakao, K., Kishida, T., & Nakajima, Y.
  • Organizer: 31st International Congress on Psychology (ICP2016)
  • Place of Presentation: Yokohama, Japan
  • Year and Date: 2016-07-24 – 2016-07-29
  • Int'l Joint Research
• [Presentation] The effect of sound on visual grouping in a multi-stable stimulus. (2016)
  • Author(s): Yano, H., Nakajima, Y., Ueda, K., & Remijn, G.B.
  • Organizer: 31st International Congress on Psychology (ICP2016)
  • Place of Presentation: Yokohama, Japan
  • Year and Date: 2016-07-24 – 2016-07-29
  • Int'l Joint Research
• [Presentation] The speech-to-song illusion in Japanese (2016)
  • Author(s): Ono, A., Nakajima, Y., Ueda, K., & Remijn, G.B.
  • Organizer: 31st International Congress on Psychology (ICP2016)
  • Place of Presentation: Yokohama, Japan
  • Year and Date: 2016-07-24 – 2016-07-29
  • Int'l Joint Research
• [Presentation] Effects of factor elimination on intelligibility of noise-vocoded Japanese speech. (2016)
  • Author(s): Kishida, T., Nakajima, Y., Ueda, K., & Remijn, G.B.
  • Organizer: 31st International Congress on Psychology (ICP2016)
  • Place of Presentation: Yokohama, Japan
  • Year and Date: 2016-07-24 – 2016-07-29
  • Int'l Joint Research
• [Presentation] Principle of music perception (2016)
  • Author(s): Nakajima, Y.
  • Organizer: 31st International Congress on Psychology (ICP2016)
  • Place of Presentation: Yokohama, Japan
  • Year and Date: 2016-07-24 – 2016-07-29
  • Int'l Joint Research
• [Presentation] Perceived duration of piano sounds (2016)
  • Author(s): Hasuo, E., & Nakajima, Y.
  • Organizer: 31st International Congress on Psychology (ICP2016)
  • Place of Presentation: Yokohama, Japan
  • Year and Date: 2016-07-24 – 2016-07-29
  • Int'l Joint Research
• [Presentation] Perceptual contrast between two short adjacent time intervals marked by clicks (2016)
  • Author(s): Nakajima, Y., Matsuda, M., Tomimatsu, E., & Hasuo, E.
  • Organizer: 31st International Congress on Psychology (ICP2016)
  • Place of Presentation: Yokohama, Japan
  • Year and Date: 2016-07-24 – 2016-07-29
  • Int'l Joint Research
• [Presentation] Effects of the duration and the frequency of temporal gaps on the subjective distortedness of music fragments (2016)
  • Author(s): Iida, I., Nakajima, Y., Ueda, K., Remijn, G. B., & Serizawa, Y.
  • Organizer: ICMPC14, the 14th International Conference for Music Perception and Cognition
  • Place of Presentation: San Francisco, CA, USA
  • Year and Date: 2016-07-05 – 2016-07-09
  • Int'l Joint Research
• [Presentation] The perception of a dotted rhythmembedded in a two-four-time framework (2016)
  • Author(s): Onishi, C. Nakajima, Y. & Hasuo, E.
  • Organizer: ICMPC14, the 14th International Conference for Music Perception and Cognition
  • Place of Presentation: San Francisco, CA, USA
  • Year and Date: 2016-07-05 – 2016-07-09
  • Int'l Joint Research