Analysis of rhythmic structures of real-time communication

2013 Fiscal Year Final Research Report

• Project/Area Number: 23653227
• Research Category: Grant-in-Aid for Challenging Exploratory Research
• Allocation Type: Multi-year Fund
• Research Field: Experimental psychology
• Research Institution: Kyushu University
• Principal Investigator: NAKAJIMA Yoshitaka 九州大学, 芸術工学研究科(研究院), 教授 (90127267)
• Co-Investigator(Kenkyū-buntansha): UEDA Kazuo 九州大学, 大学院・芸術工学研究院, 准教授 (80254316) ; TAKEICHI Hiroshige 独立行政法人理化学研究所, 脳数理研究チーム, 研究員 (60242020) ; TOMIMATSU Erika 九州大学, 大学院・芸術工学研究院, 学術研究員 (20584668)
• Project Period (FY): 2011 – 2013
• Keywords: コミュニケーション / リズム / 時間知覚 / 精神物理学 / 脳活動

Research Abstract

The relationship between auditory time perception and visual time perception was investigated. The (continuously-)filled-duration as observed frequently in the auditory modality for time intervals shorter than 1 s was established also in the visual modality utilizing a new type of stimulus patterns in which random-dot figures were used. How two adjacent time intervals marked by sound bursts were perceived as equal or unequal was investigated from a viewpoint on which brain science and psychophysics are merged. Rhythmic patterns of infants' speech in the linguistic environments of Japanese, English, and Chinese were studied and compared. Multimodal analyses of English speech communication are on a pilot stage.

Research Products

• [Journal Article] The occurrence of the filled duration illusion : A comparison of the method of adjustment with the method of magnitude estimation (2014)
  • Author(s): Hasuo, E., Nakajima, N., Tomimatsu, E., Grondin, S., Ueda, K
  • Journal Title: Acta Psychologica Volume: Vol.147 Pages: 111-121
  • DOI: 10.1016/j.actpsy.2013.10.003
  • Peer Reviewed
• [Journal Article] Acoustic analyses of speech sounds and rhythms in Japanese- and English-learning infants (2013)
  • Author(s): Yamashita, Y., Nakajima, Y., Ueda, K., Shimada, Y., Hirsh, D., Seno, T., and Smith, B.A
  • Journal Title: Front. Psychol Volume: 4 Pages: 57
  • DOI: 10.3389/fpsyg.2013.00057
  • Peer Reviewed
• [Journal Article] Illusory continuity without sufficient sound energy to fill a temporal gap : Examples of crossing glide tones (2012)
  • Author(s): Kuroda, T., Nakajima, Y., Eguchi, S
  • Journal Title: Journal of Experimental Psychology : Human Perception and Performance Volume: Vol.36 Pages: 1254-1267
  • DOI: 10.1037/a0026629
  • Peer Reviewed
• [Journal Article] Effects of temporal shapes of sound markers in the perception of inter-onset time intervals (2012)
  • Author(s): Hasuo, E., Nakajima, Y., Osawa, S., Fujishima, H
  • Journal Title: Attention, Perception, & Psychophysics Volume: Vol.74 Pages: 430-445
  • DOI: 10.3758/s13414-011-0236-1
  • Peer Reviewed
• [Journal Article] Halt and recovery of illusory motion perception from peripherally images (2011)
  • Author(s): Tomimatsu, E., Ito, H., Sunaga, S
  • Journal Title: Attention, Perception, & Psychophysics Volume: Vol.73 Pages: 1823-1832
  • DOI: 10.3758/s13414-011-0131-9
  • Peer Reviewed
• [Journal Article] Human processing of short temporal intervals as revealed by ERP waveform analysis (2011)
  • Author(s): Nakajima, Y., Takeichi, H
  • Journal Title: Front. Psychol
  • DOI: 10.3389/fnint.2011.00074
  • Peer Reviewed
• [Journal Article] A neural decoding approach to auditory temporal assimilation (2011)
  • Author(s): Takeichi, H., Mitsudo, T., Nakajima, Y., Remijn, G.B., Goto, Y., Tobimatsu, S
  • Journal Title: Neural Computing and Applications Volume: Vol.20 Pages: 965-973
  • DOI: 10.1077/s00521-010-0399-z
  • Peer Reviewed
• [Presentation] 聴覚の文法 (2014)
  • Author(s): 中島 祥好, 佐々木隆之, 上田和夫, G.B. Remijn
  • Organizer: 日本音響学会春季研究発表会
  • Place of Presentation: 日本大学
  • Year and Date: 20140310-12
• [Presentation] Perceptual processing of pairs of acoustically marked time intervals : Correspondence between psychophysiological data (2013)
  • Author(s): Nakajima, Y., Takeichi, H., Mitsudo, T., Tobimatsu, S
  • Organizer: 29th Annual Meeting of the International Society for Psychophysics Fechner Day 2013
  • Place of Presentation: Freiburg i. Br., Germany
  • Year and Date: 20131021-25
• [Presentation] Comparison of factors extracted from power fluctuations in critical-band-filtered homophonic choral music (2013)
  • Author(s): Ueda, K., Nakajima, Y
  • Organizer: 日本音響学会聴覚研究会
  • Place of Presentation: 同志社大学, 京都
  • Year and Date: 2013-05-25
• [Presentation] 視覚における1 秒以下の空虚時間と充実時間の主観的時間長 (2013)
  • Author(s): 富松江梨佳, 中島祥好, 伊藤裕之, Mark A. Elliot
  • Organizer: 日本視覚学会2013年冬季大会
  • Place of Presentation: 工学院大学アーバンティックホール, 東京
  • Year and Date: 2013-01-23
• [Presentation] 朗読音声と歌唱音声との因子分析 (2012)
  • Author(s): 中島祥好, 竹市博臣, 木寺沙紀, 上田和夫, 岸田拓也
  • Organizer: 日本基礎心理学会第31回大会
  • Place of Presentation: 九州大学医学部百年講堂, 福岡
  • Year and Date: 2012-11-03
• [Presentation] Acoustic correlate of phonological sonority in British English (2012)
  • Author(s): Nakajima, Y., Ueda, K., Fujimaru, S., Motomura, H., Ohsaka, Y
  • Organizer: 28th Annual Meeting of the International Society for Psychophysics
  • Place of Presentation: Ottawa, Canada
  • Year and Date: 2012-10-12
• [Presentation] Perceptual roles of different frequency bands in Japanese syllable identification (2012)
  • Author(s): Ueda, K., Nakajima, Y. Noguchi, K., Satsukawa, Y
  • Organizer: 28th Annual Meeting of the International Society for Psychophysics
  • Place of Presentation: Ottawa, Canada
  • Year and Date: 2012-10-12
• [Presentation] Electrophysiological substrates of auditory temporal assimilation between two neighboring time intervals (2012)
  • Author(s): Mitsudo, T., Nakajima, Y., Remijn, G.B., Takeichi, H., Goto, Y., Tobimatsu, S
  • Organizer: 12th International Conference on Music Perception and Cognition and the 8th Triennial Conference of the European Society for the Cognitive Sciences of Music
  • Place of Presentation: Thessaloniki, Greece
  • Year and Date: 2012-07-21
• [Presentation] Multivariate analyses of speech signals in singing and non-singing voices (2012)
  • Author(s): Nakajima, Y., Takeichi, H., Kidera, S., Ueda, K
  • Organizer: 12th International Conference on Music Perception and Cognition and the 8th Triennial Conference of the European Society for the Cognitive Sciences of Music
  • Place of Presentation: Thessaloniki, Greece
  • Year and Date: 2012-07-21
• [Presentation] Comparison of factors extracted from power fluctuations in critical-band-filtered homophonic choral music (2012)
  • Author(s): Ueda, K., Nakajima, Y
  • Organizer: 12th International Conference on Music Perception and Cognition and the 8th Triennial Conference of the European Society for the Cognitive Sciences of Music
  • Place of Presentation: Thessaloniki, Greece
  • Year and Date: 2012-07-21
• [Presentation] Electrophysiological correlates of subjective equality and inequality between neighboring time intervals (2012)
  • Author(s): Takeichi, H., Mitsudo, T., Nakajima, Y., Tobimatsu, S
  • Organizer: 12th International Conference on Music Perception and Cognition and the 8th Triennial Conference of the European Society for the Cognitive Sciences of Music
  • Place of Presentation: Thessaloniki, Greece
  • Year and Date: 2012-07-21
• [Presentation] 多変量解析による時間知覚の脳内機序の解明 : 時間同化現象の分析 (2012)
  • Author(s): 竹市博臣, 光藤崇子, 中島祥好, 飛松省三
  • Organizer: 第27回日本生体磁気学会大会
  • Place of Presentation: 東京電機大学千住キャンパス, 東京
  • Year and Date: 2012-05-31
• [Presentation] ランダムドット図形によって示された空虚時間と充実時間との主観的時間長の比較 (2012)
  • Author(s): 富松江梨佳, 中島祥好
  • Organizer: 日本音響学会聴覚研究会
  • Place of Presentation: 那覇市IT創造館, 那覇
  • Year and Date: 2012-02-05
• [Presentation] Factor analyses of critical-band-filtered infant babbling (2011)
  • Author(s): Nakajima, Y., Shimada, Y., Motomura, H., Ueda, K., Seno, T
  • Organizer: The 161st Meeting of the Acoustical Society of America
  • Place of Presentation: Seattle, Washington, USA
  • Year and Date: 2011-05-26
• [Book] ジェラードB. レメイン : 聴覚の文法(音響サイエンスシリーズ8) (2014)
  • Author(s): 中島祥好, 佐々木隆之, 上田和夫
  • Total Pages: 169
  • Publisher: コロナ社