Neurocognitive plasticity and development of communication bases

2013 Fiscal Year Final Research Report

• Project/Area Number: 21243040
• Research Category: Grant-in-Aid for Scientific Research (A)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Experimental psychology
• Research Institution: Kumamoto University
• Principal Investigator: SEKIYAMA Kaoru 熊本大学, 文学部, 教授 (70216539)
• Co-Investigator(Kenkyū-buntansha): SHINOZAKI Jun 札幌医科大学, 医学部, 助教 (30510953) ; IMARUOKA Toshihide 金沢工業大学, 情報フロンティア学部, 准教授 (20387351) ; MATSUMOTO Kei 金沢工業大学, 基礎教育部, 准教授 (40367446) ; MATSUI Mie 富山大学, 医学薬学研究部, 准教授 (70209485) ; MURAYAMA Nobuki 熊本大学, 自然科学研究科, 教授 (60094108) ; IGASAKI Tomohiko 熊本大学, 自然科学研究科, 准教授 (70315282) ; YUMOTO Eiji 熊本大学, 生命科学研究部, 教授 (40116992)
• Co-Investigator(Renkei-kenkyūsha): SAMEJIMA Yasuhiro 熊本大学, 生命科学研究部, 講師 (50206009) ; SATO Masaaki 株式会社国際電気通信基礎技術研究所, ATR 脳情報研究所, 研究室長 (90395129)
• Project Period (FY): 2009-04-01 – 2013-03-31
• Keywords: 視聴覚音声知覚 / 言語特殊性 / 人工内耳 / 共感 / 社交不安 / 発達 / 脳機能画像 / 事象関連電位

Research Abstract

This study investigated how different types of experiences in early and later in life affect human communication bases. The results are as follows. The type of native language (Japanese versus English) affects auditory-visual integration in speech perception, as evidenced by gaze behavior in infancy, adult brain responses (ERP, fMRI) and behavior (RT and gaze). In cochlear implant user's speech perception, good performers' brain responses (ERP) showed a component similar to that of normal hearing, indicating the beginning of restoration of speech perception in noise, as compared with poor performers. Concerning neural bases of empathy, fMRI revealed an own-mother-specific activation for recognizing facial expressions. A cognitive behavioral therapy program for students with high social anxiety indicated an intervention effect in brain responses (NIRS).

Research Products

• [Journal Article] Enhanced audiovisual integration with aging in speech perception : A heightened McGurk effect in older adults (2014)
  • Author(s): Sekiyama, K, Sohi, T., & Sakamoto, S
  • Journal Title: Frontiers in Psychology Language Sciences Pages: l-12
  • DOI: 10.3389/fpsyg2014.00323
  • Peer Reviewed
• [Journal Article] Referential framework for transcranial anatomical correspondence for fNIRS based on manually traced sulci and gyri of an infant brain (2014)
  • Author(s): Matsui M, et al
  • Journal Title: Neuroscience Research Volume: 80 Pages: 55-68
  • DOI: 10.1016/j.neures.2014.0l.003
  • Peer Reviewed
• [Journal Article] Audiotactile interactions beyond the space and body parts around the head (2013)
  • Author(s): Teramoto, W, Nozoe, Y, &Sekiyama, K
  • Journal Title: Experimental Brain Research Volume: 228 Pages: 427-436
  • DOI: 10.1007/s00221-013-3574-5
  • Peer Reviewed
• [Journal Article] Event-related potential study on image-symmetry discrimination in the human brain (2013)
  • Author(s): Sambul AM, Muravama N, Inagaki T
  • Journal Title: Proc. of the 35th Annual Intemational Conference of the IEEE Engineering in Medicine and Biology Society Pages: 5938-5941
  • DOI: 10.1109/EMBC.2013.6610904
  • Peer Reviewed
• [Journal Article] Visuo-somato sensory reorganization in perceptUal adaptation to reversed vision (2012)
  • Author(s): Sekivama, K., Hashimoto, K., & Sugita, Y
  • Journal Title: Acta Psychologica Volume: 141 Pages: 231-242
  • DOI: 10.1016/」.actpsy.2012.05.011.
  • Peer Reviewed
• [Journal Article] Reading performance in middle-aged adults with declined accommodation (2012)
  • Author(s): Teramoto, W, Tao, K, Sekiyama. K., & Mori, S
  • Journal Title: Attention, Perception, & Psychophysics Volume: 74 Pages: 1722-1731
  • DOI: 10.3758/s13414-012-0360-6
  • Peer Reviewed
• [Journal Article] Developmental trajectories of amygdala and hippocampus from infancy to early adulthood in healthy individuals (2012)
  • Author(s): Uematsu A, Matsui M, Tanaka C, Takahashi T, Noguchi K, Suzuki M, Nishijo H
  • Journal Title: PLoS ONE Volume: 7(10) Pages: e46970
  • DOI: 10.1371/journal.pone.0046970
  • Peer Reviewed
• [Journal Article] ERPと視線にみられる日英間の視聴覚音声知覚の差異 (2012)
  • Author(s): 久永聡子、積山薫、伊賀崎伴彦、村山伸樹
  • Journal Title: 日本音響学会聴覚研究会資料 Volume: 42(7) Pages: 559-564
• [Journal Article] Enhanced perception of various linguistic featUres by musicians : across-linguistic study (2011)
  • Author(s): Sadakata, M. & Sekiyama K
  • Journal Title: Acta Psychologica Volume: l38 Pages: 1-10
  • DOI: 10.1016/j.actpsy.2011.03.007
  • Peer Reviewed
• [Journal Article] An ERP examination of audiovisual speech perception in Japanese younger and older adults (2010)
  • Author(s): Hisanaga, S., Sekiyama. K., Inagaki T., & Murayama. N
  • Journal Title: Proc. of the 2010 Intemational Conference on Auditory-Visual Speech Processing Pages: ll6-120
  • URL: http://www.isca-speech.org/archive/avsp10/papers/av10_S5-3.pdf
  • Peer Reviewed
• [Journal Article] Long-term cochlear implant users have resistance to noise but short-term users don't (2010)
  • Author(s): Kanekama, Y, Hisanaga, S., Sekivama, K., Kodama, N., Sameiima. Y, Yamada, T., & Yumototo. E
  • Journal Title: Proc. of the 2010 International Conference on Auditory-Visual Speech Processing Pages: 54-58
  • URL: http://www.isca-speech.org/archive/avsp10/papers/av10_S4-1.pdf
  • Peer Reviewed
• [Journal Article] Impact of language on audiovisual speech perception examined by fMRI (2010)
  • Author(s): Shinozaki, J., Sekiyama. K., Hiroe, N., Yoshioka, T., & Sato, M
  • Journal Title: Proc. of the 2010 1nternational Conference on Auditory-Visual Speech Processing Pages: 111-115
  • URL: http://www.isca-speech.org/archive/avsp10/papers/av10_S5-2.pdf
  • Peer Reviewed
• [Journal Article] Audiovisual speech perception in Japanese and Englilsh : Interlanguage differences examined by event-related potentials (2009)
  • Author(s): Hisanaga, S., Sekivama. K., Igasaki, T., & Murayama. N
  • Journal Title: International Conference on Auditory-Visual Speech Processing Pages: 38-42
  • URL: http://www2.cmp.uea.ac.uk/～blt/avsp2009/proc/papers/paper-38.pdf
  • Peer Reviewed
• [Presentation] Brain activity in cognitive conflict using face expression stimuli : A study of near-infrared spectroscopy (2014)
  • Author(s): Matsui M, Nakagawa M, Katagiri M, Hoshino T
  • Organizer: Intemational Neuropsychological Society 42nd Annual Meeting
  • Place of Presentation: Seattle, USA
  • Year and Date: 20140212-15
• [Presentation] Unconscious perception of own mother's anger face enhances the lateral orbitofrontal cortex activity (2013)
  • Author(s): Shinozaki J., Murahara T., Saito H., Harada K.,Nagahama H., Sakurai Y, Nagamine T
  • Organizer: Society for Neuroscience
  • Place of Presentation: San Diego, U.S.
  • Year and Date: 2013-11-10
• [Presentation] スピーチ不安を有する大学生の自己評価バイアス-社交不安との関連と集団認知行動療法による変化 (2013)
  • Author(s): 松本圭
  • Organizer: 日本心理学会第77回大会
  • Place of Presentation: 札幌市産業振興センター(札幌)
  • Year and Date: 2013-09-19
• [Presentation] 視線方向は自伝的記憶想起に影響するか (2013)
  • Author(s): 伊丸岡俊秀・関大輔
  • Organizer: 日本心理学会第77回大会
  • Place of Presentation: 札幌市産業振興センター(札幌)
  • Year and Date: 2013-09-19
• [Presentation] Hearing impairment in nasopharyngeal carcinoma patients (2012)
  • Author(s): Masuda M, Minoda R, Yumoto E
  • Organizer: 9th International Conference on Cholesteatoma and Ear Surgery
  • Place of Presentation: 長崎長崎ブリックホール
  • Year and Date: 20120603-07
• [Presentation] Visual motion in audiovisual speech perception affects superior temporal sulcus in English speakers more strongly than in Japanese speakers : An effective connectivity analysis (2012)
  • Author(s): Shinozaki, J., Hiroe, N., Yohioka, T., Sato M, and Sekiyama, K
  • Organizer: Society for Neuroscience 42nd annual meeting
  • Place of Presentation: New Orleans, USA
  • Year and Date: 2012-10-15
• [Presentation] Visual motion in audiovisual speech perception affects superior temporal sulcus in English speakers more strongly than in Japanese speakers : An effective co㎜ectivity analysis (2012)
  • Author(s): Shinozaki J, Hiroe N, Yoshioka T, Sato M, Sekivama K
  • Organizer: Society for Neuroscience
  • Place of Presentation: New Orleans, US
  • Year and Date: 2012-10-14
• [Presentation] Speech perception by face and voice in speakers of Japanese and English (2012)
  • Author(s): Sekiyama, K
  • Organizer: the 30th International Congress of Psychology
  • Place of Presentation: Cape Tbwn : South Africa
  • Year and Date: 2012-07-25
  • Invited
• [Presentation] Deficit in shifts of attention to different levels of global-local stimuli in patients with schizophrenia (2012)
  • Author(s): Matsui M, Takeuchi A, Katagiri M, Matsuda Y,Suzuki M
  • Organizer: Cognition in Schizophrenia 2012 : A Satellite Meeting of the Schizophrenia Intemational Research Society
  • Place of Presentation: Florence, Italy
  • Year and Date: 2012-04-14
• [Presentation] Auditory modulation of somatosensory spatial judgments in various body regions and locations (2011)
  • Author(s): Nozoe Y, Sekivama K., & Teramoto W
  • Organizer: The l2th Intemational Multisensory Research Forum
  • Place of Presentation: 福岡市、アクロス福岡
  • Year and Date: 2011-10-17
• [Presentation] A cross-linguistic ERP examination of audiovisual speech perception between English and Japanese (2011)
  • Author(s): Hisanaga S., Sekivama K., Igasaki T, & Murayama N
  • Organizer: The l2th Intemational Multisensory Research Forum
  • Place of Presentation: 福岡市、アクロス福岡
  • Year and Date: 2011-10-17
• [Presentation] Effects of emotional stimulation on cortico-muscular coherence in humans (2011)
  • Author(s): Fextha S., Muravama N., lgasaki T., Hayashida Y
  • Organizer: 第34回日本神経科学大会
  • Place of Presentation: 横浜市パシフィコ横浜
  • Year and Date: 2011-09-14
• [Presentation] 'The brain mechanism underling interaction of processing bias and anxiety level (2010)
  • Author(s): Matsuda, Y, Imaruoka, T., Kunimi, M., Matsumoto K, & Matsui. M
  • Organizer: Symposium : Attention and Cognition
  • Place of Presentation: 仙台市、東北大学
  • Year and Date: 2010-09-18
• [Presentation] 視聴覚統合における脳内神経機構の解明 (2010)
  • Author(s): 廣江総雄・篠崎淳・吉岡琢・佐藤雅昭・積山薫
  • Organizer: 第33回日本神経科学大会 (Neuroscience Research, Vol.68, supplement 1,2010, page e332)
  • Place of Presentation: 神戸市,神戸国際展示場
  • Year and Date: 2010-09-03
• [Book] Cambridge University Press. Investigating auditory-visual speech perception development. In G. Bailly, P. Perrier,&E. Vatikiotis-Bateson (Eds.) (2012)
  • Author(s): Burnham, D. & Sekivama. K
  • Total Pages: 62-75
  • Publisher: Audiovisual Speech Processing
• [Book] 音声知覚 における多感覚情報の統合、川崎恵理子(編) 「認知心理学の新展開 : 言語と記憶」 (2012)
  • Author(s): 積山薫
  • Total Pages: 21
  • Publisher: ナカニシヤ出版
• [Book] 認知発達の脳科学的基盤、根ヶ山光一・仲真紀子(編)「発達科学ハンドブック4発達の基盤 : 身体、認知、情動」 (2012)
  • Author(s): 松井三枝
  • Total Pages: 105-118
  • Publisher: 新曜社
• [Book] Proceedings of the 2010 Intemational Conference on Auditory-Visual Speech Processing ISBN 978-4-9905475-0-9. (2010)
  • Author(s): Sekivama. K., et al. (Eds.)
• [Remarks]
  • URL: http://www.let.kumamoto-u.ac.jp/ihs/hum/psychology/sekiyama/kibanA_home.htm