Dynamic integration process linking language and action

2009 Fiscal Year Final Research Report

• Project/Area Number: 19330160
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Experimental psychology
• Research Institution: Nagoya University
• Principal Investigator: SAITO Hirofumi Nagoya University, 大学院・情報科学研究科, 教授 (40178504)
• Co-Investigator(Kenkyū-buntansha): SHIROKAWA Tetsuya 日本福祉大学, 情報社会科学部, 教授 (40187547) ; YAMAMOTO Yuji 名古屋大学, 総合保健体育科学センター, 教授 (30191456) ; SEKIYAMA Kaoru 熊本大学, 文学部, 教授 (70216539) ; SHIRAISHI Tomoko 東海大学, 健康科学部, 准教授 (60275154)
• Project Period (FY): 2007 – 2009
• Keywords: コミュニケーション / ジェスチャー / 意味 / 意図 / 理解 / 身体運動

Research Abstract

For a long time, the cortical systems for language and actions were believed to be independent modules. However, some studies have reported that as these systems are reciprocally connected with each other, information about language and actions might interact in distributed neuronal assembles. In the present study, we examined the dynamic integration process linking the generation of language and action (for instance, speech and gesture) using near-infrared spectroscopy (NIRS).

Research Products

• [Journal Article] Semantic judgment of Chinese-Japanese bilinguals: A near-infrared spectroscopy study (2010)
  • Author(s): Oi, M., Saito, H., Ito, H., Rumme, P
  • Journal Title: NeuroReport, Refereed vol.21,no.2 Pages: 127-131
• [Journal Article] 社会人の業務遂行能力に対する自己評価と他者評価:両評価のズレに着目した教育効果の計測 (2010)
  • Author(s): 山本雅基、齋藤洋典
  • Journal Title: 認知科学 17巻2号 Pages: 257-269
  • Peer Reviewed
• [Journal Article] 2言語併用者による日中同形語の意味処理における第2言語熟達度の影響 (2010)
  • Author(s): 大井京、齋藤洋典
  • Journal Title: 認知心理学研究 7巻1号 Pages: 1-8
  • Peer Reviewed
• [Journal Article] 会話とジェスチャー研究における柔軟な同期と引き込み現象 (2009)
  • Author(s): 齋藤洋典
  • Journal Title: 認知科学 16巻4号 Pages: 499-507
  • Peer Reviewed
• [Journal Article] デザインにおける美しさと機能性の共存可能性 (2009)
  • Author(s): 酒井正明、齋藤洋典、白石知子、井藤寛志
  • Journal Title: 認知科学 6巻3号 Pages: 433-447
  • Peer Reviewed
• [Journal Article] Brain responses to meaningless postures as measured by near-infrared spectroscopy (2008)
  • Author(s): Ito, H., Saito, H., Shiraishi, T., Shimizu, H., Yamamoto, Y
  • Journal Title: Refereed, NeuroReport vol.19,no.14 Pages: 1411-1415
• [Journal Article] 姿勢間結合処理の効果:プローブ再生課題を用いた検討 (2007)
  • Author(s): 井藤寛志、齋藤洋典、白石知子、山本裕二
  • Journal Title: 認知科学 14巻2号 Pages: 192-205
  • Peer Reviewed
• [Journal Article] 継時呈示された姿勢に対する結合処理を生起させる諸要因の検討 (2007)
  • Author(s): 井藤寛志、齋藤洋典、白石知子、山本裕二
  • Journal Title: 認知科学 14巻3号 Pages: 425-436
  • Peer Reviewed
• [Journal Article] 組込みソフトウェア教育の受講者と上司による受講後の教育効果評価 (2007)
  • Author(s): 山本雅基、齋藤洋典
  • Journal Title: 工学教育 55巻4号 Pages: 81-85
  • Peer Reviewed
• [Journal Article] 不確実状況下での行動決定に伴う内省の荷下ろし効果
  • Author(s): 齋藤洋典
  • Journal Title: 感性工学 (印刷中)
  • Peer Reviewed
• [Presentation] The Role of Co-Speech Gestures in Story Narration by Chinese-Japanese Bilinguals (2009)
  • Author(s): Li, Z., Saito, H
  • Organizer: 13th International Conference on the Processing East Asian Languages
  • Place of Presentation: Beijing, China
  • Year and Date: 20090000
• [Presentation] The effect of second language proficiency on semantic processing of first language in bilinguals (2009)
  • Author(s): Oi, M., Saito, H., Ito, H
  • Organizer: 13th International Conference on the Processing East Asian Languages
  • Place of Presentation: Beijing, China
  • Year and Date: 2009-10-10
• [Presentation] Cortical activities during speech related to gesture generation as measured by near-infrared spectroscopy: Speech describing object manipulation ("character-viewpoint") gesture versus speech describing object representation ("observer-viewpoint") gesture (2009)
  • Author(s): Saito, H., Kita, S., Ito, H., Oi, M., Meng, S., Liu, T., Li, Z
  • Organizer: 13th International Conference on the Processing East Asian Languages
  • Place of Presentation: Beijing, China
  • Year and Date: 2009-10-10
• [Presentation] 認知と行為に関する研究(7)物を「扱う」身振り(action gesture)と物の「動き」を表す身振り(motion gesture)の生成 (2009)
  • Author(s): 齋藤洋典、喜多壮太郎、井藤寛志、大井京、Rumme, Paul、Lepe, Albert、李宗鳳
  • Organizer: 日本心理学会第72回大会
  • Place of Presentation: 北海道(北海道大学)
  • Year and Date: 2009-09-21
• [Presentation] 認知と行為に関する研究(8)マネキンを用いた看護動作の模倣学習におけるNIRSによる特徴分析 (2009)
  • Author(s): 齋藤洋典、白石知子、大井京、井藤寛志、劉涛
  • Organizer: 日本心理学会第73回大
  • Place of Presentation: 京都(立命館大学)
  • Year and Date: 2009-08-27
• [Presentation] Integrative perception of partial humanlike body postures: A near-infrared spectroscopy study (2009)
  • Author(s): Saito, H., Ito, H., Oi, M., Shiraishi, T
  • Organizer: 1st International Conference on Asia Pacific Psychology
  • Place of Presentation: Seoul, Korea
  • Year and Date: 2009-08-24
• [Presentation] Cortical activities during gesture generation as measured by near-infrared spectroscopy: Object manipulation ("character-viewpoint") gesture versus object representation ( "observer-viewpoint") gesture (2009)
  • Author(s): Saito, H., Kita, S., Ito, H., Oi, M., Li, Z
  • Organizer: 8th Biennial Meeting of the Society for Applied Research in Memory and Cognition
  • Place of Presentation: Kyoto, Japan
  • Year and Date: 2009-08-24
• [Presentation] Cortical activities during gesture generation as measured by near-infrared spectroscopy: Object manipulation ("character-viewpoint") gesture versus object representation ("observer-viewpoint") gesture (2009)
  • Author(s): Saito, H., Oi, M
  • Organizer: 1st International Conference on Asia Pacific Psychology
  • Place of Presentation: Seoul, Korea
  • Year and Date: 2009-08-24
• [Presentation] 二言語併用者の言語処理の研究(VII):第2言語の熟達性は第1言語の意味処理に干渉するのか? (2009)
  • Author(s): 大井京、齋藤洋典、井藤寛志
  • Organizer: 日本心理学会第73回大会
  • Place of Presentation: 京都(立命館大学)
  • Year and Date: 2009-08-08
• [Presentation] Activities in the prefrontal and parietal cortices are modulated by preparation of imitation. A near-infrared spectroscopy study (2009)
  • Author(s): Ito, H., Saito, H., Oi, M., Li, Z
  • Organizer: 8th Biennial Meeting of the Society for Applied Research in Memory and Cognition
  • Place of Presentation: Kyoto, Japan
  • Year and Date: 2009-07-29
• [Presentation] Why does hands restriction in the animation narration task affect gesture production in the successive recall of narration under hands-free condition? (2009)
  • Author(s): Li, Z., Saito, H., Ito, H., Oi, M
  • Organizer: 8th Biennial Meeting of the Society for Applied Research in Memory and Cognition
  • Place of Presentation: Kyoto, Japan
  • Year and Date: 2009-07-29
• [Presentation] Cortical activities during the mental rotation of hand and letter as measured by near-infrared spectroscopy (2009)
  • Author(s): Shimizu, T., Saito, H., Ito, H., Oi, M., Li, Z., Meng, S
  • Organizer: 8th Biennial Meeting of the Society for Applied Research in Memory and Cognition
  • Place of Presentation: Kyoto, Japan
  • Year and Date: 2009-07-29
• [Presentation] 物を「扱う」身振り(action gesture)と物の「動き」を表す身振り(motion gesture)の生成:身振りと発話産出の比較 (2009)
  • Author(s): 齋藤洋典、井藤寛志、大井京、劉涛
  • Organizer: 認知心理学会第7回大会
  • Place of Presentation: 東京(立教大学)
  • Year and Date: 2009-07-19
• [Presentation] アルツハイマー病スクリーニングに有用な簡易模倣検査の開発-予測精度の高い身振りの同定- (2008)
  • Author(s): 河野直子、齋藤洋典
  • Organizer: 日本心理学会第72回大会
  • Place of Presentation: 北海道(北海道大学)
  • Year and Date: 2008-09-21
• [Presentation] わざの修得過程-身体との対話- (2008)
  • Author(s): 佐藤公治、宮本省三、瀧元誠樹、本田直也、齋藤洋典
  • Organizer: 日本心理学会第72回大会
  • Place of Presentation: 北海道(北海道大学)
  • Year and Date: 2008-09-21
• [Presentation] 行為の理解に関する研究(V)姿勢画像と物体画像の再認記憶における近赤外分光法(NIRS)を用いた検討 (2008)
  • Author(s): 井藤寛志、齋藤洋典、白石知子、清水英樹、山本裕二
  • Organizer: 本心理学会第72回大会
  • Place of Presentation: 北海道(北海道大学)
  • Year and Date: 2008-09-20
• [Presentation] Gestures as effective teaching tools: Are students getting the point?- A study in pointing gesture in the English as a Second Language classroom- (2008)
  • Author(s): Rumme, P., Saito, H., Ito, H., Oi, M., Lepe, A
  • Organizer: 日本認知科学会第25回大会発表論文
  • Place of Presentation: 京都(同志社大学)
  • Year and Date: 2008-09-07
• [Presentation] 物語の伝達とその再生におけるジェスチャーの役割:ジェスチャー産出の制限と遅延聴覚フィードバックの効果 (2008)
  • Author(s): 齋藤洋典、加納研司、井藤寛志、大井京
  • Organizer: 日本認知科学会第25回大会
  • Place of Presentation: 京都(同志社大学)
  • Year and Date: 2008-09-07
• [Presentation] 業務遂行能力に着目した職業人教育の評価 (2008)
  • Author(s): 山本雅基、齋藤洋典
  • Organizer: 日本認知科学会第25回大会
  • Place of Presentation: 京都(同志社大学)
  • Year and Date: 2008-09-06
• [Presentation] Imitation of Meaningless Gestures (2008)
  • Author(s): Lepe, A., Saito, H., Kawano, N., Oi, M., Rumme, P
  • Organizer: 6th International Conference of Cognitive Science
  • Place of Presentation: Seoul, Korea
  • Year and Date: 2008-07-29
• [Presentation] True imitation learning of nursing actions: A NIRS study with human and dummy Patients (2008)
  • Author(s): Saito. H., Shiraishi, T., Ito, H., Shimizu, H., Oi, M., Rumme, P
  • Organizer: 6th International Conference of Cognitive Science
  • Place of Presentation: Seoul, Korea
  • Year and Date: 2008-07-29
• [Presentation] Brain response in the processing of sequentially presented meaningless postures as measured by NIRS (2008)
  • Author(s): Ito, H., Saito, H., Shiraishi, T., Shimizu, H., Yamamoto, Y
  • Organizer: 6th International Conference of Cognitive Science
  • Place of Presentation: Seoul, Korea
  • Year and Date: 2008-07-28
• [Presentation] Interference by First Language in Second language in semantic processing of interlingual homograph and cognates: A Study with functional near-infrared spectroscopy (fNIRS) (2008)
  • Author(s): Oi, M., Saito, H., Ito, H., Rumme, P
  • Organizer: 6th International Conference of Cognitive Science
  • Place of Presentation: Seoul, Korea
  • Year and Date: 2008-07-28
• [Presentation] Gestures as effective teaching tools: Are students getting the point?- An experiment in gesture in the ESL classroom- (2008)
  • Author(s): Rumme, P., Saito, H., Ito, H., Oi, M., Lepe, A
  • Organizer: 29th International Congress of Psychology
  • Place of Presentation: Berlin, German
  • Year and Date: 2008-07-24
• [Presentation] Imitation learning of nursing actions: A NIRS study with students and teacher (2008)
  • Author(s): Saito, H., Shiraishi, T., Ito, H., Oi, M
  • Organizer: 29th International Congress of Psychology
  • Place of Presentation: Berlin, German
  • Year and Date: 2008-07-23
• [Presentation] The task of imitating meaningless upper-limb movements for detecting early-stage Alzheimer's disease (2008)
  • Author(s): Kawano, N., Saito, H., Hiroyuki, U., Suzuki, Y
  • Organizer: 29th International Congress of Psychology
  • Place of Presentation: Berlin, German
  • Year and Date: 2008-07-21
• [Presentation] Dynamic interactive processing of language and action: A NIRS study with students and teacher in nursing actions (2007)
  • Author(s): Saito, H., Shiraishi, T., Ito, H., Oi, M., Rumme, P
  • Organizer: 12th International Conference on the Processing of East Asia Related Languages
  • Place of Presentation: Tainan, Taiwan
  • Year and Date: 2007-12-28
• [Presentation] Misson of Asian psychology(アジアの心理学の使命) (2007)
  • Author(s): 齋藤洋典、Hsuan Chin Chen、Jung-Oh Kim、Jong-Tsun Huang、Lin Chen
  • Organizer: 日本心理学会第71回大会
  • Place of Presentation: 東京(東洋大学)
  • Year and Date: 2007-09-20
• [Presentation] 認知機能低下と行為の障害(4)-示範者の違いが無意味肢節動作の模倣行動に及ぼす影響の検討- (2007)
  • Author(s): 河野直子、Lepe Alberto、齋藤洋典
  • Organizer: 日本心理学会第71回大会
  • Place of Presentation: 東京(東洋大学)
  • Year and Date: 2007-09-19
• [Presentation] ジェスチャー産出の制限が発話の流暢性と内容の想起に及ぼす影響 (2007)
  • Author(s): 井藤寛志、加納研司、齋藤洋典
  • Organizer: 日本心理学会第71回大会
  • Place of Presentation: 東京(東洋大学)
  • Year and Date: 2007-09-18
• [Presentation] 二言語併用者の言語処理の研究(V):日本語辞書と中国語辞書の対照による日中同形語の語義調査 (2007)
  • Author(s): 大井京、齋藤洋典
  • Organizer: 日本心理学会第71回大会
  • Place of Presentation: 東京(東洋大学)
  • Year and Date: 2007-09-18
• [Presentation] 認知と行為に関する研究(6)「想起」した看護動作の模倣におけるNIRSを用いた特徴分析 (2007)
  • Author(s): 齋藤洋典、白石知子、大井京、井藤寛志
  • Organizer: 日本心理学会第71回大会
  • Place of Presentation: 東京(東洋大学
  • Year and Date: 2007-09-18
• [Presentation] 組込みプログラミング教育における受講者と上司からの教育効果評価 (2007)
  • Author(s): 山本雅基、齋藤洋典
  • Organizer: 日本認知科学会第24回大会
  • Place of Presentation: 東京(成城大学)
  • Year and Date: 2007-09-04
• [Presentation] 発話に伴って生起するジェスチャーの役割:アニメーション伝達課題と伝達内容の再生課題によるビート機能の検討 (2007)
  • Author(s): 加納研司、齋藤洋典、井藤寛志、大井京
  • Organizer: 日本認知科学会第24回大会
  • Place of Presentation: 東京(成城大学)
  • Year and Date: 2007-09-03
• [Presentation] Do live and video-taped demonstrations of meaningless hand gestures have the same effect on imitation? (2007)
  • Author(s): Lepe, A., Saito, H., Kawano, N., Oi, M, Rumme, P
  • Organizer: International Symposium on Skill Science 2007
  • Place of Presentation: Tokyo, Japan
  • Year and Date: 2007-07-19
• [Presentation] Interference between first language and second language in the word-sentence congruency task (2007)
  • Author(s): Oi, M., Saito, H
  • Organizer: 14th Annual Meeting Society for the Scientific Study of Reading
  • Place of Presentation: Prague, Czech
  • Year and Date: 2007-07-12
• [Presentation] Disassembly and Assembly of Kanji Readings (2007)
  • Author(s): Saito, H., Kawakami, M., Masuda, H
  • Organizer: 14th Annual Meeting Society for the Scientific Study of Reading
  • Place of Presentation: Prague, Czech
  • Year and Date: 2007-07-12