Clarification of mechanism of capturing events presented peripheral area based on auditory, visual, and somatic sensations

• Project/Area Number: 24683026
• Research Category: Grant-in-Aid for Young Scientists (A)
• Allocation Type: Partial Multi-year Fund
• Research Field: Experimental psychology
• Research Institution: Japan Advanced Institute of Science and Technology
• Principal Investigator: Miyauchi Ryota 北陸先端科学技術大学院大学, 情報科学研究科, 助教 (30455852)
• Project Period (FY): 2012-04-01 – 2016-03-31
• Project Status: Completed (Fiscal Year 2015)
• Budget Amount: ¥17,290,000 (Direct Cost: ¥13,300,000、Indirect Cost: ¥3,990,000); Fiscal Year 2015: ¥2,600,000 (Direct Cost: ¥2,000,000、Indirect Cost: ¥600,000); Fiscal Year 2014: ¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000); Fiscal Year 2013: ¥5,590,000 (Direct Cost: ¥4,300,000、Indirect Cost: ¥1,290,000); Fiscal Year 2012: ¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000)
• Keywords: 視聴覚統合 / 空間知覚 / 聴覚的注意 / 身体運動 / マルチモーダル感覚統合 / 周辺空間知覚 / 知覚と運動 / 選択的注意 / 時空間統合

Outline of Final Research Achievements

Human can perceive visual and auditory information originated with various events surrounding them, and recognize the events based on the percept. In the present study, to examine multimodal (auditory, visual, and somatosensory) interaction and cognitive process of the events, psychological experiments were conducted. The results showed that perceptual directions of auditory and visual stimuli were different, whereas these stimuli were presented from the same direction. The discrepancy between auditory and visual perceptual directions cannot be explained by the differences of modality specific features of each audition and vision. It is considered to be caused by the interaction between audition, vision, and somatic sensation.

Research Products

• [Journal Article] Relative localization of auditory and visual events presented in peripheral visual field (2014)
  • Author(s): Ryota Miyauchi, Dea-Gee Kang, Yukio Iwaya, & Yoiti Suzuki
  • Journal Title: Multisensory Research, Volume: 27 Pages: 1-16
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Relative localization of auditory and visual events presented in peripheral visual field (2014)
  • Author(s): Ryota Miyauchi, Dea-Gee Kang, Yukio Iwaya, and Yoiti Suzuki
  • Journal Title: Multisensory Research Volume: 24 Issue: 1 Pages: 1-16
  • DOI: 10.1163/22134808-00002442
  • Peer Reviewed
• [Presentation] 変調フィルタバンクを用いた感情音声における変調スペクトルの特徴解析 (2016)
  • Author(s): 朱治・宮内良太・鵜木祐史
  • Organizer: 日本音響学会 2016 年春季研究発表会
  • Place of Presentation: 桐蔭横浜大学，神奈川県横浜市
  • Year and Date: 2016-03-09
• [Presentation] Study on effects of speech production during delayed auditory feedback for air-conducted and bone-conducted speech (2016)
  • Author(s): Teruki Toya, Daisuke Ishikawa, Ryota Miyauchi, Kazushi Nishimoto, & Masashi Unoki
  • Organizer: RIST International workshop on Nonlinear Circuite and Signal Processing
  • Place of Presentation: Hilton Waikiki Beach Hotel, Honolulu, Hawaii
  • Year and Date: 2016-03-06
  • Int'l Joint Research
• [Presentation] 雑音駆動音声の感情知覚と振幅包絡線情報の関係に関する検討 (2016)
  • Author(s): 朱治・宮内良太・荒木友希子・鵜木祐史
  • Organizer: 日本音響学会聴覚研究会
  • Place of Presentation: 九州大学，福岡県福岡市
  • Year and Date: 2016-03-04
• [Presentation] 様々な刺激を呈示して測定した耳音響放射音の特徴解析 (2016)
  • Author(s): 宮内良太・木谷俊介・鵜木祐史
  • Organizer: 日本音響学会聴覚研究会
  • Place of Presentation: 九州大学，福岡県福岡市
  • Year and Date: 2016-03-04
• [Presentation] Analysis of modulation-spectral features extracted from Japanese emotional speech (2015)
  • Author(s): Zhi Zhu, Ryota Miyauchi, and Mavashi Enoki
  • Organizer: Taiwan/Japan Research Meeting on Psychological & Physiological Acoustics and Electroacoustics
  • Place of Presentation: 台湾国立清華大学，Hshinchu，Taiwan
  • Year and Date: 2015-10-23
  • Int'l Joint Research
• [Presentation] 心理物理的同調曲線による抑圧性マスキングの検討 (2015)
  • Author(s): 鳥谷輝樹・宮内良太・鵜木祐史
  • Organizer: 平成27年度電気関係学会北陸支部連合大会
  • Place of Presentation: 金沢工業大学，石川県野々市市
  • Year and Date: 2015-09-12
• [Presentation] 雑音駆動音声の個人性知覚に関する基礎的検討 (2015)
  • Author(s): 朱治・宮内良太・鵜木祐史
  • Organizer: 平成27年度電気関係学会北陸支部連合大会
  • Place of Presentation: 金沢工業大学，石川県野々市市
  • Year and Date: 2015-09-12
• [Presentation] 変調スペクトルの帯域を制限した雑音駆動音声の個人性知覚に関する研究 (2015)
  • Author(s): 朱治・宮内良太・鵜木祐史
  • Organizer: 日本音響学会 2015 年春季研究発表会
  • Place of Presentation: 中央大学後楽園キャンパス（東京都文京区）
  • Year and Date: 2015-03-16 – 2015-03-18
• [Presentation] Analysis of speaker individual differences on modulation spectrum (2015)
  • Author(s): Zhi Zhu, Ryota Miyauchi, & Masashi Unoki
  • Organizer: 2015 RISP International workshop on Nonlinear Circuits and Signal Processing
  • Place of Presentation: Kuala Lumpur, Malaysia
  • Year and Date: 2015-02-27 – 2015-03-02
• [Presentation] 音列時間パターンが音像定位位置に与える影響 (2015)
  • Author(s): 宮内良太
  • Organizer: 日本音響学会聴覚研究会
  • Place of Presentation: 愛媛大学（愛媛県松山市）
  • Year and Date: 2015-02-13 – 2015-02-14
• [Presentation] 音声の変調スペクトルに現れる個人差の分析 (2014)
  • Author(s): 朱治・宮内良太・鵜木祐史
  • Organizer: 日本音響学会聴覚研究会
  • Place of Presentation: ホテルシーモア（和歌山県牟婁郡白浜町）
  • Year and Date: 2014-10-23 – 2014-10-24
• [Presentation] 情報科学と心理学 (2014)
  • Author(s): 宮内良太
  • Organizer: 北陸心理学会第 49 回大会公開シンポジウム
  • Place of Presentation: 金沢工業大学扇が丘キャンパス（石川県野々市市）
  • Year and Date: 2014-10-18
  • Invited
• [Presentation] Sound and flash localizations in peripheral directions (2014)
  • Author(s): Ryota Miyauchi, Kang Dea-Gee, Yukio Iwaya, & Yoiti Suzuki
  • Organizer: Forum Acusticum 2014
  • Place of Presentation: Krakow, Poland
  • Year and Date: 2014-09-07 – 2014-09-12
  • Invited
• [Presentation] Study on linguistic information contained in temporal amplitude envelope of Japanese speech signals (2014)
  • Author(s): Yasutaka Nishino, Ryota Miyauchi, and Masashi Unoki
  • Organizer: RISP International workshop on Nonlinear Circuits and Signal Processing
  • Place of Presentation: Waikiki Beach Marriott Hotel, Hawaii, U.S.A.
• [Presentation] 振幅包絡の変調成分の制御が日本語音声の子音知覚に与える影響の検討 (2014)
  • Author(s): 西野恭生・宮内良太・鵜木祐史
  • Organizer: 日本音響学会 2014 年春季研究発表会
  • Place of Presentation: 日本大学駿河台キャンパス，東京
• [Presentation] 耳音響放射を用いた聴覚的注意の測定手法に関する予備的検討 (2014)
  • Author(s): 木谷俊介・濵田康弘・宮内良太・鵜木祐史
  • Organizer: 日本音響学会聴覚研究会
  • Place of Presentation: 那覇市IT創造館，沖縄
• [Presentation] Study on effects of presence of cue-tone on psychophysical tuning curves (2013)
  • Author(s): Shunsuke Kidani, Ryota Miyauchi, and Masashi Unoki
  • Organizer: International Congress on Acoustics
  • Place of Presentation: Palais des congres, Montreal, Canada
• [Presentation] 日本語音声の子音知覚は振幅包絡の変調成分の制御により変化するのか？ (2013)
  • Author(s): 西野恭生・宮内良太・鵜木祐史
  • Organizer: 日本音響学会聴覚研究会
  • Place of Presentation: 神戸セミナーハウス，神戸
• [Presentation] 音声の振幅包絡の変調成分が言語情報の取得に与える影響 (2013)
  • Author(s): 西野恭生・宮内良太・鵜木祐史
  • Organizer: 平成25年度電気関係学会北陸支部連合大会
  • Place of Presentation: 金沢大学サテライトプラザ，金沢
• [Presentation] 心理物理的同調曲線における手がかり音呈示の効果の検討 (2013)
  • Author(s): 木谷俊介・宮内良太・鵜木祐史
  • Organizer: 日本音響学会2013年春期研究発表会
  • Place of Presentation: 東京工科大学八王子キャンパス
• [Presentation] 同側耳への手がかり音の呈示による心理物理的同調曲線の変化に関する検討 (2013)
  • Author(s): 木谷俊介・宮内良太・鵜木祐史
  • Organizer: 日本音響学会聴覚研究会
  • Place of Presentation: 金沢大学サテライト・プラザ
• [Presentation] Effect of presentation of cue tones on active tuning of auditory filters derived from simultaneous notched-noise masking (2012)
  • Author(s): Shunsuke Kidani, Rvota Mivauchi, and Masashi Unoki
  • Organizer: International Symposium on Hearing
  • Place of Presentation: St Johns College, Cambridge, U.K.
• [Presentation] Robustness of audio-visual localization disparity in the peripheral fields (2012)
  • Author(s): Rvota Mivauchi. Dae-Gee Kang, Yukio Iwaya, and Y&iti Suzuki
  • Organizer: Acoustics 2012 Hong Kong
  • Place of Presentation: Hong Kong Convention and Exhibition Centre, Hong Kong