• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Cognition of time varying environment due to multimodal information

Research Project

Project/Area Number 11480075
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionNagoya University

Principal Investigator

KAKEHI Kazuhiko  Nagoya Univ., Graduate School of Human Informatics, Prof., 大学院・人間情報学研究科, 教授 (90262930)

Co-Investigator(Kenkyū-buntansha) SAIKI Jun  Kyoto Univ. Graduate School of Informatics, Associate Prof., 大学院・情報学研究科, 助教授 (60283470)
KAWAGUCHI Jun  Nagoya Univ., Graduate School of Environment Studies, Prof., 大学院・環境学研究科, 教授 (70152931)
SHIMADA Shoji  Nagaoka University of Technology, Faculty of Engineering, Prof., 工学部, 教授 (20262462)
Project Period (FY) 1999 – 2001
Project Status Completed (Fiscal Year 2001)
Budget Amount *help
¥15,100,000 (Direct Cost: ¥15,100,000)
Fiscal Year 2001: ¥2,200,000 (Direct Cost: ¥2,200,000)
Fiscal Year 2000: ¥5,600,000 (Direct Cost: ¥5,600,000)
Fiscal Year 1999: ¥7,300,000 (Direct Cost: ¥7,300,000)
KeywordsSound localization / integration of visual and auditory information / sound field transmission / method of listening test / ecological acoustics / out-of-head sound localization / human interface / memory of schedule / 受聴試験法 / 頭外音像定位 / ヒューマニンタフェース / 視聴覚情報の対応づけ / 音源定位の時間特性 / 外耳道伝達関数 / 潜在記憶 / 外耳伝達関数
Research Abstract

The aim of this study is to investigate the superior perceptual ability of human beings for environment to realize adaptive man-machine interface to environmental situation.
( 1 ) Perception of sound environment under nearly actual situation : It is shown that sound localization due to integration of audio-visual information can Quantitatively be calculated by FLMP (Fuzzy Logical Model of Perception). The effect of cognitive discord between audio-visual information on sound localization was investigated to find out the importance of matching the audio-visual information sources. It is known that the biased sound localization is occurred in the field of plural sound sources. The occurrence conditions of the phenomenon were experimentally investigated. The characteristic of the acoustical signal was studied to make sound localization easy, We also investigated what extent we can "hear" the shape of the sound source object which is strucked by something small. The detection ability of the … More degradation due to transmission error of 2ch stereo signal was studied in the case of binaural and loudspeaker listening respectively.
( 2 ) Reproducing technique of sound fields and its evaluation method. The kinds of sound source signal and the evaluation method of sound fields were investigated to make the evaluation accurate. The goal of this study is to establish the standard method of sound localization evaluation for both binaural b and sound field listening. The conditionswhichmage the estimation accurate was determined. The fast calculationmethod of transfer function was developed to construct the system of out-of-head sound localization. A new highly bit reduced transmission system for reproduction of sound fields was proposed using the estimation techniaue of sound source signals.
( 3 ) Cognitive mechanism related to human interface based on attention and emotion system The influence of use of external memory aids on memory for schedule was studied to clarity the interaction between outside environment and cognition. It is discovered that schedule memory in morning and evening is retained better than that in daytime throughout a day. The emotional informalion of prosodywas analyzed to findout the language dependence. The physiological basis of cognitive process for facial expression was also investigated using fMRI and ERP. The increase of utterance latency was discovered when the talker was adapted to DAF (Delayed Auditory Feedback). It was found that a talker feels more familiar to amachine which responds withnon-segmental sound which echoicly imitated some prosodic aspects of the talker. Less

Report

(4 results)
  • 2001 Annual Research Report   Final Research Report Summary
  • 2000 Annual Research Report
  • 1999 Annual Research Report
  • Research Products

    (33 results)

All Other

All Publications (33 results)

  • [Publications] 西田鶴代, 筧一彦, 穂刈治英, 島田正治: "音源定位における視覚情報の影響 -FLMPによる視覚情報の影響の定量化-"日本音響学会誌. 55・11. 735-741 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 黄倉雅広, 筧一彦: "聴覚へのエコロジカルアプローチ"日本音響学会誌. 56・3. 209-214 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 筧一彦: "人間と機械の音声認識 -音声聴覚研究の学際性-"認知科学. 8・3. 207-211 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 櫻庭京子, 今泉敏, 筧一彦: "音声による感情表現の発達的研究"音声言語医学. 43・1. 1-8 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 藤井洋之, 筧一彦: "視聴覚情報の統合的知覚 -音源定位課題による検討-"日本音響学会誌. 58・4(in press). (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Watanabe, H., Kawaguchi, J.: "Planning over the day span : Memory for the center of plans"Applied Cognitive Psychology. (in press).

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 筧一彦: "映像情報メディアハンドブック マルチメディアシステムの人間科学/ヒトの情報処理モデル"映像メディア学会編 オーム社. 566-570 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Nishida, T. KAKEHI. K. HOKARI, H. SHIMADA, S.: "The effect of the visual information on sound source localization -- A quantative estimation of the visual information effect by FLMP --"The Journal of the Acoustical Society of Japan. 55,11. 735-741 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] KAKEHI. K: "Speech recognition by man and machine - Inter disciplinary nature of speech perception research -"The Journal of the Acoustical Society of Japan. 56,3. 209-214 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] SAKURA, K., IMAIZUMI,. S., KAKEHI, K.: "Development changes in Vocal Expression of Emotions"Cognitive Studies. 8,3. 207-211 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] FUJII, H. KAKEHI, K.: "The perceptual integration of Auditory- visual information in a sound localization task"The Journal of the Acoustical Society of Japan. 58,4(in press).

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] WATANABE. H. KAWAGUCHI, J.: "Planning over the day span : Memory for the center of plans"Applied Cognitive Psychology. (in press).

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 西田鶴代, 筧一彦, 穗刈治英, 島田正治: "音源定位における視覚情報の影響 -FLMPによる視覚情報の影響の定量化-"日本音響学会誌. 55・11. 735-741 (1999)

    • Related Report
      2001 Annual Research Report
  • [Publications] 黄倉雅広, 筧一彦: "聴覚へのエコロジカルアプローチ"日本音響学会誌. 56・3. 209-214 (2000)

    • Related Report
      2001 Annual Research Report
  • [Publications] 筧一彦: "人間と機械の音声認識 -音声聴覚研究の学際性-"認知科学. 8・3. 207-211 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 櫻庭京子, 今泉敏, 筧一彦: "音声による感情表現の発達的研究"音声言語医学. 43・1. 1-8 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 藤井洋之, 筧一彦: "視聴覚情報の統合的知覚 -音源定位課題による検討-"日本音響学会誌. 58・4(in press). (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] Watanabe, H., Kawaguchi, J.: "Planning over the day span : Memory for the center of plans"Applied Cognitive Psychology. (in press).

    • Related Report
      2001 Annual Research Report
  • [Publications] 筧一彦: "映像情報メディアハンドブック マルチメディアシステムの人間科学/ヒトの情報処理モデル"映像メディア学会編 オーム社. 566-570 (2000)

    • Related Report
      2001 Annual Research Report
  • [Publications] H.Fujii,K.Kakehi: "Effect of the non-target sound source on the target sound source localization"Proceedings of International Conference on Psychology 2000. 53 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 藤井洋之,筧一彦: "2音同時呈示条件における音源定位-相対的位置関係と定位位置-"音響学会聴覚研究会資料. H-2000-83. 1-7 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 堀内俊治,穂刈治英,島田正治: "音像定位受聴試験の実験法に関する研究"信学技報. EA-2000-51. 1-8 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 別府大幸,穂刈治英,島田正治: "適応逆フィルタを用いた頭外音像定位に関する検討"信学技報. EA-2000-52. 9-16 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 石附達也,穂刈治英,島田正治: "HRTFにおける最小位相モデルの適用に関する検討"信学技報. EA-2000-85. 33-40 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] H.Watanabe,J.Kawaguchi: "Priming over the day span : Memory for the content of Plans"Applied Cognitive Psychology.

    • Related Report
      2000 Annual Research Report
  • [Publications] 筧一彦(映像情報メディア学会編): "ヒトの情報処理モデル(映像情報メディアハンドブック)"オーム社. 5(652) (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 川口潤(甘利俊一・外山敬介編): "非言語情報の潜在記憶(脳科学大事典)"朝倉書店. (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 西田鶴代,筧 一彦 穂刈治英,島田正治: "音源定位における視覚情報の影響-FLMPによる視覚情報の影響の定量化-"日本音響学会誌. 55・11. 735-741 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] H. Fujii & K. Kakehi: "The Effect of Talker Charateristics in the Ventriloquist Condition"Proceedings of the 2nd International Conference on Cognitive Science. 1124-1127 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 伊藤継俊,筧 一彦: "衝撃音の知覚"音響学会聴覚研究会資料. H-2000-13. 1-8 (2000)

    • Related Report
      1999 Annual Research Report
  • [Publications] 石田朋也,筧 一彦: "周波数帯域の異なる2音源が相互の移動感に及ぼす影響"信学技報. SP99-679. 1-7 (2000)

    • Related Report
      1999 Annual Research Report
  • [Publications] S. Yano,H. Hokari & S. Shimada: "A Study on Personal Difference in the Transfer Functions of Sound Localization"Proceedings of the 106th Convention of Acoustical Engineering Society. 4922. 8-11 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 川口 潤: "認知情報処理における文脈効果と知識処理・自動的処理"風間書房. 214 (1999)

    • Related Report
      1999 Annual Research Report

URL: 

Published: 1999-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi