• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of advanced virtual audio-visual space reproduction technology using human perceptual process concerning external recognition

Research Project

Project/Area Number 26280067
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypePartial Multi-year Fund
Section一般
Research Field Human interface and interaction
Research InstitutionTohoku University

Principal Investigator

Sakamoto Shuichi  東北大学, 電気通信研究所, 准教授 (60332524)

Co-Investigator(Kenkyū-buntansha) 寺本 渉  熊本大学, 文学部, 准教授 (30509089)
Project Period (FY) 2014-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥16,120,000 (Direct Cost: ¥12,400,000、Indirect Cost: ¥3,720,000)
Fiscal Year 2016: ¥3,900,000 (Direct Cost: ¥3,000,000、Indirect Cost: ¥900,000)
Fiscal Year 2015: ¥6,240,000 (Direct Cost: ¥4,800,000、Indirect Cost: ¥1,440,000)
Fiscal Year 2014: ¥5,980,000 (Direct Cost: ¥4,600,000、Indirect Cost: ¥1,380,000)
Keywordsバーチャルリアリティ / マルチモーダルインタフェース / 認知科学 / 情報システム
Outline of Final Research Achievements

The purpose of this research is to investigate the human perceptual process concerning the interaction among auditory, visual, and vestibular information. This knowledge is also used to develop three-dimensional audio-visual space reproduction technology, which is a very important part of virtual reality systems. The results of the experiments indicated that these three types of sensory information are closely integrated when people are moving. This interaction plays an important role for human to perceive the external world stably. The results also revealed that they sensitively perceive the approaching motion of a sound-object when people are moving forward. This observation would be ecologically reasonable to escape from approaching object. These findings are crucially important to synthesize accurate and real virtual spaces.

Report

(4 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Annual Research Report
  • 2014 Annual Research Report
  • Research Products

    (24 results)

All 2017 2016 2015 2014 Other

All Int'l Joint Research (1 results) Journal Article (10 results) (of which Peer Reviewed: 3 results,  Acknowledgement Compliant: 10 results) Presentation (13 results) (of which Int'l Joint Research: 7 results,  Invited: 4 results)

  • [Int'l Joint Research] Technical University Dresden(Germany)

    • Related Report
      2016 Annual Research Report
  • [Journal Article] 多感覚コンテンツの高次感性知覚に音情報から生成した振動情報が及ぼす影響2017

    • Author(s)
      崔正烈,柳生寛幸,坂本修一,行場次朗,鈴木陽一
    • Journal Title

      電子情報通信学会技術研究報告

      Volume: EMM2016-97 Pages: 61-66

    • Related Report
      2016 Annual Research Report
    • Acknowledgement Compliant
  • [Journal Article] 直線加速度運動中における接近および後退音の音像定位弁別限の差異2017

    • Author(s)
      野田美春,坂本修一,崔正烈,寺本渉,鈴木陽一,行場次朗
    • Journal Title

      平成29年東北地区若手研究者研究発表会

      Volume: YS29-2-3-6 Pages: 71-72

    • Related Report
      2016 Annual Research Report
    • Acknowledgement Compliant
  • [Journal Article] Effects of vibration information on the sense of presence and verisimilitude of audio-visual scenes2016

    • Author(s)
      S. Sakamoto, Z. Cui, T. Ohtani, Y. Suzuki, and J. Gyoba
    • Journal Title

      Proc. internoise2016

      Volume: Mon:18-2-5 Pages: 1777-1782

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] 生成振動情報を含む多感覚コンテンツの高次感性評価2016

    • Author(s)
      S. Sakamoto, H. Yagyu, Z. Cui, T. Ohtani, Y. Suzuki, and J. Gyoba
    • Journal Title

      Proc. 12th International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP 2016)

      Volume: IIHMSP-2016-IS08-5

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] 生成振動情報を含む多感覚コンテンツの高次感性評価2016

    • Author(s)
      柳生寛幸,崔正烈,坂本修一,鈴木陽一,行場次朗
    • Journal Title

      電子情報通信学会技術研究報告

      Volume: HIP2016-66 Pages: 25-28

    • Related Report
      2016 Annual Research Report
    • Acknowledgement Compliant
  • [Journal Article] 音情報から生成した振動情報が多感覚コンテンツの高次感性評価に与える影響2016

    • Author(s)
      柳生寛幸,崔正烈,坂本修一,鈴木陽一,行場次朗
    • Journal Title

      日本バーチャルリアリティ学会第21回大会論文集

      Volume: 34B-04

    • Related Report
      2016 Annual Research Report
    • Acknowledgement Compliant
  • [Journal Article] 上下方向ベクション知覚中の正中面音像定位2016

    • Author(s)
      崔正烈,坂本修一,鈴木陽一
    • Journal Title

      日本音響学会聴覚研究会資料

      Volume: H-2016-4 Pages: 11-14

    • Related Report
      2015 Annual Research Report
    • Acknowledgement Compliant
  • [Journal Article] 横方向への直線等加速度運動が音空間知覚に与える影響2015

    • Author(s)
      花篭慶史,坂本修一,寺本渉,鈴木陽一,行場次朗
    • Journal Title

      日本音響学会聴覚研究会資料

      Volume: H-2015-115 Pages: 653-657

    • Related Report
      2015 Annual Research Report
    • Acknowledgement Compliant
  • [Journal Article] 刺激音の時間長が自己運動中の音空間知覚に与える影響2014

    • Author(s)
      花篭慶史,坂本修一,寺本渉,鈴木陽一
    • Journal Title

      平成26年度電気関係学会東北支部連合大会講演論文集

      Volume: なし Pages: 126-126

    • NAID

      130005478527

    • Related Report
      2014 Annual Research Report
    • Acknowledgement Compliant
  • [Journal Article] Auditory space perception during linearly self-motion2014

    • Author(s)
      Shuichi Sakamoto, Wataru Teramoto and Jiro Gyoba
    • Journal Title

      Proc. 7th Forum Acusticum 2014 (FA2014)

      Volume: なし

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] 多感覚コンテンツの高次感性知覚に音情報から生成した振動情報が及ぼす影響2017

    • Author(s)
      崔正烈,柳生寛幸,坂本修一,行場次朗,鈴木陽一
    • Organizer
      電子情報通信学会マルチメディア情報ハイディング・エンリッチメント研究会
    • Place of Presentation
      宮古島マリンターミナルビル,宮古島市
    • Year and Date
      2017-03-06
    • Related Report
      2016 Annual Research Report
  • [Presentation] 直線加速度運動中における接近および後退音の音像定位弁別限の差異2017

    • Author(s)
      野田美春,坂本修一,崔正烈,寺本渉,鈴木陽一,行場次朗
    • Organizer
      平成29年東北地区若手研究者研究発表会
    • Place of Presentation
      東北学院大学,多賀城市
    • Related Report
      2016 Annual Research Report
  • [Presentation] 生成振動情報を含む多感覚コンテンツの高次感性評価2016

    • Author(s)
      柳生寛幸,崔正烈,坂本修一,鈴木陽一,行場次朗
    • Organizer
      電子情報通信学会ヒューマン情報処理研究会
    • Place of Presentation
      東北大学,仙台市
    • Year and Date
      2016-12-20
    • Related Report
      2016 Annual Research Report
  • [Presentation] Auditory space perception during self-motion2016

    • Author(s)
      S. Sakamoto, W. Teramoto, A. Honda, Y. Suzuki, and J. Gyoba
    • Organizer
      5th Joint Meeting of the Acoustical Society of America and the Acoustical Society of Japan
    • Place of Presentation
      Hawaii, USA
    • Year and Date
      2016-11-28
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Temporal characteristics of perceived reality of multimodal contents2016

    • Author(s)
      S. Sakamoto, H. Yagyu, Z. Cui, T. Ohtani, Y. Suzuki, and J. Gyoba
    • Organizer
      12th International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP 2016)
    • Place of Presentation
      Kaohsiung, Taiwan
    • Year and Date
      2016-11-21
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 音情報から生成した振動情報が多感覚コンテンツの高次感性評価に与える影響2016

    • Author(s)
      柳生寛幸,崔正烈,坂本修一,鈴木陽一,行場次朗
    • Organizer
      日本バーチャルリアリティ学会第21回大会
    • Place of Presentation
      つくば国際会議場,つくば市
    • Year and Date
      2016-09-14
    • Related Report
      2016 Annual Research Report
  • [Presentation] Effects of vibration information on the sense of presence and verisimilitude of audio-visual scenes2016

    • Author(s)
      S. Sakamoto, Z. Cui, T. Ohtani, Y. Suzuki, and J. Gyoba
    • Organizer
      internoise2016
    • Place of Presentation
      Hamburg, Germany
    • Year and Date
      2016-08-21
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Negative correlation between strength of visually induced self-motion and subsequent motion aftereffects2016

    • Author(s)
      W. Teramoto
    • Organizer
      International Congress of Psychology
    • Place of Presentation
      パシフィコ横浜,横浜市
    • Year and Date
      2016-07-24
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Effect of vertical vection on vertical sound localization2016

    • Author(s)
      Z. Cui, S. Sakamoto, and Y. Suzuki
    • Organizer
      17th International Multisensory Research Forum (IMRF)
    • Place of Presentation
      Suzhou, China
    • Year and Date
      2016-06-15
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Effect of visual and vestibular information on auditory space perception2016

    • Author(s)
      S. Sakamoto, K. Hanakago, Z. Cui, W. Teramoto, Y. Suzuki, and J. Gyoba
    • Organizer
      171st Meeting of the Acoustical Society of America
    • Place of Presentation
      Salt Lake City, USA
    • Year and Date
      2016-05-23
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Effect of visual and vestibular information on auditory space perception2016

    • Author(s)
      S. Sakamoto, K. Hanakago, Z.L. Cui, W. Teramoto, Y. Suzuki and J. Gyoba
    • Organizer
      171st Meeting of the Acoustical Society of America
    • Place of Presentation
      Salt Lake City, Utah, USA
    • Year and Date
      2016-05-23
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Auditory space perception during linearly self-motion2014

    • Author(s)
      Shuichi Sakamoto, Wataru Teramoto and Jiro Gyoba
    • Organizer
      7th Forum Acusticum 2014 (FA2014)
    • Place of Presentation
      Krakow, Poland
    • Year and Date
      2014-09-07 – 2014-09-12
    • Related Report
      2014 Annual Research Report
    • Invited
  • [Presentation] 刺激音の時間長が自己運動中の音空間知覚に与える影響2014

    • Author(s)
      花篭慶史,坂本修一,寺本渉,鈴木陽一
    • Organizer
      平成26年度電気関係学会東北支部連合大会
    • Place of Presentation
      山形大学(山形県米沢市)
    • Year and Date
      2014-08-21 – 2014-08-22
    • Related Report
      2014 Annual Research Report

URL: 

Published: 2014-04-04   Modified: 2018-03-22  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi