Development of new platform for cognitive experiments using virtual reality techniques

• Project/Area Number: 23650141
• Research Category: Grant-in-Aid for Challenging Exploratory Research
• Allocation Type: Multi-year Fund
• Research Field: Cognitive science
• Research Institution: The Institute of Physical and Chemical Research
• Principal Investigator: WAKISAKA SOHEI 独立行政法人理化学研究所, 脳科学総合研究センター, 研究員 (40513445)
• Project Period (FY): 2011 – 2013
• Project Status: Completed (Fiscal Year 2013)
• Budget Amount: ¥4,030,000 (Direct Cost: ¥3,100,000、Indirect Cost: ¥930,000); Fiscal Year 2013: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000); Fiscal Year 2012: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000); Fiscal Year 2011: ¥2,730,000 (Direct Cost: ¥2,100,000、Indirect Cost: ¥630,000)
• Keywords: ヒューマンインターフェイス / 代替現実 / 仮想現実 / 体験型成果発表 / 認知心理学 / アミューズメント / ヴァーチャルリアリティ / 認知実験

Research Abstract

We developed the second version of substitutional reality system, which enables 'covert substitution' of participants' reality, employing immersive virtual reality techniques and panoramic video camera system. In addition to the enhancement of basic features such as visual resolutions, we add (1) eye-tracker system, (2) floor vibration emulation, (3) open sound protocol (OSC) based extensibility, etc. We also had several applications of the new system: (1) Contemporary performing arts at Miraikan, (2) Experimental digital signage with SONY corporation at Tokyo Game Show, etc. Finally, we have a permanent exhibition of the outcome of the research at the Advanced Technology Exhibition Hall@TEPIA (Association of Technological Excellence Promoting Innovative Advances).

Research Products

• [Journal Article] Reality jockey: lifting the barrier between alternate realities through audio and haptic feedback. (2013)
  • Author(s): K. Fan, H. Izumi, Y. Sugiura, K. Minamizawa, S. Wakisaka, M. Inami, N. Fujii, and S. Tachi.
  • Journal Title: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems Volume: 2013 Pages: 2557-2566
  • DOI: 10.1145/2470654.2481353
  • Peer Reviewed
• [Journal Article] Substitutional Reality System: A Novel Experimental Platform for Experiencing Alternative Reality (2012)
  • Author(s): Keisuke Suzuki, Sohei Wakisaka and Naotaka Fujii
  • Journal Title: Scientific Reports Volume: 2 Issue: 1 Pages: 459-459
  • DOI: 10.1038/srep00459
  • Peer Reviewed
• [Presentation] 内部観測体験装置としての代替現実システム (2013)
  • Author(s): 脇坂崇平
  • Organizer: 人工知能学会
  • Place of Presentation: 富山
  • Year and Date: 2013-06-05
• [Presentation] 代替現実と内部観測 (2013)
  • Author(s): 脇坂崇平
  • Organizer: 内部観測研究会
  • Place of Presentation: 埼玉
  • Year and Date: 2013-03-03
• [Presentation] SRシステム これまでにない新しい体験プラットフォームの可能性を探る (2013)
  • Author(s): 脇坂崇平, 藤井直敬
  • Organizer: CEDEC2013
  • Place of Presentation: パシフィコ横浜・神奈川
  • Invited
• [Presentation] AIx認知科学 (2013)
  • Author(s): 脇坂崇平, 三宅陽一郎, 竹内ゆうすけ
  • Organizer: CEDEC2013
  • Place of Presentation: パシフィコ横浜・神奈川
• [Presentation] 内部観測体験装置としてのSRシステム (2013)
  • Author(s): 脇坂崇平
  • Organizer: 人工知能学会
  • Place of Presentation: 富山国際会議場・富山
• [Presentation] 代替現実と内部観測 (2013)
  • Author(s): 脇坂崇平
  • Organizer: 内部観測研究会
  • Place of Presentation: 理化学研究所（和光）
• [Presentation] 代替現実システムにおける臨場感と現実感 (2012)
  • Author(s): 脇坂崇平, 藤井直敬
  • Organizer: 高臨場感ディスプレイフォーラム予
  • Place of Presentation: 東京
  • Year and Date: 2012-11-06
  • Invited
• [Presentation] 第2世代・代替現実(SR)システム (2012)
  • Author(s): 脇坂崇平, 石黒祥生, 上野道彦, 樋口啓, FAN Szu-Wen, 泉秀幸, 南 澤孝太, 杉浦裕太, 稲見昌彦, 藤井直敬
  • Organizer: 第17回日本バーチャルリアリティ学会大会
  • Place of Presentation: 神奈川
  • Year and Date: 2012-09-14
• [Presentation] 代替現実システムとその認知心理実験装置としての応用 (2012)
  • Author(s): 脇坂崇平
  • Organizer: ICS2-7 犬山比較社会認知シンポジウム
  • Place of Presentation: 愛知
  • Year and Date: 2012-03-24
• [Presentation] 代替現実(Substitutional Substitutional : SR)システム (2012)
  • Author(s): 理化学研究所脳科学総合研究センター適応知性研究チーム
  • Organizer: Digital Contents Expo 2012
  • Place of Presentation: 東京
  • Invited
• [Presentation] 代替現実システムにおける臨場感と現実感 (2012)
  • Author(s): 脇坂崇平, 藤井直敬
  • Organizer: 高臨場感ディスプレイフォーラム
  • Place of Presentation: 工学院大学（新宿）
  • Invited
• [Presentation] 第二世代・代替現実システム (2012)
  • Author(s): 脇坂崇平, 藤井直敬
  • Organizer: ヴァーチャルリアリティ学会年会
  • Place of Presentation: 慶応大学（日吉）
• [Presentation] 代替現実システムとその認知心理実験装置としての応用 (2012)
  • Author(s): 脇坂崇平
  • Organizer: 第7回犬山比較社会認知シンポジウム
  • Place of Presentation: 愛知
• [Presentation] Substitutional reality: A new experimental platform for psychological and cognitive experiments (2011)
  • Author(s): Sohei Wakisaka, Keisuke Suzuki and Naotaka Fujii
  • Organizer: Annual meeting of society for neuroscience
  • Place of Presentation: Washington DC, USA
• [Presentation] Reality Substitution Platform and its Application to Research on Déjà Vu Experience (2011)
  • Author(s): Sohei Wakisaka, Keisuke Suzuki and Naotaka Fujii
  • Organizer: Annual meeting of ASSC 2012
  • Place of Presentation: Kyoto, Japan
• [Remarks] 先端技術館＠TEPIA テーマ展示
  • URL: http://www.tepia.jp/exhibition/studio2.html