• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Free-hand multi-modal interaction with floating images

Research Project

Project/Area Number 23500161
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Media informatics/Database
Research InstitutionKobe Institute of Computing / Graduate School of Information Technology

Principal Investigator

MARKON Sandor  神戸情報大学院大学, システム情報工学研究科(系), 教授 (30434971)

Co-Investigator(Kenkyū-buntansha) KUWANO Mitsuhiro  神戸情報大学院大学, システム情報工学研究科(系), 准教授 (50434973)
YOSHIDA Hiroya  神戸情報大学院大学, システム情報工学研究科(系), 講師 (00461153)
OHTERA Ryo  神戸情報大学院大学, システム情報工学研究科(系), 助教 (50590410)
Project Period (FY) 2011-04-28 – 2015-03-31
Project Status Completed (Fiscal Year 2014)
Budget Amount *help
¥5,070,000 (Direct Cost: ¥3,900,000、Indirect Cost: ¥1,170,000)
Fiscal Year 2013: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2012: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Fiscal Year 2011: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Keywords空中映像 / 多感覚刺激 / インタラクション / アミューズメント / 医療データ可視化 / 触覚刺激 / 聴覚刺激 / 医療可視化 / 触覚 / 聴覚 / エンターテインメント / 国際研究者交流 トルコ / 多感覚インタラクション / 医療情報可視化 / 国際情報交流
Outline of Final Research Achievements

We have developed a system to study multimodal interaction with floating images by combining them with floating touch and floating sound stimulation. We have found optimal parameters for floating touch stimulation with air jets, and studied the effective use for interaction. As one application area, we have studied multi-modal interaction with floating images for amusement, and performed psychological experiments with games. As another application, we have developed a medical information visualisation system combining floating images with a new type of haptic stimulation device. We have also developed fingertip detection methods for interacting with the floating images. We have presented the results at international conferences and received Best Paper Award two times. The developed basic technology is expected to lead to new products in amusement and in medical visualisation.

Report

(5 results)
  • 2014 Annual Research Report   Final Research Report ( PDF )
  • 2013 Research-status Report
  • 2012 Research-status Report
  • 2011 Research-status Report
  • Research Products

    (11 results)

All 2015 2014 2013 2012 Other

All Presentation (9 results) Remarks (1 results) Patent(Industrial Property Rights) (1 results) (of which Overseas: 1 results)

  • [Presentation] Context-Oriented Medical Visualization with Floating Images2015

    • Author(s)
      Sandor Markon, Satoshi Maekawa and Ahmet Onat
    • Organizer
      9th ICME International Conference on Complex Medical Engineering (CME 2015)
    • Place of Presentation
      岡山、京都
    • Year and Date
      2015-06-18 – 2015-06-21
    • Related Report
      2014 Annual Research Report
  • [Presentation] Multi-Modal Interaction for Medical Visualization with Floating Images2014

    • Author(s)
      Sandor Markon, Satoshi Maekawa and Ahmet Onat
    • Organizer
      2014 ICME International Conference on Complex Medical Engineering (CME 2014)
    • Place of Presentation
      台北(台湾)
    • Year and Date
      2014-06-26 – 2014-06-29
    • Related Report
      2014 Annual Research Report
  • [Presentation] Multi-Modal Interaction for Medical Visualization with Floating Images2014

    • Author(s)
      S. Markon, S. Maekawa and A. Onat
    • Organizer
      2014 ICME International Conference on Complex Medical Engineering
    • Place of Presentation
      台北(台湾)
    • Related Report
      2013 Research-status Report
  • [Presentation] Improved interaction methods for medical visualization with floating images2013

    • Author(s)
      S. Markon, H. Miyake, S. Maekawa, A. Onat, and Z. Zhibo
    • Organizer
      2013 ICME International Conference on Complex Medical Engineering
    • Place of Presentation
      中国・北京
    • Related Report
      2013 Research-status Report
  • [Presentation] Sandor Markon, Satoshi Maekawa, Ahmet Onat, Zhao Zhibo, Hideaki Miyake2013

    • Author(s)
      Improved Interaction Methods for Medical Visualization with Floating Images
    • Organizer
      International Conference on Complex Medical Engineering
    • Place of Presentation
      北京・中国
    • Related Report
      2012 Research-status Report
  • [Presentation] Sandor Markon, Satoshi Maekawa, Ahmet Onat2012

    • Author(s)
      Robot-Assisted Medical Visualization with Floating Images
    • Organizer
      International Symposium on Network Enabled Health Informatics, Biomedicine and Bioinformatics
    • Place of Presentation
      イスタンブール・トルコ
    • Related Report
      2012 Research-status Report
  • [Presentation] 空気ジェットによる空中映像内触覚刺激に関する研究2012

    • Author(s)
      樋口 綾,諾明,マルコン シャンドル(神戸情報大学院大学),前川 聡(情報通信研究機構)
    • Organizer
      第 147回 ヒューマンコンピュータインタラクション研究会
    • Place of Presentation
      北陸先端科学技術大学院大学 東京サテライト
    • Related Report
      2011 Research-status Report
  • [Presentation] 空中映像と空中音源の統合に関する研究2012

    • Author(s)
      山崎 丈史,東 昌輝,マルコン シャンドル(神戸情報大学院大学),前川 聡(情報通信研究機構)
    • Organizer
      第 147回 ヒューマンコンピュータインタラクション研究会
    • Place of Presentation
      北陸先端科学技術大学院大学 東京サテライト
    • Related Report
      2011 Research-status Report
  • [Presentation] Interactive Medical Visualization with Floating Images2012

    • Author(s)
      andor Markon, Satoshi Maekawa, Ahmet Onat, Hiroshi Furukawa
    • Organizer
      2012 ICME International Conference on Complex Medical Engineering
    • Place of Presentation
      Crowne Plaza Hotel, 神戸
    • Related Report
      2011 Research-status Report
  • [Remarks] Prof. Sandor Markon has won the Best Paper award

    • URL

      http://ict4d.kic.ac.jp/en/news/20140629.html

    • Related Report
      2014 Annual Research Report
  • [Patent(Industrial Property Rights)] Reflector array optical device and display device using the same2012

    • Inventor(s)
      S. Markon and others
    • Industrial Property Rights Holder
      STANLEY ELECTR., NICT
    • Industrial Property Rights Type
      特許
    • Filing Date
      2012
    • Acquisition Date
      2014
    • Related Report
      2013 Research-status Report
    • Overseas

URL: 

Published: 2011-08-05   Modified: 2021-04-07  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi