Functional advance and various realization of step-on interface (SOI)

2013 Fiscal Year Final Research Report

• Project/Area Number: 23560300
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: Intelligent mechanics/Mechanical systems
• Research Institution: Waseda University
• Principal Investigator: MATSUMARU Takafumi 早稲田大学, 理工学術院, 教授 (10313933)
• Project Period (FY): 2011 – 2013
• Keywords: ヒューマン・ロボット・インタラクション（HRI） / ステップ・オン・インタフェース（SOI） / プロジェクション（投影） / レンジ・スキャナ（二次元距離センサ） / 三次元深度センサ / 画像処理 / OpenCV + OpenNI / レーザー・ポインタ

Research Abstract

This project aimed to make the step-on interface (SOI) to operate robotic and mechatronic systems both higher functional (higher reliability and higher accuracy) and more diversified (realization in various forms). For high functionality, the camera image processing (recognition of a projection screen and a light spot using OpenCV) and the depth date processing (by use of a three-dimensional depth sensor) have been achieved. For diversification, the operation on screen by on/off gesture of laser pointer (click/drag operation), the real-time follow-up to a projection screen by a pan-tilt-zoom camera control, the recognition of the contact/non-contact operation to the background of a finger-tip based on depth data, and the application to a virtual keyboard and a virtual xylophone have been realized.

Research Products

• [Presentation] 画像投射式卓上型上肢訓練装置(IDAT)を用いた片麻痺患者上肢の訓練-予備的研究-. (2014)
  • Author(s): 武本暁生,中津留正剛,飯田真也,頓所つく実,樺島美由紀,伊藤英明,越智光宏,松嶋康之,蜂須賀研二,松丸隆文
  • Organizer: 第39回日本脳卒中学会総会(STROKE2014)
  • Place of Presentation: 大阪(大阪国際展示場)
  • Year and Date: 2014-03-14
• [Presentation] パンチルトズームカメラによる投影画面とのサイズ調整と追従制御 (2013)
  • Author(s): 古海陽一,松丸隆文
  • Organizer: 第14回計測自動制御学会システムインテグレーション部門講演会(SICE SI2013)
  • Place of Presentation: 兵庫(神戸国際会議場)
  • Year and Date: 2013-12-18
• [Presentation] Measuring the Performance of Laser Spot Clicking Techniques (2013)
  • Author(s): R.B. Widodo and T. Matsumaru
  • Organizer: 2013 IEEE International Conference Robotics and Biomimetics (IEEE ROBIO 2013)
  • Place of Presentation: Shenzhen, China
  • Year and Date: 2013-12-13
• [Presentation] Image-projective Desktop Arm Trainer IDAT for Therapy (2013)
  • Author(s): T. Matsumaru, Y. Jiang and Y. Liu
  • Organizer: The 22nd IEEE International Symposium on Robot and Human Interactive Communication (IEEE RO-MAN 2013)
  • Place of Presentation: Gyeongju, Korea
  • Year and Date: 2013-08-29
• [Presentation] Laser Spotlight Detection and Interpretation of Its Movement Behavior in Laser Pointer Interface (2012)
  • Author(s): R.B. Widodo, W. Chen and T. Matsumaru
  • Organizer: IEEE/SICE International Symposium on System Integration (SII)
  • Place of Presentation: Fukuoka, Japan
  • Year and Date: 2012-12-17
• [Presentation] Appling Infrared Radiation Image Sensor to Step-on Interface : Touched Point Detection and Tracking (2012)
  • Author(s): Y. Jiang, Y. Liu and T. Matsumaru
  • Organizer: IEEE/SICE International Symposium on System Integration (SII)
  • Place of Presentation: Fukuoka, Japan
  • Year and Date: 2012-12-17
• [Presentation] Development of Image-projective Desktop Arm Trainer, IDAT (2012)
  • Author(s): Y. Liu, Y. Jiang and T. Matsumaru
  • Organizer: IEEE/SICE International Symposium on System Integration (SII)
  • Place of Presentation: Fukuoka, Japan
  • Year and Date: 2012-12-16
• [Presentation] Interaction Using the Projector Screen and Spot-light from a Laser Pointer : Handling Some Fundamentals Requirements (2012)
  • Author(s): R.B. Widodo, W. Chen and T. Matsumaru
  • Organizer: SICE Annual Conference 2012
  • Place of Presentation: Akita, Japan
  • Year and Date: 2012-08-22
• [Remarks] ホームページ(研究室)
  • URL: http://www.waseda.jp/sem-matsumaru/
• [Remarks] ホームページ(個人)
  • URL: http://www.aoni.waseda.jp/matsumaru/
• [Remarks] 展示会等への出展・デモンストレーション①2013国際ロボット展・RT交流プラザ(主催:(一社)日本ロボット工業会,共催:日刊工業新聞社 ), [東京国際展示場], (2013.11.06水～09土)
• [Remarks] 北九州学研都市第13回産学連携フェア(主催:北九州学研都市産学連携フェア実行委員会, (公財)北九州産業学術推進機構), [北九州学術研究都市], (2013.10.23水～25金)
• [Remarks] 北九州学研都市第12回産学連携フェア(主催:北九州学研都市産学連携フェア実行委員会, (財)北九州産業学術推進機構), [北九州学術研究都市], (2012.10.17水～19金)
• [Remarks] 第49回 日本リハビリテーション医学会学術集会(主催:(社)日本リハビリテーション医学会), [福岡国際会議場], (2012.05.31木～06.02土)
• [Remarks] 北九州学研都市 報道記者見学ツアー((公財)北九州産業学術推進機構),[北九州学術研究都市会議場], (2012.04.24火)
• [Remarks] 2011国際ロボット展RT交流プラザ(主催:(社)日本ロボット工業会,共催:日刊工業新聞社), [東京国際展示場], (2011.11.09水～11.12土)
• [Remarks] 北九州学研都市第11回産学連携フェア(主催:北九州学研都市産学連携フェア実行委員会,(財)北九州産業学術推進機構)[北九州学術研究都市] (2011.10.19水～21金)
• [Remarks] 第51回西日本総合機械展(主催:(財)西日本産業貿易コンベンション協会) ロボット産業マッチングフェア北九州2011(主催:北九州ロボットフォーラム), [西日本総合展示場], (2011.06.23木～25土)