• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Functional advance and various realization of step-on interface (SOI)

Research Project

Project/Area Number 23560300
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Intelligent mechanics/Mechanical systems
Research InstitutionWaseda University

Principal Investigator

MATSUMARU Takafumi  早稲田大学, 理工学術院, 教授 (10313933)

Project Period (FY) 2011 – 2013
Project Status Completed (Fiscal Year 2013)
Budget Amount *help
¥5,200,000 (Direct Cost: ¥4,000,000、Indirect Cost: ¥1,200,000)
Fiscal Year 2013: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2012: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Fiscal Year 2011: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
Keywordsヒューマン・ロボット・インタラクション(HRI) / ステップ・オン・インタフェース(SOI) / プロジェクション(投影) / レンジ・スキャナ(二次元距離センサ) / 三次元深度センサ / 画像処理 / OpenCV + OpenNI / レーザー・ポインタ / プロジェクタ / RGB-Dセンサ(カラー+深度センサ) / OpenCV / ヒューマン・ロボット・インタラクション / ステップ・オン・インタフェース / レンジ・スキャナ(2D距離センサ) / カメラ画像処理 / Kinect
Research Abstract

This project aimed to make the step-on interface (SOI) to operate robotic and mechatronic systems both higher functional (higher reliability and higher accuracy) and more diversified (realization in various forms). For high functionality, the camera image processing (recognition of a projection screen and a light spot using OpenCV) and the depth date processing (by use of a three-dimensional depth sensor) have been achieved. For diversification, the operation on screen by on/off gesture of laser pointer (click/drag operation), the real-time follow-up to a projection screen by a pan-tilt-zoom camera control, the recognition of the contact/non-contact operation to the background of a finger-tip based on depth data, and the application to a virtual keyboard and a virtual xylophone have been realized.

Report

(4 results)
  • 2013 Annual Research Report   Final Research Report ( PDF )
  • 2012 Research-status Report
  • 2011 Research-status Report
  • Research Products

    (45 results)

All 2014 2013 2012 2011 Other

All Presentation (30 results) Remarks (15 results)

  • [Presentation] 画像投射式卓上型上肢訓練装置(IDAT)を用いた片麻痺患者上肢の訓練-予備的研究-.2014

    • Author(s)
      武本暁生,中津留正剛,飯田真也,頓所つく実,樺島美由紀,伊藤英明,越智光宏,松嶋康之,蜂須賀研二,松丸隆文
    • Organizer
      第39回日本脳卒中学会総会(STROKE2014)
    • Place of Presentation
      大阪(大阪国際展示場)
    • Year and Date
      2014-03-14
    • Related Report
      2013 Final Research Report
  • [Presentation] パンチルトズームカメラによる投影画面とのサイズ調整と追従制御2013

    • Author(s)
      古海陽一,松丸隆文
    • Organizer
      第14回計測自動制御学会システムインテグレーション部門講演会(SICE SI2013)
    • Place of Presentation
      兵庫(神戸国際会議場)
    • Year and Date
      2013-12-18
    • Related Report
      2013 Final Research Report
  • [Presentation] Measuring the Performance of Laser Spot Clicking Techniques2013

    • Author(s)
      R.B. Widodo and T. Matsumaru
    • Organizer
      2013 IEEE International Conference Robotics and Biomimetics (IEEE ROBIO 2013)
    • Place of Presentation
      Shenzhen, China
    • Year and Date
      2013-12-13
    • Related Report
      2013 Final Research Report
  • [Presentation] Image-projective Desktop Arm Trainer IDAT for Therapy2013

    • Author(s)
      T. Matsumaru, Y. Jiang and Y. Liu
    • Organizer
      The 22nd IEEE International Symposium on Robot and Human Interactive Communication (IEEE RO-MAN 2013)
    • Place of Presentation
      Gyeongju, Korea
    • Year and Date
      2013-08-29
    • Related Report
      2013 Final Research Report
  • [Presentation] Laser Spotlight Detection and Interpretation of Its Movement Behavior in Laser Pointer Interface2012

    • Author(s)
      R.B. Widodo, W. Chen and T. Matsumaru
    • Organizer
      IEEE/SICE International Symposium on System Integration (SII)
    • Place of Presentation
      Fukuoka, Japan
    • Year and Date
      2012-12-17
    • Related Report
      2013 Final Research Report
  • [Presentation] Appling Infrared Radiation Image Sensor to Step-on Interface : Touched Point Detection and Tracking2012

    • Author(s)
      Y. Jiang, Y. Liu and T. Matsumaru
    • Organizer
      IEEE/SICE International Symposium on System Integration (SII)
    • Place of Presentation
      Fukuoka, Japan
    • Year and Date
      2012-12-17
    • Related Report
      2013 Final Research Report
  • [Presentation] Development of Image-projective Desktop Arm Trainer, IDAT2012

    • Author(s)
      Y. Liu, Y. Jiang and T. Matsumaru
    • Organizer
      IEEE/SICE International Symposium on System Integration (SII)
    • Place of Presentation
      Fukuoka, Japan
    • Year and Date
      2012-12-16
    • Related Report
      2013 Final Research Report
  • [Presentation] Interaction Using the Projector Screen and Spot-light from a Laser Pointer : Handling Some Fundamentals Requirements2012

    • Author(s)
      R.B. Widodo, W. Chen and T. Matsumaru
    • Organizer
      SICE Annual Conference 2012
    • Place of Presentation
      Akita, Japan
    • Year and Date
      2012-08-22
    • Related Report
      2013 Final Research Report
  • [Presentation] 人間共存型ロボットの操作手法に関する研究(第11報) -レーザー・ポインタによるステップ・オン・インタフェースの操作の検討―2011

    • Author(s)
      齋藤渉, 黄川田昌和, 松丸隆文
    • Organizer
      日本機械学会 ロボティクス・メカトロニクス講演会2011(ROBOMEC2011)
    • Place of Presentation
      岡山コンベンションセンター,岡山市,岡山県
    • Related Report
      2011 Research-status Report
  • [Presentation] Human-Robot Interaction using Projection Interface2011

    • Author(s)
      Takafumi Matsumaru
    • Organizer
      International Workshop on Target Recognition and Tracking
    • Place of Presentation
      IPS, Waseda Univ., Kitakyushu-city, Fukuoka, Japan
    • Related Report
      2011 Research-status Report
  • [Presentation] Image-projective Desktop Arm Trainer IDAT for Therapy

    • Author(s)
      Takafumi Matsumaru, Yi Jiang, and Yang Liu
    • Organizer
      The 22nd IEEE International Symposium on Robot and Human Interactive Communication (IEEE RO-MAN 2013)
    • Place of Presentation
      Gyeongju, Korea
    • Related Report
      2013 Annual Research Report
  • [Presentation] Human-robot interaction on training

    • Author(s)
      Takafumi Matsumaru
    • Organizer
      International Workshop on Machine Vision for Industrial Innovation (MVII2013 )
    • Place of Presentation
      Kitakyushu, Japan
    • Related Report
      2013 Annual Research Report
  • [Presentation] Using Laser Pointer for Human-Computer Interaction

    • Author(s)
      Romy B. Widodo, and Takafumi Matsumaru
    • Organizer
      International Workshop on Machine Vision for Industrial Innovation (MVII2013 )
    • Place of Presentation
      Kitakyushu, Japan
    • Related Report
      2013 Annual Research Report
  • [Presentation] Automatic Adjustment and Tracking of Screen Projected by Using Pan-tilt-zoom Camera

    • Author(s)
      Yoichi Furumi, and Takafumi Matsumaru
    • Organizer
      International Workshop on Machine Vision for Industrial Innovation (MVII2013 )
    • Place of Presentation
      Kitakyushu, Japan
    • Related Report
      2013 Annual Research Report
  • [Presentation] Human-robot interaction based on contact/non-contact sensing by camera and depth sensors

    • Author(s)
      Phonpatchara Chochai, and Takafumi Matsumaru
    • Organizer
      International Workshop on Machine Vision for Industrial Innovation (MVII2013 )
    • Place of Presentation
      Kitakyushu, Japan
    • Related Report
      2013 Annual Research Report
  • [Presentation] Relative Position Calibration using Pan-tilt-zoom Camera for Projection Interface

    • Author(s)
      Yoichi Furumi, and Takafumi Matsumaru
    • Organizer
      7th IPS International Collaboration Symposium (IPS-ICS 2013)
    • Place of Presentation
      Kitakyushu, Japan
    • Related Report
      2013 Annual Research Report
  • [Presentation] Contact/non-contact Interaction System using Camera and Depth Sensors

    • Author(s)
      Phonpatchara Chochai, and Takafumi Matsumaru
    • Organizer
      7th IPS International Collaboration Symposium (IPS-ICS 2013)
    • Place of Presentation
      Kitakyushu, Japan
    • Related Report
      2013 Annual Research Report
  • [Presentation] Measuring the Performance of Laser Spot Clicking Techniques

    • Author(s)
      Romy Budhi Widodo, and Takafumi Matsumaru
    • Organizer
      2013 IEEE International Conference Robotics and Biomimetics (IEEE ROBIO 2013)
    • Place of Presentation
      Shenzhen, China
    • Related Report
      2013 Annual Research Report
  • [Presentation] パンチルトズームカメラによる投影画面とのサイズ調整と追従制御

    • Author(s)
      古海陽一, 松丸隆文
    • Organizer
      第14回 計測自動制御学会 システムインテグレーション部門講演会 (SICE SI2013)
    • Place of Presentation
      神戸,兵庫(神戸国際会議場)
    • Related Report
      2013 Annual Research Report
  • [Presentation] 画像投射式卓上型上肢訓練装置(IDAT)を用いた片麻痺患者上肢の訓練-予備的研究-

    • Author(s)
      武本暁生, 中津留正剛, 飯田真也, 頓所つく実, 樺島美由紀, 伊藤英明, 越智光宏, 松嶋康之, 蜂須賀研二, 松丸隆文
    • Organizer
      第39回日本脳卒中学会総会 (STROKE2014)
    • Place of Presentation
      大阪,大阪(大阪国際会議場)
    • Related Report
      2013 Annual Research Report
  • [Presentation] Interaction Using the Projector Screen and Spot-light from a Laser Pointer: Handling Some Fundamentals Requirements

    • Author(s)
      Romy Budhi Widodo, Weijen Chen and Takafumi Matsumaru
    • Organizer
      SICE Annual Conference 2012
    • Place of Presentation
      Akita Univ., Japan
    • Related Report
      2012 Research-status Report
  • [Presentation] Application of Step-on Interface to Therapy

    • Author(s)
      Takafumi Matsumaru, Shiyang Dong and Yang Liu
    • Organizer
      IEEE/RSJ IROS 2012 Workshop on Motivational Aspects of Robotics in Physical Therapy
    • Place of Presentation
      Vilamoura, Algarve, Portugal
    • Related Report
      2012 Research-status Report
  • [Presentation] Recent Advance on SOI (Step-On-Interface) Applications

    • Author(s)
      Takafumi Matsumaru
    • Organizer
      International Workshop on Image & Signal Processing and Retrieval (IWISPR2012)
    • Place of Presentation
      Kitakyushu, Fukuoka, Japan
    • Related Report
      2012 Research-status Report
  • [Presentation] Development of Walking Training Robotwith Customizable Trajectory Design System

    • Author(s)
      Shiyang Dong, Yu Zhang and Takafumi Matsumaru
    • Organizer
      International Workshop on Image & Signal Processing and Retrieval (IWISPR2012)
    • Place of Presentation
      Kitakyushu, Fukuoka, Japan
    • Related Report
      2012 Research-status Report
  • [Presentation] Development of Image-Projective Desktop Arm Trainer and Measurement of Trainee's Performance

    • Author(s)
      Yang Liu, Yi Jiang and Takafumi Matsumaru
    • Organizer
      International Workshop on Image & Signal Processing and Retrieval (IWISPR2012)
    • Place of Presentation
      Kitakyushu, Fukuoka, Japan
    • Related Report
      2012 Research-status Report
  • [Presentation] Development of Walking Training Robot with Customizable Trajectory Design System

    • Author(s)
      Shiyang Dong, Yu Zhang and Takafumi Matsumaru
    • Organizer
      6th IPS International Collaboration Symposium (IPS-ICS)
    • Place of Presentation
      Kitakyushu, Fukuoka, Japan
    • Related Report
      2012 Research-status Report
  • [Presentation] Development of Image-Projective Desktop Arm Trainer and Measurement of Trainee’s Performance

    • Author(s)
      Yang Liu, Yi Jiang and Takafumi Matsumaru
    • Organizer
      6th IPS International Collaboration Symposium (IPS-ICS)
    • Place of Presentation
      Kitakyushu, Fukuoka, Japan
    • Related Report
      2012 Research-status Report
  • [Presentation] Development of Image-projective Desktop Arm Trainer, IDAT

    • Author(s)
      Yang Liu, Yi Jiang and Takafumi Matsumaru
    • Organizer
      2012 IEEE/SICE International Symposium on System Integration (SII)
    • Place of Presentation
      Kyushu University, Fukuoka, Japan
    • Related Report
      2012 Research-status Report
  • [Presentation] Appling Infrared Radiation Image Sensor to Step-on Interface: Touched Point Detection and Tracking

    • Author(s)
      Yi Jiang, Yang Liu and Takafumi Matsumaru
    • Organizer
      2012 IEEE/SICE International Symposium on System Integration (SII)
    • Place of Presentation
      Kyushu University, Fukuoka, Japan
    • Related Report
      2012 Research-status Report
  • [Presentation] Laser Spotlight Detection and Interpretation of Its Movement Behavior in Laser Pointer Interface

    • Author(s)
      Romy Budhi Widodo, Weijen Chen and Takafumi Matsumaru
    • Organizer
      2012 IEEE/SICE International Symposium on System Integration (SII)
    • Place of Presentation
      Kyushu University, Fukuoka, Japan
    • Related Report
      2012 Research-status Report
  • [Remarks] ホームページ(研究室)

    • URL

      http://www.waseda.jp/sem-matsumaru/

    • Related Report
      2013 Final Research Report
  • [Remarks] ホームページ(個人)

    • URL

      http://www.aoni.waseda.jp/matsumaru/

    • Related Report
      2013 Final Research Report
  • [Remarks] 展示会等への出展・デモンストレーション①2013国際ロボット展・RT交流プラザ(主催:(一社)日本ロボット工業会,共催:日刊工業新聞社 ), [東京国際展示場], (2013.11.06水~09土)

    • Related Report
      2013 Final Research Report
  • [Remarks] 北九州学研都市第13回産学連携フェア(主催:北九州学研都市産学連携フェア実行委員会, (公財)北九州産業学術推進機構), [北九州学術研究都市], (2013.10.23水~25金)

    • Related Report
      2013 Final Research Report
  • [Remarks] 北九州学研都市第12回産学連携フェア(主催:北九州学研都市産学連携フェア実行委員会, (財)北九州産業学術推進機構), [北九州学術研究都市], (2012.10.17水~19金)

    • Related Report
      2013 Final Research Report
  • [Remarks] 第49回 日本リハビリテーション医学会学術集会(主催:(社)日本リハビリテーション医学会), [福岡国際会議場], (2012.05.31木~06.02土)

    • Related Report
      2013 Final Research Report
  • [Remarks] 北九州学研都市 報道記者見学ツアー((公財)北九州産業学術推進機構),[北九州学術研究都市会議場], (2012.04.24火)

    • Related Report
      2013 Final Research Report
  • [Remarks] 2011国際ロボット展RT交流プラザ(主催:(社)日本ロボット工業会,共催:日刊工業新聞社), [東京国際展示場], (2011.11.09水~11.12土)

    • Related Report
      2013 Final Research Report
  • [Remarks] 北九州学研都市第11回産学連携フェア(主催:北九州学研都市産学連携フェア実行委員会,(財)北九州産業学術推進機構)[北九州学術研究都市] (2011.10.19水~21金)

    • Related Report
      2013 Final Research Report
  • [Remarks] 第51回西日本総合機械展(主催:(財)西日本産業貿易コンベンション協会) ロボット産業マッチングフェア北九州2011(主催:北九州ロボットフォーラム), [西日本総合展示場], (2011.06.23木~25土)

    • Related Report
      2013 Final Research Report
  • [Remarks] Bio-Robotics & Human-Mechatronics Laboratory

    • URL

      http://www.waseda.jp/sem-matsumaru/

    • Related Report
      2013 Annual Research Report
  • [Remarks] Takafumi MATSUMARU (Waseda Univ.)

    • URL

      http://www.aoni.waseda.jp/matsumaru/

    • Related Report
      2013 Annual Research Report
  • [Remarks] Bio-Robotics & Human-Mechatronics Laboratory

    • URL

      http://www.waseda.jp/sem-matsumaru/

    • Related Report
      2012 Research-status Report
  • [Remarks] Takafumi MATSUMARU (Waseda Univ.)

    • URL

      http://www.aoni.waseda.jp/matsumaru/

    • Related Report
      2012 Research-status Report
  • [Remarks] バイオ・ロボティクス&ヒューマンメカトロニクス研究室

    • URL

      http://www.waseda.jp/sem-matsumaru/

    • Related Report
      2011 Research-status Report

URL: 

Published: 2011-08-05   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi