• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Emergence of Discriminating Object Function by Fingering Observation

Research Project

Project/Area Number 24500224
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionRitsumeikan University

Principal Investigator

SHIMADA NOBUTAKA  立命館大学, 情報理工学部, 教授 (10294034)

Project Period (FY) 2012-04-01 – 2015-03-31
Project Status Completed (Fiscal Year 2014)
Budget Amount *help
¥5,330,000 (Direct Cost: ¥4,100,000、Indirect Cost: ¥1,230,000)
Fiscal Year 2014: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2013: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Fiscal Year 2012: ¥2,470,000 (Direct Cost: ¥1,900,000、Indirect Cost: ¥570,000)
Keywords指使い / 画像認識 / 把持状態空間 / 機械学習 / 想起 / CNN / プロセスモデリング / 人工知能 / 画像 / 物体認識 / ジェスチャ / 物体機能 / 物体の機能
Outline of Final Research Achievements

This research finally proposed a framework of learning relationship between ‘fingering’ and object appearances from samples which enables to infer the functional class of objects and remind the fingering and grasping way for a given object appearance, and experimentally showed its availability:
1) The method of estimating wrist position based on Hough Forest voting of Joint hand image features,2) The method of segmentation of the grasped object based on suitable grasping pattern bound to a certain object function class,3) The method of constructing ‘grasping pattern feature space’ which describes interaction states in object grasping by hand by using Sparse Stacked Convolutional Autoencoder,4) The method of reminding the grasping approach by hand from stimulus of a object appearance by using Convolutional Neural Network .

Report

(4 results)
  • 2014 Annual Research Report   Final Research Report ( PDF )
  • 2013 Research-status Report
  • 2012 Research-status Report
  • Research Products

    (25 results)

All 2015 2014 2013 2012 Other

All Journal Article (3 results) (of which Peer Reviewed: 3 results) Presentation (22 results)

  • [Journal Article] Automatic Image Collection of Objects with Similar Function by Learning Human Grasping Forms2015

    • Author(s)
      Shinya Morioka, Tadashi Matsuo, Yasuhiro Hiramoto, Nobutaka Shimada, Yoshiaki Shirai
    • Journal Title

      Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction, Lecture Notes in Computer Science

      Volume: 8869 Pages: 3-14

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Journal Article] HMMを利用した画像処理による手話単語の認識のための特徴抽出および状態分割2013

    • Author(s)
      松尾 直志, 山田 寛, 白井 良明, 島田 伸敬
    • Journal Title

      ヒューマンインタフェース学会論文誌

      Volume: Vol.15, No.1 Pages: 85-94

    • NAID

      130007671397

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] ゴルフスイング診断のための画素値の時間ヒストグラムとグラフカットに基づく人体シルエット抽出2012

    • Author(s)
      神山 泰典, 松本 俊昭, 白井 良明, 島田 伸敬, 植田 勝彦
    • Journal Title

      電気学会論文誌

      Volume: Vol.132, No.11 Pages: 1840-1846

    • NAID

      10031120134

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Presentation] VRシミュレータを用いた腹腔鏡下手術訓練支援フレームワーク2014

    • Author(s)
      丸谷宜史,田川和義,島田伸敬,田中弘美,小森優,来見良誠,森川茂廣
    • Organizer
      第23回日本コンピュータ外科学会大会
    • Place of Presentation
      大阪大学(大阪府)
    • Year and Date
      2014-11-08
    • Related Report
      2014 Annual Research Report
  • [Presentation] Automatic Logging System of Person-Object Communication Based on Hierarchical Visual Event Detection2014

    • Author(s)
      Shogo Kawamoto, Takayuki Ikegami , Tadashi Matsuo , Nobutaka Shimada
    • Organizer
      The 10th Joint Workshop on Machine Perception and Robotics (MPR2014)
    • Place of Presentation
      Beijing (CN)
    • Year and Date
      2014-10-17
    • Related Report
      2014 Annual Research Report
  • [Presentation] Temporal-Spatial Validation of Knot-tying Motion Using RGB-D Sensor for Training of Surgical Operation2014

    • Author(s)
      Yoko Ogawa, Nobutaka Shimada, Yoshiaki Shirai, Yoshimasa Kurumi, Masaru Komori
    • Organizer
      The 10th Joint Workshop on Machine Perception and Robotics (MPR2014)
    • Place of Presentation
      Beijing (CN)
    • Year and Date
      2014-10-16
    • Related Report
      2014 Annual Research Report
  • [Presentation] 腹腔鏡下手術の技能分析・学習支援のための手術プロセス認識手法の検討2014

    • Author(s)
      丸谷宜史,田川和義,島田伸敬,田中弘美,小森優,来見良誠,森川茂廣
    • Organizer
      第2回看護理工学会学術集会
    • Place of Presentation
      大阪大学(大阪府)
    • Year and Date
      2014-10-05
    • Related Report
      2014 Annual Research Report
  • [Presentation] 手術手技訓練における糸結び手技のRGB-Dセンサを用いた良否評価2014

    • Author(s)
      小川陽子, 島田伸敬, 白井良明, 来見良誠, 小森優
    • Organizer
      第2回看護理工学会学術集会
    • Place of Presentation
      大阪大学(大阪府)
    • Year and Date
      2014-10-04
    • Related Report
      2014 Annual Research Report
  • [Presentation] 手指リハビリテーションのためのRGB-Dセンサーを用いた親指の3D稼働領域計測2014

    • Author(s)
      松尾直志、島田伸敬
    • Organizer
      第2回看護理工学会学術集会
    • Place of Presentation
      大阪大学(大阪府)
    • Year and Date
      2014-10-04
    • Related Report
      2014 Annual Research Report
  • [Presentation] VRシミュレータを用いた腹腔鏡下手術訓練支援のための手術プロセス認識・分析2014

    • Author(s)
      丸谷宜史,田川和義,島田伸敬,田中弘美,小森優,来見良誠,森川茂廣
    • Organizer
      第14回日本VR医学会学術大会
    • Place of Presentation
      東京大学(東京都)
    • Year and Date
      2014-09-13
    • Related Report
      2014 Annual Research Report
  • [Presentation] Automatic Image Collection of Objects with Similar Function by Learning Human Grasping Forms2014

    • Author(s)
      Shinya Morioka, Tadashi Matsuo, Yasuhiro Hiramoto, Nobutaka Shimada, Yoshiaki Shirai
    • Organizer
      The 3rd International Workshop on Multimodal pattern recognition of social signals in human computer interaction (MPRSS2014) (ICPR 2014 Satellite Workshop)
    • Place of Presentation
      Stockholm (SE)
    • Year and Date
      2014-08-24
    • Related Report
      2014 Annual Research Report
  • [Presentation] A study on recognizing surgical processes from training logs for VR Laparoscopic cholecystectomy surgery training support2014

    • Author(s)
      Takafumi Marutani, Kazuyoshi Tagawa, Nobutaka Shimada, Hiromi T. Tanaka, Yoshimasa Kurumi, Masaru Komori and Sigehiro Morikawa
    • Organizer
      第17回画像の認識・理解シンポジウム(MIRU2014)
    • Place of Presentation
      岡山コンベンションセンター(岡山県)
    • Year and Date
      2014-07-31
    • Related Report
      2014 Annual Research Report
  • [Presentation] Joint特徴に基づく手と物体の関係性記述を用いた把持状態の検出2014

    • Author(s)
      森岡慎也, 島田伸敬, 松尾直志, 白井良明
    • Organizer
      第17回画像の認識・理解シンポジウム(MIRU2014)
    • Place of Presentation
      岡山コンベンションセンター(岡山県)
    • Year and Date
      2014-07-29
    • Related Report
      2014 Annual Research Report
  • [Presentation] 手術手技訓練のためのSHOT特徴量を用いた糸結び動作の識別とフレーム単位の評価2014

    • Author(s)
      小川陽子, 島田伸敬, 白井良明, 来見良誠, 小森優
    • Organizer
      第17回画像の認識・理解シンポジウム(MIRU2014)
    • Place of Presentation
      岡山コンベンションセンター(岡山県)
    • Year and Date
      2014-07-29
    • Related Report
      2014 Annual Research Report
  • [Presentation] "Construction of General HMMs from a Few Hand Motions for Sign Language Word Recognition

    • Author(s)
      Tadashi Matsuo, Yoshiaki Shirai, Nobutaka Shimada
    • Organizer
      IAPR INTERNATIONAL CONFERENCE ON MACHINE VISION APPLICATION(MVA2013)
    • Place of Presentation
      立命館大学(京都府)
    • Related Report
      2013 Research-status Report
  • [Presentation] Trainee's Action Archiving System for Supporting Laparoscopic Surgery Training

    • Author(s)
      Takafumi Marutani, Kazuyoshi Tagawa, Nobutaka Shimada, Hiromi T. Tanaka, Yoshimasa Kurumi, Masaru Komori and Sigehiro Morikawa,
    • Organizer
      The 5th International Conference on 3D Systems and Applications(3DSA2013 )
    • Place of Presentation
      グランフフロント大阪(大阪府)
    • Related Report
      2013 Research-status Report
  • [Presentation] 局所特徴の位置関係の学習に基づく複雑背景下での把持状態の検出

    • Author(s)
      森岡 慎也, 平本 康裕, 島田 伸敬, 松尾 直志, 白井 良明
    • Organizer
      Meeting on Image Recognition and Understanding 2013(MIRU2013)
    • Place of Presentation
      国立情報学研究所(東京都)
    • Related Report
      2013 Research-status Report
  • [Presentation] Detection of hand grasping an object from complex background based on machine learning co-occurrence of local image feature

    • Author(s)
      Shinya Morioka, Yasuhiro Hiramoto, Nobutaka Shimada Yoshiaki Shirai
    • Organizer
      The 9th Joint Workshop on Machine Perception and Robotics (MPR2013)
    • Place of Presentation
      立命館大学(京都府)
    • Related Report
      2013 Research-status Report
  • [Presentation] 局所特徴の位置関係の学習に基づく複雑背景下での把持状態の検出"

    • Author(s)
      森岡 慎也, 平本 康裕, 島田 伸敬, 松尾 直志, 白井 良明
    • Organizer
      計測自動制御学会 システム・情報部門 学術講演会2013 (SSI2013),
    • Place of Presentation
      ピアザ淡海(滋賀県)
    • Related Report
      2013 Research-status Report
  • [Presentation] タブレットPCの前背面カメラを活用したARによる会話特徴量の可視化

    • Author(s)
      安達 寛之,明神 聖子, 島田 伸敬
    • Organizer
      インタラク ション2014
    • Place of Presentation
      日本科学未来館(東京)
    • Related Report
      2013 Research-status Report
  • [Presentation] 拡張現実感のユーザ別情報提示に基づく不完全情報ゲームのオプションのリデザイン

    • Author(s)
      明神 聖子, 島田 伸敬
    • Organizer
      インタラクション2014
    • Place of Presentation
      日本科学未来館(東京)
    • Related Report
      2013 Research-status Report
  • [Presentation] 手話認識のための距離情報を用いた隠蔽を含んだ顔・手領域抽出

    • Author(s)
      森昭太,松尾直志,白井良明,島田伸敬
    • Organizer
      情報処理学会コンピュータビジョンとイメージメディア研究会(CVIM)
    • Place of Presentation
      大阪府 大阪大学産業科学研究所
    • Related Report
      2012 Research-status Report
  • [Presentation] パートナーロボット視点からの観察による人・物体関連シーンの抽出

    • Author(s)
      西丸隼人,堀元直生, 明神聖子,松尾直志,島田伸敬
    • Organizer
      ViEW2012
    • Place of Presentation
      神奈川県 パシフィコ横浜アネックス・ホール
    • Related Report
      2012 Research-status Report
  • [Presentation] 多様な見え変化を許容した物体持ち込み・持ち去り履歴ロギングシステム

    • Author(s)
      川本祥悟, 池上貴之, 岡本和浩, TRUONGTUAN MANH, 松尾直志, 島田伸敬
    • Organizer
      第13回計測自動制御学会システムインテグレーション部門
    • Place of Presentation
      福岡県 福岡国際会議場
    • Related Report
      2012 Research-status Report
  • [Presentation] Real-Time and Precise 3-D Hand Posture Estimation Based on Classification Tree Trained with Variations of Appearances

    • Author(s)
      Sho MIYAMOTO, Tadashi MATSUO, Nobutaka SHIMADA,Yoshiaki SHIRAI
    • Organizer
      IAPR Int'l Conference on Pattern Recognition 2012
    • Place of Presentation
      茨城県 つくば国際会議場
    • Related Report
      2012 Research-status Report

URL: 

Published: 2013-05-31   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi