• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on interactive links between actions and visual recognition for handling soft objects

Research Project

Project/Area Number 22240019
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionNational Institute of Advanced Industrial Science and Technology

Principal Investigator

KITA Yasuyo  独立行政法人産業技術総合研究所, 知能システム研究部門, 上級主任研究員 (00356875)

Co-Investigator(Kenkyū-buntansha) KITA Nobuyuki  独立行政法人産業技術総合研究所, 知能システム研究部門, 主任研究員 (90356874)
UESHIBA Toshio  独立行政法人産業技術総合研究所, 情報技術研究部門, 主任研究員 (20356546)
KANEHIRO Fumio  独立行政法人産業技術総合研究所, 知能システム研究部門, 主任研究員 (70356806)
MORISAWA Mitsuharu  独立行政法人産業技術総合研究所, 知能システム研究部門, 研究員 (00392671)
Project Period (FY) 2010-04-01 – 2015-03-31
Project Status Completed (Fiscal Year 2014)
Budget Amount *help
¥49,530,000 (Direct Cost: ¥38,100,000、Indirect Cost: ¥11,430,000)
Fiscal Year 2013: ¥9,360,000 (Direct Cost: ¥7,200,000、Indirect Cost: ¥2,160,000)
Fiscal Year 2012: ¥9,620,000 (Direct Cost: ¥7,400,000、Indirect Cost: ¥2,220,000)
Fiscal Year 2011: ¥11,960,000 (Direct Cost: ¥9,200,000、Indirect Cost: ¥2,760,000)
Fiscal Year 2010: ¥18,590,000 (Direct Cost: ¥14,300,000、Indirect Cost: ¥4,290,000)
Keywordsロボットビジョン / 柔軟物ハンドリング / モデル駆動型画像処理 / アクション連動 / ヒューマノイド / ステレオビジョン / 広視野視覚 / 変形モデリング
Outline of Final Research Achievements

It is becoming increasingly important for robots to autonomously handle daily necessities, such as clothes folding. In this project, we have studied methods for robustly handling a clothing item by densely linking handling actions and visual recognition via a deformable model of the item. As a practical task, folding an item of clothing from an arbitrary shape into a fixed form was considered. We treat“recognition of clothing state”as a turning point in the total process. While the clothing state is unknown, actions which reshape the item so as to produce more informative observations are proactively used. Once the state of the item becomes known, the desirable clothing shape is positively led and traced by iterating handling actions and deformable-model based visual recognition. Experimental results using a humanoid system showed a good prospective of the proposed strategy.

Report

(6 results)
  • 2014 Final Research Report ( PDF )
  • 2013 Annual Research Report
  • 2012 Annual Research Report
  • 2011 Annual Research Report
  • 2010 Annual Research Report
  • Products Report
  • Research Products

    (22 results)

All 2014 2013 2012 2011 2010 Other

All Journal Article (5 results) (of which Peer Reviewed: 5 results,  Acknowledgement Compliant: 2 results) Presentation (11 results) (of which Invited: 1 results) Remarks (4 results) Patent(Industrial Property Rights) (2 results)

  • [Journal Article] Strategy for foldling clothing on the basis of deformable models2014

    • Author(s)
      Y. Kita, F. Kanehiro, T.Ueshiba and N. Kita
    • Journal Title

      Proc. of International Conference on Image Analysis and Recognition

      Volume: LNCS8815 Pages: 442-452

    • DOI

      10.1007/978-3-319-11755-3_49

    • ISBN
      9783319117546, 9783319117553
    • Related Report
      2013 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Recognizing clothing states using 3D data observed from multiple directions2013

    • Author(s)
      Y. Kita, T. Ueshiba, F. Kanehiro and N. Kita
    • Journal Title

      Proc. of IEEE-RAS International Conference on Humanoid Robots

      Volume: 1 Pages: 227-233

    • DOI

      10.1109/humanoids.2013.7029980

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] 3D Shape Measurement of a Large Cloth close to a Fisheye Stereo2012

    • Author(s)
      喜多 伸之、金広 文男、喜多 泰代
    • Journal Title

      Proceedings of 2012 IEEE/SICE International Symposium on System Integration

      Pages: 895-900

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Dense 3D Measurement of the Near Surroundings by Fisheye Stereo2011

    • Author(s)
      Nobuyuki Kita
    • Journal Title

      Proceedings of The Twelfth IAPR Conference on Machine Vision Applications

      Pages: 148-151

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Clothes handling based on recognition by strategic observation2011

    • Author(s)
      Y. Kita, F. Kanehiro, T. Ueshiba and N. Kita
    • Journal Title

      Proceedings of Humanoids2011

      Pages: 53-58

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Presentation] Strategy for foldling clothing on the basis of deformable models2014

    • Author(s)
      喜多泰代
    • Organizer
      IEEE-RAS International Conference on Humanoid Robots
    • Place of Presentation
      ポルトガル、ヴィラモーラ
    • Year and Date
      2014-10-22 – 2014-10-24
    • Related Report
      2013 Annual Research Report
  • [Presentation] 誘導された識別用形状を用いる衣類種別判定の試み2014

    • Author(s)
      胡 京雨
    • Organizer
      第17 回画像の認識・理解シンポジウム
    • Place of Presentation
      岡山
    • Year and Date
      2014-07-28 – 2014-07-31
    • Related Report
      2013 Annual Research Report
  • [Presentation] Recognizing clothing states using 3D data observed from multiple directions2013

    • Author(s)
      喜多伸之
    • Organizer
      IEEE-RAS International Conference on Humanoid Robots 2013
    • Place of Presentation
      米国 アトランタ
    • Year and Date
      2013-10-15 – 2013-10-17
    • Related Report
      2013 Annual Research Report
  • [Presentation] 衣類ハンドリングのための可変形状モデルを核とした全体戦略2013

    • Author(s)
      喜多泰代
    • Organizer
      第31 回日本ロボット学会学術講演会
    • Place of Presentation
      東京
    • Year and Date
      2013-09-04 – 2013-09-06
    • Related Report
      2013 Annual Research Report
  • [Presentation] 3D Shape Measurement of a Large Cloth close to a Fisheye Stereo2012

    • Author(s)
      喜多 伸之、金広 文男、喜多 泰代
    • Organizer
      International Symposium on System Integration
    • Place of Presentation
      福岡市
    • Related Report
      2012 Annual Research Report
  • [Presentation] Dense 3D Measurement of the Near Surroundings by Fisheye Stereo2011

    • Author(s)
      N.Kita
    • Organizer
      IAPR.Conf.on Machine Vision Applications (MVA2011)
    • Place of Presentation
      Nara
    • Year and Date
      2011-06-14
    • Related Report
      2010 Annual Research Report
  • [Presentation] Clothes handling using visual recognition in cooperation with actions2010

    • Author(s)
      Y.Kita, E.S.Neo, T.Ueshiba, N.Kita
    • Organizer
      Int.Conf.on Intelligent Robotics and Systems (IROS10)
    • Place of Presentation
      Taipei
    • Year and Date
      2010-10-19
    • Related Report
      2010 Annual Research Report
  • [Presentation] アクションを活用する衣類ハンドリングのための視覚認識2010

    • Author(s)
      喜多(泰)、植芝、喜多(伸)、Neo
    • Organizer
      第28回ロボット学術講演会
    • Place of Presentation
      名古屋
    • Year and Date
      2010-09-24
    • Related Report
      2010 Annual Research Report
  • [Presentation] 対象の大きな変形を考慮した医用画像統合解析

    • Author(s)
      喜多泰代
    • Organizer
      電子情報通信学会医用画像研究会
    • Place of Presentation
      那覇市
    • Related Report
      2012 Annual Research Report
    • Invited
  • [Presentation] Dense 3D Measurement of the Near Surroundings by Fisheye Stereo

    • Author(s)
      Nobuyuki Kita
    • Organizer
      IAPR Conference on Machine Vision Applications (MVA2011)
    • Place of Presentation
      なら100年会館(奈良県)
    • Related Report
      2011 Annual Research Report
  • [Presentation] Clothes handling based on recognition by strategic observation

    • Author(s)
      Y. Kita, F. Kanehiro, T. Ueshiba and N. Kita
    • Organizer
      Humanoids 2011
    • Place of Presentation
      Golf Hotel(スロベニア)
    • Related Report
      2011 Annual Research Report
  • [Remarks] 柔軟物連続操作のための視覚認識とアクションの双方向連動に関する研究

    • URL

      https://staff.aist.go.jp/y.kita/Japanese/Research/Action/index-chandling2-out.htm

    • Related Report
      2013 Annual Research Report
  • [Remarks] 柔軟物連続操作のための視覚認識とアクションの双方向連動に関する研究

    • URL

      http://staff.aist.go.jp/y.kita/Japanese/Research/Action/index-chandling2-out.htm

    • Related Report
      2012 Annual Research Report
  • [Remarks] 柔軟物連続操作のための視覚認識とアクションの双方向連動に関する研究

    • URL

      http://staff.aist.go.jp/y.kita/Japanese/Research/Action/index-chandling2-out.htm

    • Related Report
      2011 Annual Research Report
  • [Remarks]

    • URL

      http://staff.aist.go.jp/y.kita/Japanese/Research/Action/index-chandling2-out.htm

    • Related Report
      2010 Annual Research Report
  • [Patent(Industrial Property Rights)] 状態推定装置及び 状態推定方法2013

    • Inventor(s)
      喜多泰代,喜多伸之
    • Industrial Property Rights Holder
      喜多泰代,喜多伸之
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2013-208162
    • Filing Date
      2013-10-03
    • Related Report
      2013 Annual Research Report
  • [Patent(Industrial Property Rights)] 状態推定装置及び状態推定方法2013

    • Inventor(s)
      喜多 泰代, 喜多 伸之
    • Industrial Property Rights Holder
      独立行政法人産業技術総合研究所
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2013-208162
    • Filing Date
      2013-10-03
    • Related Report
      Products Report

URL: 

Published: 2010-08-23   Modified: 2023-03-16  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi