• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Object Recognition Integrating Autonomous and Interactive Methods Based on the Analysis of Human Expressions of Object Attributes and Spatial Relationships

Research Project

Project/Area Number 19300055
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionSaitama University

Principal Investigator

KUNO Yoshinori  Saitama University, 大学院・理工学研究科, 教授 (10252595)

Co-Investigator(Kenkyū-buntansha) KOBAYSHI Yoshiori  埼玉大学, 大学院・理工学研究科, 助教 (20466692)
山崎 敬一  埼玉大学, 教養学部, 教授 (80191261)
Co-Investigator(Renkei-kenkyūsha) YAMAZAKI Keiichi  埼玉大学, 教養学部, 教授 (80191261)
Project Period (FY) 2007 – 2010
Project Status Completed (Fiscal Year 2010)
Budget Amount *help
¥17,550,000 (Direct Cost: ¥13,500,000、Indirect Cost: ¥4,050,000)
Fiscal Year 2010: ¥2,730,000 (Direct Cost: ¥2,100,000、Indirect Cost: ¥630,000)
Fiscal Year 2009: ¥2,860,000 (Direct Cost: ¥2,200,000、Indirect Cost: ¥660,000)
Fiscal Year 2008: ¥7,800,000 (Direct Cost: ¥6,000,000、Indirect Cost: ¥1,800,000)
Fiscal Year 2007: ¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Keywordsコンピュータビジョン / 物体認識 / ヒューマンコンピュータインタラクション / 画像,文章,音声等認識 / 知能ロボティックス / 認知科学 / ユーザインターフェース / エスノメソドロジー / ユーザィンターフェース
Research Abstract

Service robots need to be able to recognize objects located in complex environments. Although there has been recent progress in this area, it remains difficult for autonomous vision systems to recognize objects in natural conditions. In this research, we have proposed an interactive object recognition system. In this system, the robot asks the user to verbally provide information about an object that it cannot detect. In particular, it asks the user questions regarding color and spatial relationship between objects depending on the situation. Experimental results confirm the usefulness and efficiency of our interaction system.

Report

(6 results)
  • 2010 Annual Research Report   Final Research Report ( PDF )
  • 2009 Annual Research Report   Self-evaluation Report ( PDF )
  • 2008 Annual Research Report
  • 2007 Annual Research Report
  • Research Products

    (51 results)

All 2011 2010 2009 2008 2007 Other

All Journal Article (15 results) (of which Peer Reviewed: 14 results) Presentation (31 results) Book (2 results) Remarks (3 results)

  • [Journal Article] Sub-category optimization through cluster performance analysis for multi-view multi-pose object detection2011

    • Author(s)
      Dipankar Das, Yoshinori Kobayashi, Yoshinori Kuno
    • Journal Title

      IEICE Trans.Information and Systems

      Volume: Vol.E94-D(印刷中)

    • NAID

      10029805650

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Object detection in cluttered range images using edgel geometry2010

    • Author(s)
      D.Das, Y.Kobayashi, Y.Kuno
    • Journal Title

      IEEJ Trans. EIS Vol.130,No.9

      Pages: 1572-1580

    • NAID

      10026579851

    • Related Report
      2010 Final Research Report
    • Peer Reviewed
  • [Journal Article] Dbject detection in cluttered range images using edgel geometry2010

    • Author(s)
      Dipankar Das, Yoshinori Kobayashi, Yoshinori Kuno
    • Journal Title

      IEEJ Trans.EIS

      Volume: Vol.130 Pages: 1572-1580

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Multiple object category detection and localization using generative and discriminative models, IEICE Trans.2009

    • Author(s)
      D.Das, Y.Kobayashi, Y.Kuno
    • Journal Title

      Information and Systems Vol.E92-D,No.10

      Pages: 2112-2121

    • Related Report
      2010 Final Research Report
    • Peer Reviewed
  • [Journal Article] Multiple object category detection and localization using generative and discriminative models2009

    • Author(s)
      D. Das, Y. Kobayashi, Y. Kuno
    • Journal Title

      IEICE Trans.Information and Systems Vol. E92-D, No. 10

      Pages: 2112-2121

    • NAID

      10026811845

    • Related Report
      2009 Self-evaluation Report
    • Peer Reviewed
  • [Journal Article] Multiple object category detection and localization using generative and discriminative models2009

    • Author(s)
      Dipankar Das, Yoshinori Kobayashi, Yoshinori Kuno
    • Journal Title

      IEICE Trans.Information and Systems E92-D

      Pages: 2112-2121

    • NAID

      10026811845

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Specific and class object recognition for service robots through autonomous and interactive methods2008

    • Author(s)
      A.Mansur, Y.Kuno
    • Journal Title

      IEICE Trans. Information and Systems Vol.E91-D,No.6

      Pages: 1793-1803

    • NAID

      10026804529

    • Related Report
      2010 Final Research Report
    • Peer Reviewed
  • [Journal Article] Recognition of plain objects using local region matching2008

    • Author(s)
      A. Mansur, K. Sakata, D. Das, Y. Kuno
    • Journal Title

      IEICE Trans.Information and Systems Vol. E91-D, No. 7

      Pages: 1906-1913

    • NAID

      10026804789

    • Related Report
      2009 Self-evaluation Report
    • Peer Reviewed
  • [Journal Article] Specific and class object recognition for service robots through autonomous and interactive methods2008

    • Author(s)
      A. Mansur, Y. Kuno
    • Journal Title

      IEICE Trans. Information and Systems Vol. E91-D, No. 6

      Pages: 1793-1803

    • NAID

      10026804529

    • URL

      http://sucra-rd.saitama-u.ac.jp/search/profile.do?lng=ja&id=gmkeumcN

    • Related Report
      2009 Self-evaluation Report
    • Peer Reviewed
  • [Journal Article] Importance of Vision in Human-Robot Communication: Understanding Speech Using Robot Vision and Demonstrating Proper Actions to Human Vision2008

    • Author(s)
      Y. Kuno, M. Kawashima, K Yamazaki, and A. Yamazaki
    • Journal Title

      D. Monekosso, P. Remagnino, and Y. Kuno (eds.), Intelligent Environments: Methods, Algorithms and Applications, Springer

      Pages: 191-210

    • Related Report
      2008 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Specific and Class Object Recognition for Service Robots through Autonomous and Interactive Methods2008

    • Author(s)
      A. Mansur and Y. Kuno
    • Journal Title

      IEICE Trans. Information and Systems Vol.E91D

      Pages: 1793-1803

    • NAID

      10026804529

    • Related Report
      2008 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Recognition of Plain Objects Using Local Region Matching2008

    • Author(s)
      A. Mansur, K. Sakata, D. Das, and Y. Kuno
    • Journal Title

      IEICE Trans. Information and Systems Vol.E91D

      Pages: 1906-1913

    • NAID

      10026804789

    • Related Report
      2008 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Specfic and Class Object Recognition for Service Robots through Autonomous and Interactive Methods2008

    • Author(s)
      A.Mansur and Y.Kuno
    • Journal Title

      IEICE Trans.Information and Systems Vol.E91-D

    • Related Report
      2007 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Recognition of Plain Objects Using Local Region Matching2008

    • Author(s)
      A.Mansur, K.Sakata, D.Das, and Y.Kuno
    • Journal Title

      IEICE Trans.Information and Systems Vol.E91-D

    • NAID

      10026804789

    • Related Report
      2007 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 人間の物体表現の調査に基づく対話物体認識2007

    • Author(s)
      久野 義徳
    • Journal Title

      画像ラボ 18

      Pages: 28-31

    • Related Report
      2007 Annual Research Report
  • [Presentation] 状況に応じて形状表現の意味を理解する対話物体認識システム2010

    • Author(s)
      森智史, 小林貴訓, 久野義徳
    • Organizer
      HAIシンポジウム2010
    • Place of Presentation
      慶応大学日吉キャンパス(横浜市)
    • Year and Date
      2010-12-14
    • Related Report
      2010 Annual Research Report
  • [Presentation] Object material classification by surface reflection analysis with a time-of-flight range sensor2010

    • Author(s)
      Md.Abdul Mannan, Dipankar Das, Yoshinori Kobayashi, Yoshinori Kuno
    • Organizer
      International Symposium on Visual Computing (ISVC2010)
    • Place of Presentation
      ラスベガス(合衆国)
    • Year and Date
      2010-12-01
    • Related Report
      2010 Annual Research Report
  • [Presentation] Spatial resolution for robot to detect objects2010

    • Author(s)
      L.Cao, Y.Kobayashi, Y.Kuno
    • Organizer
      International Conference on Intelligent Robots and Systems (IROS2010)
    • Place of Presentation
      Taipei(Taiwan)
    • Year and Date
      2010-10-21
    • Related Report
      2010 Final Research Report
  • [Presentation] Spatial resolution for robot to detect objects2010

    • Author(s)
      Lu Cao, Yoshinori Kobayashi, Yoshinori Kuno
    • Organizer
      International Conference on Intelligent Robots and Systems (IROS 2010)
    • Place of Presentation
      台北(台湾)
    • Year and Date
      2010-10-21
    • Related Report
      2010 Annual Research Report
  • [Presentation] Sub-category optimization for multi-view multi-pose object detection2010

    • Author(s)
      D.Das, Y.Kobayashi, Y.Kuno
    • Organizer
      IAPR International Conference on Pattern Recognition (ICPR2010)
    • Place of Presentation
      Istanbul(Turkey)
    • Year and Date
      2010-08-24
    • Related Report
      2010 Final Research Report
  • [Presentation] Sub-category optimization for multi-view multi-pose object detection2010

    • Author(s)
      Dipankar Das, Yoshinori Kobayashi, Yoshinori Kuno
    • Organizer
      IAPR International Conference on Pattern Recognition (ICPR2010)
    • Place of Presentation
      イスタンブール(トルコ)
    • Year and Date
      2010-08-24
    • Related Report
      2010 Annual Research Report
  • [Presentation] Sub-category optimization for multi-view multi-pose object detection2010

    • Author(s)
      Dipankar Das, Yoshinori Kobayashi, Yoshinori Kuno
    • Organizer
      IAPR International Conference on Pattern Recognition(ICPR2010)
    • Place of Presentation
      イスタンブール(トルコ)(発表確定)
    • Year and Date
      2010-08-24
    • Related Report
      2009 Annual Research Report
  • [Presentation] Decomposition and detection of multiple object categories through automatic topic optimization2010

    • Author(s)
      Dipankar Das, Yoshinori Kobayashi, Yoshinori Kuno
    • Organizer
      16th Korea-Japan Joint Workshop on Frontiers of Computer Vision(FCV2010)
    • Place of Presentation
      広島
    • Year and Date
      2010-02-05
    • Related Report
      2009 Annual Research Report
  • [Presentation] Efficient hypothesis generation through sub-categorization for multiple object detection2009

    • Author(s)
      Dipankar Das, Yoshinori Kobayashi, Yoshinori Kuno
    • Organizer
      International Symposium on Visual Computing(ISVC2009)
    • Place of Presentation
      ラスベガス(合衆国)
    • Year and Date
      2009-12-02
    • Related Report
      2009 Annual Research Report
  • [Presentation] Object detection and localization in clutter range images using edge features2009

    • Author(s)
      Dipankar Das, Yoshinori Kobayashi, Yoshinori Kuno
    • Organizer
      International Symposium on Visual Computing(ISVC2009)
    • Place of Presentation
      ラスベガス(合衆国)
    • Year and Date
      2009-12-02
    • Related Report
      2009 Annual Research Report
  • [Presentation] Object recognition in service robots : Conducting verbal interaction on color and spatial relationship2009

    • Author(s)
      Y.Kuno, K.Sakata, Y.Kobayashi
    • Organizer
      IEEE 12th ICCV Workshops (Human-Computer Interaction)
    • Place of Presentation
      京都大学
    • Year and Date
      2009-10-04
    • Related Report
      2010 Final Research Report
  • [Presentation] Object recognition in service robots : Conducting verbal interaction on color and spatial relationship2009

    • Author(s)
      Y. Kuno, K. Sakata, Y. Kobayashi
    • Organizer
      IEEE 12th ICCV Workshops (Human-Computer Interaction)
    • Place of Presentation
      京都
    • Year and Date
      2009-10-04
    • Related Report
      2009 Self-evaluation Report
  • [Presentation] Object recognition in service robots : Conducting verbal interaction on color and spatial relationship2009

    • Author(s)
      Yoshinori Kuno, Katsutoshi Sakata, Yoshinori Kobayashi
    • Organizer
      IEEE 12th ICCV Workshops(Human-Computer Interaction)
    • Place of Presentation
      京都大学
    • Year and Date
      2009-10-04
    • Related Report
      2009 Annual Research Report
  • [Presentation] Object detection for service robots using a hybrid autonomous/interactive approach2009

    • Author(s)
      Dipankar Das, Yoshinori Kobayashi, Yoshinori Kuno
    • Organizer
      First IEEE Workshop on Computer Vision for Humanoid Robots in Real Environments
    • Place of Presentation
      京都大学
    • Year and Date
      2009-09-27
    • Related Report
      2009 Annual Research Report
  • [Presentation] Spatial relation model for object recognition in human-robot interaction2009

    • Author(s)
      Lu Cao, Yoshinori Kobayashi, Yoshinori Kuno
    • Organizer
      ICIC2009(2009 International Conference on Intelligent Computing)
    • Place of Presentation
      ウルサン(韓国)
    • Year and Date
      2009-09-18
    • Related Report
      2009 Annual Research Report
  • [Presentation] Multiple object detection and localization using range and color images for service robots2009

    • Author(s)
      Dipankar Das, Yoshinori Kobayashi, Yoshinori Kuno
    • Organizer
      ICROS-SICE International Joint Conference 2009
    • Place of Presentation
      福岡(福岡国際会議場)
    • Year and Date
      2009-08-20
    • Related Report
      2009 Annual Research Report
  • [Presentation] A hybrid model for multiple object category detection and localization2009

    • Author(s)
      Dipankar Das, Yoshinori Kobayashi, Yoshinori Kuno
    • Organizer
      IAPR Conference on Machine Vision Applications(MVA2009)
    • Place of Presentation
      横浜(慶応大学日吉キャンパス)
    • Year and Date
      2009-05-22
    • Related Report
      2009 Annual Research Report
  • [Presentation] オントロジーに基づく対話物体認識2009

    • Author(s)
      森智史,小林貴訓,久野義徳
    • Organizer
      電子情報通信学会2009年総合大会
    • Place of Presentation
      松山
    • Year and Date
      2009-03-18
    • Related Report
      2008 Annual Research Report
  • [Presentation] Spatial Relation Descriptions for Interactive Robot Vision2009

    • Author(s)
      L. Cao, Y. Kobayashi, and Y. Kuno
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      松山
    • Year and Date
      2009-03-17
    • Related Report
      2008 Annual Research Report
  • [Presentation] オントロジーに基づくロボットビジョンの提案2009

    • Author(s)
      小林貴訓,久野義徳,加地大介
    • Organizer
      電子情報通信学会2009年総合大会
    • Place of Presentation
      松山
    • Year and Date
      2009-03-17
    • Related Report
      2008 Annual Research Report
  • [Presentation] An Integrated Method for Multiple Object Detection and Localization2008

    • Author(s)
      D. Das, A. Mansur, Y. Kobayashi, and Y. Kuno
    • Organizer
      International Symposium on Visual Computing (ISVC2008)
    • Place of Presentation
      Las Vegas, USA
    • Year and Date
      2008-12-03
    • Related Report
      2008 Annual Research Report
  • [Presentation] Improving Recognition through Object Sub-categorization2008

    • Author(s)
      A Mansur and Y. Kuno
    • Organizer
      International Symposium on Visual Computing (ISVC2008)
    • Place of Presentation
      Las Vegas, USA
    • Year and Date
      2008-12-02
    • Related Report
      2008 Annual Research Report
  • [Presentation] Human Robot Interaction through Simple Expressions for Object Recognition2008

    • Author(s)
      A. Mansur, K. Sakata, Y. Kobayashi, and Y. Kuno
    • Organizer
      International Symposium on Robot and Human Interactive Communication (RO-MAN2008)
    • Place of Presentation
      ミュンヘン,ドイツ
    • Year and Date
      2008-08-03
    • Related Report
      2008 Annual Research Report
  • [Presentation] Robot vision for recognizing complex objects through simple interaction2008

    • Author(s)
      Y.Kuno, K.Sakata, Y.Kobayashi
    • Organizer
      Mecatronics 2008
    • Place of Presentation
      Le Grand-Bornand(France)
    • Year and Date
      2008-05-23
    • Related Report
      2010 Final Research Report
  • [Presentation] Robot Vision for Recognizing Complex Objects through Simple Interaction2008

    • Author(s)
      Y Kuno, K. Sakata, A. Mansur, and K. Yamazaki
    • Organizer
      M:ecatronics2008
    • Place of Presentation
      Le Grand-Bornand, France
    • Year and Date
      2008-05-23
    • Related Report
      2008 Annual Research Report
  • [Presentation] Robot Vision for Recognizing Complex Objects through Simple Interaction2008

    • Author(s)
      Y. Kuno, K. Sakata, A. Mansur, and K. Yamazaki
    • Organizer
      Mecatronics2008
    • Place of Presentation
      Le Grand-Bornand,France
    • Year and Date
      2008-05-23
    • Related Report
      2007 Annual Research Report
  • [Presentation] Interactive Reference Resolution for Service Robots2008

    • Author(s)
      R. T. Tajin and Y. Kuno
    • Organizer
      14th Korea-Japan Joint Workshop on Frontiers of Computer Vision(FCV2008)
    • Place of Presentation
      Beppu(別府)
    • Year and Date
      2008-01-26
    • Related Report
      2007 Annual Research Report
  • [Presentation] Recognition of Household Objects by Service Robots through Interactive and Autonomous Methods2007

    • Author(s)
      A. Mansur, K. Sakata, and Y. Kuno
    • Organizer
      International Symposium on Visual Computing(ISVC2007)
    • Place of Presentation
      Lake Tahoe,USA
    • Year and Date
      2007-11-26
    • Related Report
      2007 Annual Research Report
  • [Presentation] lntegration of Multiple Methods fbr Robust Object Recognition2007

    • Author(s)
      A. Mansur and Y. Kuno
    • Organizer
      SICE2007
    • Place of Presentation
      Takamatsu(高松)
    • Year and Date
      2007-09-18
    • Related Report
      2007 Annual Research Report
  • [Presentation] 人間が用いる物体表現の調査に基づいた対象物体の検出2007

    • Author(s)
      坂田 克俊, 久野 義徳
    • Organizer
      第13回画像センシングシンポジウム
    • Place of Presentation
      横浜
    • Year and Date
      2007-06-08
    • Related Report
      2007 Annual Research Report
  • [Presentation] Selection of Object Recognition Methods According to the Task and Object Category2007

    • Author(s)
      A.Mansur and Y. Kuno
    • Organizer
      IAPR Conference on Machine Vision Applications(MVA2007)
    • Place of Presentation
      Tokyo(東京)
    • Year and Date
      2007-05-17
    • Related Report
      2007 Annual Research Report
  • [Book] Intelligent Environments : Methods, Algorithms and Applications2009

    • Author(s)
      D.Monekosso, P.Remagnino, Y.Kuno(eds.)
    • Publisher
      Springer
    • Related Report
      2010 Final Research Report
  • [Book] Intelligent Environments : Methods, Algorithms and Applications2009

    • Author(s)
      D. Monekosso, P. Remagnino, Y. Kuno, eds.
    • Publisher
      Springer
    • Related Report
      2009 Self-evaluation Report
  • [Remarks] ホームページ等

    • URL

      http://www.cv.ics.saitama-u.ac.jp/research/index.html

    • Related Report
      2010 Final Research Report
  • [Remarks]

    • URL

      http://www.cv.ics.saitama-u.ac.jp/

    • Related Report
      2010 Annual Research Report
  • [Remarks] ホームページ

    • URL

      http://www.cv.ics.saitama-u.ac.jp/research/index.html

    • Related Report
      2009 Self-evaluation Report

URL: 

Published: 2007-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi