• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Integrated Object Recognition for Service Robots Based on Ontology with the Interactive Support from Humans

Research Project

Project/Area Number 23300065
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionSaitama University

Principal Investigator

KUNO Yoshinori  埼玉大学, 理工学研究科, 教授 (10252595)

Co-Investigator(Kenkyū-buntansha) KOBAYASHI Yoshinori  埼玉大学, 大学院理工学研究科, 助教 (20466692)
KACHI Daisuke  埼玉大学, 教養学部, 教授 (50251145)
Project Period (FY) 2011-04-01 – 2015-03-31
Project Status Completed (Fiscal Year 2014)
Budget Amount *help
¥15,990,000 (Direct Cost: ¥12,300,000、Indirect Cost: ¥3,690,000)
Fiscal Year 2013: ¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000)
Fiscal Year 2012: ¥6,110,000 (Direct Cost: ¥4,700,000、Indirect Cost: ¥1,410,000)
Fiscal Year 2011: ¥5,200,000 (Direct Cost: ¥4,000,000、Indirect Cost: ¥1,200,000)
Keywordsコンピュータビジョン / 知能ロボット / ヒューマンインタフェース / オントロジー / 物体認識 / 対話システム / 音声対話 / 画像,文章,音声等認識 / 知能ロボティックス / 認知科学 / ユーザインターフェース / 画像,文章,音声等認識
Outline of Final Research Achievements

We have been developing a helper robot that is able to fetch objects requested by users. Such a robot must recognize the desired object(s) in order to carry out its tasks. However, it is difficult for a system to recognize objects autonomously without fail under various real-world conditions. To address this problem, we have proposed an integrated object recognition system. The system first attempts autonomous object recognition. If it fails, it switches to an interactive object recognition mode where the system asks the user to verbally provide information about the object that it is unable to detect autonomously. However, natural language descriptions from humans can be complex. Such descriptions may not even have a one-to-one correspondence to the physical attributes of objects. We have constructed an ontology for representing such complex relationships between human descriptions and physical attributes and developed a method to recognize objects based on this ontology.

Report

(4 results)
  • 2014 Final Research Report ( PDF )
  • 2013 Annual Research Report
  • 2012 Annual Research Report
  • 2011 Annual Research Report
  • Research Products

    (25 results)

All 2014 2013 2012 2011 Other

All Journal Article (4 results) (of which Peer Reviewed: 3 results) Presentation (18 results) (of which Invited: 3 results) Remarks (3 results)

  • [Journal Article] 物体形状オントロジーに基づく指示形状物体の認識2013

    • Author(s)
      森 智史,福田 悠人,小林 貴訓,久野 義徳,加地 大介
    • Journal Title

      画像電子学会誌

      Volume: 42 Pages: 477-485

    • NAID

      130005108141

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Object Recognition for Service Robots Based on Human Description of Object Attributes2013

    • Author(s)
      H. Fukuda, S. Mori, K. Sakata, Y. Kobayashi, and Y. Kuno
    • Journal Title

      IEEJ Transactions on Electronics, Information and Systems

      Volume: 133 Issue: 1 Pages: 18-27

    • DOI

      10.1541/ieejeiss.133.18

    • NAID

      10031142402

    • ISSN
      0385-4221, 1348-8155
    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 虹の本質 ―穴と虹と鏡像そして音―2012

    • Author(s)
      加地大介
    • Journal Title

      埼玉大学紀要(教養学部)

      Volume: 48 Pages: 49-57

    • NAID

      120006387744

    • Related Report
      2012 Annual Research Report
  • [Journal Article] Sub-Category Optimization through Cluster Performance Analysis for Multi-View Multi-Pose Object Detection2011

    • Author(s)
      D.Das, Y.Kobayashi, Y.Kuno
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E94-D Issue: 7 Pages: 1467-1478

    • DOI

      10.1587/transinf.E94.D.1467

    • NAID

      10029805650

    • ISSN
      0916-8532, 1745-1361
    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Presentation] 対話を援用したグラフカットに基づく物体領域抽出2014

    • Author(s)
      光野 泰弘,小林 貴訓,久野 義徳
    • Organizer
      2014年電子情報通信学会総合大会,
    • Place of Presentation
      新潟大学(新潟市)
    • Related Report
      2013 Annual Research Report
  • [Presentation] オントロジーに基づく形状認識2013

    • Author(s)
      森 智史,福田 悠人,小林 貴訓,久野 義徳,加地 大介
    • Organizer
      画像の認識・理解シンポジウム(MIRU2013)
    • Place of Presentation
      国立情報学研究所(東京都千代田区)
    • Related Report
      2013 Annual Research Report
  • [Presentation] Object recognition for service robots through verbal interaction based on ontology2013

    • Author(s)
      H. Fukuda, S. Mori, Y. Kobayashi, Y. Kuno, and D. Kachi
    • Organizer
      International Symposium on Visual Computing (ISVC2013)
    • Place of Presentation
      Rethymnon (ギリシア)
    • Related Report
      2013 Annual Research Report
  • [Presentation] オントロジーに基づく対話を援用した物体認識の検討2013

    • Author(s)
      福田悠人, 小林貴訓, 久野義徳, 加地大介
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      岐阜大学(岐阜市)
    • Related Report
      2012 Annual Research Report
  • [Presentation] 人間行動の社会学的分析に基づくサービスロボットの開発2013

    • Author(s)
      久野義徳
    • Organizer
      第8回感性ロボティクスワークショップ、日本感性工学会
    • Place of Presentation
      中央大学(東京)
    • Related Report
      2012 Annual Research Report
    • Invited
  • [Presentation] Computer Vision for Human-Robot Interaction, and Vice-Versa2012

    • Author(s)
      Y.Kuno
    • Organizer
      FCV2012 (Korea-Japan Joint Workshop on Frontiers of Computer Vision)
    • Place of Presentation
      電気の史料館(川崎市)(招待講演)
    • Year and Date
      2012-02-05
    • Related Report
      2011 Annual Research Report
  • [Presentation] Interactive Object Recognition Using Attribute Information2012

    • Author(s)
      H.Fukuda, Y.Kobayashi, Y.Kuno
    • Organizer
      FCV2012 (Korea-Japan Joint Workshop on Frontiers of Computer Vision)
    • Place of Presentation
      川崎市国際交流センター(川崎市)
    • Year and Date
      2012-02-03
    • Related Report
      2011 Annual Research Report
  • [Presentation] RGB-Dカメラを用いたサービスロボットのための対話物体認識2012

    • Author(s)
      福田悠人、小林貴訓、久野義徳
    • Organizer
      情報処理学会コンピュータビジョンとイメージメディア研究会
    • Place of Presentation
      大阪電気通信大学(大阪府寝屋川市)
    • Year and Date
      2012-01-20
    • Related Report
      2011 Annual Research Report
  • [Presentation] Object Recognition for Service Robots through Verbal Interaction about Multiple Attribute Information2012

    • Author(s)
      H. Fukuda, S. Mori, Y. Kobayashi, and Y. Kuno
    • Organizer
      International Symposium on Visual Computing (ISVC2012)
    • Place of Presentation
      Rethymnon, Crete(ギリシア)
    • Related Report
      2012 Annual Research Report
  • [Presentation] A Spatial-Based Approach for Groups of Objects2012

    • Author(s)
      L. Cao, Y. Kobayashi, and Y.Kuno
    • Organizer
      International Symposium on Visual Computing (ISVC2012)
    • Place of Presentation
      Rethymnon, Crete(ギリシア)
    • Related Report
      2012 Annual Research Report
  • [Presentation] Spatial-Based Feature for Locating Objects2012

    • Author(s)
      L. Cao, Y. Kobayashi, and Y.Kuno
    • Organizer
      International Conference on Intelligent Computing (ICIC2012)
    • Place of Presentation
      Huangshan(中国)
    • Related Report
      2012 Annual Research Report
  • [Presentation] 材質を含む属性情報を利用したサービスロボットのための対話物体情報2011

    • Author(s)
      福田悠人、小林貴訓、久野義徳
    • Organizer
      精密工学会画像応用技術専門委員会サマーセミナー2011
    • Place of Presentation
      かたくら諏訪湖ホテル(長野県諏訪市)
    • Year and Date
      2011-08-29
    • Related Report
      2011 Annual Research Report
  • [Presentation] Understanding the Meaning of Shape Description for Interactive Object Recognition2011

    • Author(s)
      S.Mori, Y.Kobayashi, Y.Kuno
    • Organizer
      ICIC2011 (International Conference on Intelligent Computing)
    • Place of Presentation
      Zhengzhou(中国)
    • Year and Date
      2011-08-12
    • Related Report
      2011 Annual Research Report
  • [Presentation] Object Recognition for Service Robots : Where is the Fronts?2011

    • Author(s)
      L.Cao, Y.Kobayashi, Y.Kuno
    • Organizer
      ICMA2011 (International Conference on Mechatronics and Automation)
    • Place of Presentation
      北京(中国)
    • Year and Date
      2011-08-09
    • Related Report
      2011 Annual Research Report
  • [Presentation] 3D Free-Form Object Material Identification by Surface Reflection Analysis with a Time-of-Flight Range Sensor2011

    • Author(s)
      M.Mannan, H.Fukuda, L.Cao, Y.Kobayashi, Y.Kuno
    • Organizer
      MVA2011 (12^<th> IAPR Conference on Machine Vision Applications)
    • Place of Presentation
      なら100年会館(奈良市)
    • Year and Date
      2011-06-14
    • Related Report
      2011 Annual Research Report
  • [Presentation] 対話物体認識のための材質情報の獲得2011

    • Author(s)
      福田悠人、小林貴訓、久野義徳
    • Organizer
      SSII2011(第17回画像センシングシンポジウム)
    • Place of Presentation
      パシフィコ横浜(横浜市)
    • Year and Date
      2011-06-09
    • Related Report
      2011 Annual Research Report
  • [Presentation] Endurance and Pure Becoming

    • Author(s)
      D. Kachi
    • Organizer
      Tokyo Forum for Analytic Philosophy
    • Place of Presentation
      東京大学(東京)
    • Related Report
      2012 Annual Research Report
    • Invited
  • [Presentation] 虹と鏡像

    • Author(s)
      加地大介
    • Organizer
      「メレオロジーとオントロジー」ワークショップ
    • Place of Presentation
      神戸大学(神戸市)
    • Related Report
      2012 Annual Research Report
    • Invited
  • [Remarks] 久野研究室紹介 対話物体認識

    • URL

      http://www.cv.ics.saitama-u.ac.jp/research/index.html

    • Related Report
      2013 Annual Research Report
  • [Remarks] 久野研究室紹介

    • URL

      http://www.cv.ics.saitama-u.ac.jp/research/index.html

    • Related Report
      2012 Annual Research Report
  • [Remarks]

    • URL

      http://www.cv.ics.saitama-u.ac.jp/research/index.html

    • Related Report
      2011 Annual Research Report

URL: 

Published: 2011-04-06   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi