• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Gaze tracking based on spatiotemporal integration of classifiers and recognition of relationship between people

Research Project

Project/Area Number 20700152
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeSingle-year Grants
Research Field Perception information processing/Intelligent robotics
Research InstitutionSaitama University

Principal Investigator

YOSHINORI Kobayashi  Saitama University, 大学院・理工学研究科, 助教 (20466692)

Project Period (FY) 2008 – 2009
Project Status Completed (Fiscal Year 2009)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2009: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Fiscal Year 2008: ¥2,600,000 (Direct Cost: ¥2,000,000、Indirect Cost: ¥600,000)
Keywordsコンピュータビジョン / 人物行動計測 / ヒューマンロボットインタラクション / ユーザインタフェース / 知能ロボティクス / 非言語コミュニケーション / エスノメソドロジー / ヒューマンコンピュータインタラクション / 知能ロボテークス
Research Abstract

This research aims to establish people's tracking and behavior sensing techniques by integrating omni-directional cameras and laser range sensors. An omni-directional camera is set up on the top of a laser range sensor and placed shoulder level so that the sensors can observe upper body of people. By using this integrated sensor our proposed technique can track people's position and orientation of the body and the head. In general, though an omni-directional camera with a mirror has a wide field of view, the resolution of the captured image is very low. Our method can track people's gaze direction even when the human head is observed in low resolution by incorporating the information captured by a laser range sensor. We applied our developed method to the museum guide robot that can explain the exhibits to visitors and confirmed the effectiveness of our method.

Report

(3 results)
  • 2009 Annual Research Report   Final Research Report ( PDF )
  • 2008 Annual Research Report
  • Research Products

    (50 results)

All 2010 2009 2008

All Journal Article (9 results) (of which Peer Reviewed: 6 results) Presentation (38 results) Patent(Industrial Property Rights) (3 results)

  • [Journal Article] 人の顔と頭の追跡技術2010

    • Author(s)
      小林貴訓
    • Journal Title

      映像情報メディア学会誌 vol.64,no.4

      Pages: 463-467

    • NAID

      110009669365

    • Related Report
      2009 Final Research Report
  • [Journal Article] 観客を話に引き込むミュージアムガイドロボット:言葉と身体的行動の連携2009

    • Author(s)
      星洋輔, 小林貴訓, 久野義徳, 岡田真依, 山崎敬一, 山崎晶子
    • Journal Title

      電子情報通信学会論文誌A Vol.92-A,No.11

      Pages: 764-772

    • NAID

      110007467895

    • Related Report
      2009 Final Research Report
    • Peer Reviewed
  • [Journal Article] 人間とのコミュニケーションに関するビジョン技術2009

    • Author(s)
      久野義徳, 小林貴訓
    • Journal Title

      日本ロボット学会誌 Vo.47,No.6

      Pages: 40-43

    • NAID

      10025113938

    • Related Report
      2009 Final Research Report
  • [Journal Article] 観客を話に引き込むミュージアムガイドロボット:言葉と身体的行動の連携2009

    • Author(s)
      星洋輔, 小林貴訓, 久野義徳, 岡田真依, 山崎敬一, 山崎晶子
    • Journal Title

      電子情報通信学会論文A 92-11

      Pages: 764-772

    • NAID

      110007467895

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 人間とのコミュニケーションに関するビジョン技術2009

    • Author(s)
      久野義徳, 小林貴訓
    • Journal Title

      日本ロボット学会誌 47-6

      Pages: 40-43

    • NAID

      10025113938

    • Related Report
      2009 Annual Research Report
  • [Journal Article] 行動履歴に基づく人物存在確率の利用による人物三次元追跡の安定化2008

    • Author(s)
      杉村大輔, 小林貴訓, 佐藤洋一, 杉本晃宏
    • Journal Title

      情報処理学会論文誌コンピュータビジョンとイメージメディア Vol.1,No.2

      Pages: 100-110

    • NAID

      110007990131

    • Related Report
      2009 Final Research Report
    • Peer Reviewed
  • [Journal Article] 人物動線データ群における逸脱行動人物検出および行動パターン分類2008

    • Author(s)
      鈴木直彦, 平澤宏祐, 田中健一, 小林貴訓, 佐藤洋一, 藤野陽三
    • Journal Title

      電子情報通信学会論文誌D Vol.91-D,No.6

      Pages: 1550-1560

    • Related Report
      2009 Final Research Report
    • Peer Reviewed
  • [Journal Article] 人物動線データ群における逸脱行動人物検出および行動パターン分類2008

    • Author(s)
      鈴木直彦, 平澤宏祐, 田中健一, 小林貴訓, 佐藤洋一, 藤野陽三
    • Journal Title

      電子情報通信学会論文誌D 91

      Pages: 1550-1560

    • Related Report
      2008 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 行動履歴に基づく人物存在確率の利用による人物三次元追跡の安定化2008

    • Author(s)
      杉村大輔, 小林貴訓, 佐藤洋一, 杉本晃宏
    • Journal Title

      情報処理学会論文誌コンピュータビジョンとイメージメデイア 1

      Pages: 100-110

    • NAID

      110007990131

    • Related Report
      2008 Annual Research Report
    • Peer Reviewed
  • [Presentation] Selective Function of Speaker Gaze before and during Questions-Towards Developing Museum Guide Robots2010

    • Author(s)
      Y. Kobayashi, T. Shibata, Y. Hoshi, Y. Kuno, M. Okada, K. Yamazaki
    • Organizer
      In Proc. CHI2010 Extended Abstracts
    • Place of Presentation
      Atlanta USA
    • Year and Date
      2010-04-14
    • Related Report
      2009 Final Research Report
  • [Presentation] 利用者の目的地推定に基づく自律移動車椅子の提案2010

    • Author(s)
      朱エイ, 小林貴訓, 久野義徳
    • Organizer
      電子情報通信学会総合大会(学生ポスターセッション)
    • Place of Presentation
      仙台
    • Year and Date
      2010-03-18
    • Related Report
      2009 Final Research Report
  • [Presentation] 周辺状況を考慮して介護者に追随するロボット車椅子2010

    • Author(s)
      高野恵利衣, 金原悠貴, 小林貴訓, 久野義徳
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      仙台
    • Year and Date
      2010-03-18
    • Related Report
      2009 Final Research Report
  • [Presentation] People tracking using integrated sensors for human robot interaction2010

    • Author(s)
      Y. Kobayashi, Y. Kuno
    • Organizer
      Proc. ICIT2010
    • Place of Presentation
      Vina del Mar CHILE
    • Year and Date
      2010-03-16
    • Related Report
      2009 Final Research Report
  • [Presentation] People Tracking using Integrated Sensors for Human Robot Interaction2010

    • Author(s)
      小林貴訓, 久野義徳
    • Organizer
      ICIT2010
    • Place of Presentation
      Vina del Mar CHILE
    • Year and Date
      2010-03-16
    • Related Report
      2009 Annual Research Report
  • [Presentation] 介護者の意図と周辺状況の観察に基づくロボット車椅子2010

    • Author(s)
      金原悠貴, 高野恵利衣, 小林貴訓, 久野義徳
    • Organizer
      情報処理学会全国大会
    • Place of Presentation
      東京
    • Year and Date
      2010-03-11
    • Related Report
      2009 Final Research Report
  • [Presentation] 頭部動作の計測に基づき質問相手を選択するガイドロボット2010

    • Author(s)
      柴田高志, 星洋輔, 鴇田憲, 小林貴訓, 久野義徳
    • Organizer
      情報処理学会全国大会
    • Place of Presentation
      東京
    • Year and Date
      2010-03-11
    • Related Report
      2009 Final Research Report
  • [Presentation] Choosing Answerers by Observing Gaze Responses for Museum Guide Robots2010

    • Author(s)
      Y. Kobayashi, T. Shibata, Y. Hoshi, Y. Kuno, M. Okada, K. Yamazaki
    • Organizer
      Proc. HRI2010 LBR
    • Place of Presentation
      Osaka JAPAN
    • Year and Date
      2010-03-03
    • Related Report
      2009 Final Research Report
  • [Presentation] Choosing Answerers by Observing Gaze Responses for Museum Guide Robots2010

    • Author(s)
      小林貴訓, 柴田高志, 星洋輔, 久野義徳
    • Organizer
      HRI2010
    • Place of Presentation
      Osaka JAPAN
    • Year and Date
      2010-03-03
    • Related Report
      2009 Annual Research Report
  • [Presentation] 複数鑑賞者に適応的な身体的行動を用いて解説をするミュージアムガイドロボット2009

    • Author(s)
      柴田高志, 鴇田憲, 星洋輔, 小林貴訓, 久野義徳
    • Organizer
      計測自動制御学会システムインテグレーション部門講演会論文集(SI2009)
    • Place of Presentation
      東京
    • Year and Date
      2009-12-25
    • Related Report
      2009 Final Research Report
  • [Presentation] 複数鑑賞者に適応的な身体的行動を用いて解説をするミュージアムガイドロボット2009

    • Author(s)
      柴田高志, 鴇田憲, 星洋輔, 小林貴訓, 久野義徳
    • Organizer
      計測自動制御学会システムインテグレーション部門講演会
    • Place of Presentation
      東京(芝浦工大)
    • Year and Date
      2009-12-25
    • Related Report
      2009 Annual Research Report
  • [Presentation] Robotic Wheelchair Based on Observations of People Using Integrated Sensors2009

    • Author(s)
      Y. Kobayashi, Y. Kinpara, T. Shibusawa, Y. Kuno
    • Organizer
      Proc. IROS2009
    • Place of Presentation
      St. Louis USA
    • Year and Date
      2009-10-12
    • Related Report
      2009 Final Research Report
  • [Presentation] Robotic Wheelchair Based on Observations of People Using Integrated Sensors2009

    • Author(s)
      Y.Kobayashi, Y.Kinpara, T.Shibusawa, Y.Kuno
    • Organizer
      IROS2009
    • Place of Presentation
      St.Louis USA
    • Year and Date
      2009-10-12
    • Related Report
      2009 Annual Research Report
  • [Presentation] Multiple Head Tracking and Gesture Recognition for Museum Guide Robots2009

    • Author(s)
      小林貴訓, 柴田高志, 星洋輔, 久野義徳
    • Organizer
      ICCV2009
    • Place of Presentation
      Kyoto JAPAN
    • Year and Date
      2009-09-29
    • Related Report
      2009 Annual Research Report
  • [Presentation] Assisted-Care Robot Based on Sociological Interaction Analysis2009

    • Author(s)
      W.Quan, N.Ishikawa, Y.Kobayashi, Y.Kuno
    • Organizer
      ICIC2009
    • Place of Presentation
      Ulsan KOREA
    • Year and Date
      2009-09-19
    • Related Report
      2009 Annual Research Report
  • [Presentation] Head Tracking and Gesture Recognition in Museum Guide Robots for Multiparty Settings2009

    • Author(s)
      小林貴訓, 柴田高志, 星洋輔, 久野義徳
    • Organizer
      ECSCW2009
    • Place of Presentation
      Vienna AUSTRIA
    • Year and Date
      2009-09-10
    • Related Report
      2009 Annual Research Report
  • [Presentation] 複合センサを用いた人物の行動計測に基づく自律移動車椅子2009

    • Author(s)
      小林貴訓, 金原悠貴, 久野義徳
    • Organizer
      画像センシングシンポジウム
    • Place of Presentation
      横浜
    • Year and Date
      2009-06-11
    • Related Report
      2009 Final Research Report
  • [Presentation] 複合センサを用いた人物の行動計測に基づく自律移動車椅子2009

    • Author(s)
      小林貴訓, 金原悠貴, 久野義徳
    • Organizer
      画像センシングシンポジウム
    • Place of Presentation
      横浜(パシフィコ横浜)
    • Year and Date
      2009-06-11
    • Related Report
      2009 Annual Research Report
  • [Presentation] Revealing Gauguin: Engaging visitors in robot guide's explanation in an art museum2009

    • Author(s)
      K. Yamazaki, A. Yamazaki, M. Okada, Y. Kuno, Y. Kobayashi, Y. Hoshi, K. Pitsch, P. Luff, D.V. Lehn, C. Heath
    • Organizer
      Proc. CHI2009
    • Place of Presentation
      Boston USA
    • Year and Date
      2009-04-08
    • Related Report
      2009 Final Research Report
  • [Presentation] Revealing Gauguin : Engaging visitors in robot guide's explanation in an art museum2009

    • Author(s)
      K.Yamazaki, A.Yamazaki, M.Okada, Y.Kuno, Y.Kobayashi, Y.Hoshi, K.Pitsch, P.Luff, D.V.Lehn, C.Heath
    • Organizer
      CHI2009
    • Place of Presentation
      Boston USA
    • Year and Date
      2009-04-08
    • Related Report
      2009 Annual Research Report
  • [Presentation] Assisted-Care Robot Initiation Communication in Multiparty Settings2009

    • Author(s)
      Y. Kobayashi, Y. Kuno, H. Niwa, N. Akiya, M. Okada, K. Yamazaki, A. Yamazaki
    • Organizer
      Proc. CHI2009 Extended Abstracts
    • Place of Presentation
      Boston USA
    • Year and Date
      2009-04-07
    • Related Report
      2009 Final Research Report
  • [Presentation] Assisted-Care Robot Initiation Communication in Multiparty Settings2009

    • Author(s)
      Y.Kobayashi, Y.Kuno, H.Niwa, N.Akiya, M.Okada, K.Yamazaki, A.Yamazaki
    • Organizer
      CHI2009
    • Place of Presentation
      Boston USA
    • Year and Date
      2009-04-07
    • Related Report
      2009 Annual Research Report
  • [Presentation] 介護者の状態の観察に基づいたロボット車椅子の制御2009

    • Author(s)
      金原悠貴, 小林貴訓, 久野義徳
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      松山
    • Year and Date
      2009-03-20
    • Related Report
      2009 Final Research Report
  • [Presentation] 介護者の状態の観察に基づいたロボット車椅子の制御2009

    • Author(s)
      金原悠貴, 小林貴訓, 久野義徳
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      愛媛大学 (松山)
    • Year and Date
      2009-03-20
    • Related Report
      2008 Annual Research Report
  • [Presentation] 複数鑑賞者をガイドするロボットのための頭部ジェスチャ認識2009

    • Author(s)
      柴田高志, 小林貴訓, 久野義徳
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      松山
    • Year and Date
      2009-03-19
    • Related Report
      2009 Final Research Report
  • [Presentation] 複数鑑賞者をガイドするロボットのための頭部ジェスチャ認識2009

    • Author(s)
      柴田高志, 小林貴訓, 久野義徳
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      愛媛大学 (松山)
    • Year and Date
      2009-03-19
    • Related Report
      2008 Annual Research Report
  • [Presentation] 周辺状況を考慮して介護者に追随するロボット車椅子2009

    • Author(s)
      高野恵利衣, 金原悠貴, 小林貴訓, 久野義徳
    • Organizer
      情報通信学会総合大会
    • Place of Presentation
      仙台(東北大)
    • Year and Date
      2009-03-18
    • Related Report
      2009 Annual Research Report
  • [Presentation] 頭部動作の計測に基づき質問相手を選択するガイドロボット2009

    • Author(s)
      柴田高志, 星洋輔, 鴇田憲, 小林貴訓, 久野義徳
    • Organizer
      情報処理学会全国大会
    • Place of Presentation
      東京(東大)
    • Year and Date
      2009-03-11
    • Related Report
      2009 Annual Research Report
  • [Presentation] 介護者の意図と周辺状況の観察に基づくロボット車椅子2009

    • Author(s)
      金原悠貴, 高野恵利衣, 小林貴訓, 久野義徳
    • Organizer
      情報処理学会全国大会
    • Place of Presentation
      東京(東大)
    • Year and Date
      2009-03-11
    • Related Report
      2009 Annual Research Report
  • [Presentation] Collaborative Robotic Wheelchair Based on Visual and Laser Sensing2009

    • Author(s)
      Y. Kobayashi, Y. Kinpara, T. Shibusawa, Y. Kuno
    • Organizer
      Proc. FCV2009
    • Place of Presentation
      Andong KOREA
    • Year and Date
      2009-02-05
    • Related Report
      2009 Final Research Report
  • [Presentation] Collaborative Robotic Wheelchair Based on Visual and Laser Sensing2009

    • Author(s)
      Y. Kobayashi, Y. Kinpara, T. Shibusawa, Y. Kuno
    • Organizer
      15th Japan-Korea Joint Workshop on Frontiers of Computer Vision
    • Place of Presentation
      Andong (Korea)
    • Year and Date
      2009-02-05
    • Related Report
      2008 Annual Research Report
  • [Presentation] 美術館における観客を引き込む解説ロボット2008

    • Author(s)
      岡田真依, 星洋輔, 山崎敬一, 山崎晶子, 久野義徳, 小林貴訓
    • Organizer
      Proc. HAI2008
    • Place of Presentation
      横浜
    • Year and Date
      2008-12-04
    • Related Report
      2009 Final Research Report
  • [Presentation] 美術館における観客を引き込む解説ロボット2008

    • Author(s)
      岡田真依, 星洋輔, 山崎敬一, 山崎晶子, 久野義徳, 小林貴訓
    • Organizer
      HAIシンポジウム2008
    • Place of Presentation
      慶応義塾大学 (横浜)
    • Year and Date
      2008-12-04
    • Related Report
      2008 Annual Research Report
  • [Presentation] Interactively instructing a guide robot through a network2008

    • Author(s)
      Y. Hoshi, Y. Kobayashi, T. Kasuya, M. Fueki, Y. Kuno
    • Organizer
      ICCAS2008
    • Place of Presentation
      Seoul KOREA
    • Year and Date
      2008-10-14
    • Related Report
      2009 Final Research Report
  • [Presentation] Museum Guide Robot with Three Communication Modes2008

    • Author(s)
      Y. Kobayashi, Y. Hoshi, G. Hoshino, T. Kasuya, M. Fueki, Y. Kuno
    • Organizer
      Proc. IROS2008
    • Place of Presentation
      Nice FRANCE
    • Year and Date
      2008-09-25
    • Related Report
      2009 Final Research Report
  • [Presentation] Museum Guide Robot with Three Communication Modes2008

    • Author(s)
      Y. Kobayashi, Y. Hoshi, G. Hoshino, T. Kasuya, M. Fueki and Y. Kuno
    • Organizer
      Proc. of International Conference on Intelligent Robots and Systems (IROS2008)
    • Place of Presentation
      Nice (France)
    • Year and Date
      2008-09-25
    • Related Report
      2008 Annual Research Report
  • [Presentation] Robotic Wheelchair for Museum Visit2008

    • Author(s)
      T. Sibusawa, Y. Kobayashi, Y. kuno
    • Organizer
      Proc. SICE Annual Conference (SICE2008)
    • Place of Presentation
      調布
    • Year and Date
      2008-08-22
    • Related Report
      2009 Final Research Report
  • [Presentation] 3つのコミュニケーションモードを持つネットワークロボット2008

    • Author(s)
      笛木雅人, 糟谷智樹, 星洋輔, 星野豪, 小林貴訓, 久野義徳
    • Organizer
      画像センシングシンポジウム
    • Place of Presentation
      横浜
    • Year and Date
      2008-06-13
    • Related Report
      2009 Final Research Report
  • [Patent(Industrial Property Rights)] 自律移動車椅子2009

    • Inventor(s)
      小林貴訓, 久野義徳
    • Industrial Property Rights Holder
      埼玉大学
    • Industrial Property Number
      2009-019767
    • Filing Date
      2009-01-30
    • Related Report
      2009 Final Research Report
  • [Patent(Industrial Property Rights)] 自律移動車椅子2009

    • Inventor(s)
      小林貴訓, 久野義徳
    • Industrial Property Rights Holder
      埼玉大学
    • Filing Date
      2009-01-30
    • Related Report
      2008 Annual Research Report
  • [Patent(Industrial Property Rights)] 自律移動車椅子2008

    • Inventor(s)
      久野義徳, 小林貴訓
    • Industrial Property Rights Holder
      埼玉大学
    • Patent Publication Number
      2009-183538
    • Filing Date
      2008-02-07
    • Related Report
      2009 Final Research Report

URL: 

Published: 2008-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi