• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Relic restoration using stereoscopic vision system with eye following function

Research Project

Project/Area Number 15500112
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionWakayama University

Principal Investigator

CHEN Qian  Wakayama University, Faculty of systems engineering, Associate professor, システム工学部, 助教授 (70263233)

Project Period (FY) 2003 – 2005
Project Status Completed (Fiscal Year 2005)
Budget Amount *help
¥3,700,000 (Direct Cost: ¥3,700,000)
Fiscal Year 2005: ¥200,000 (Direct Cost: ¥200,000)
Fiscal Year 2004: ¥900,000 (Direct Cost: ¥900,000)
Fiscal Year 2003: ¥2,600,000 (Direct Cost: ¥2,600,000)
Keywordscamera calibration / stereo image / motion parallax / virtual reality / stereo vision / viewpoint / facial feature / visual direction / ステレオカメラ / 視点 / 円パターン / 楕円錐
Research Abstract

In a VR system, the eye position and the visual line of the viewer are necessary to make virtual objects generated by a stereo display look like a real objects. In the case of using a planar display to generate stereo images based on binocular parallax, the eye position and the visual line information relative to the display are required. We extended the "two-circle algorithm", which is an unique method for camera calibration proposed by us, to realize a visual direction estimation method that only uses the iris contours and is independent to the head pose. This research was reported at several international conferences (ECCV'04 FG'04 and ICPR'04) and some conferences held in Japan (PRMU'0402, MIRU'04).
In order to realize the effects of binocular parallax and motion parallax, the stereo images have to be generated according to the eye positions of the viewer relative to the stereo display. To obtain those parameters the calibration between the stereo display and the camera for estimating the eye positions have to be carried out. However, since the camera is used for obtain the information about the viewer's eyes ; the display is not viewable in general cases. To solve this problem, we let the user gaze the marker shown on the display and point it with his/her finger. We use a stereo camera to estimate the 3D positions of the eye and the finger tip. The calibration between the stereo camera and the display is carried out by making use of the fact that the maker, the finger tip and the eye are on the same line. We built a stereo display system with eye following function based on this idea which will be reported on MIRU2006.

Report

(4 results)
  • 2005 Annual Research Report   Final Research Report Summary
  • 2004 Annual Research Report
  • 2003 Annual Research Report
  • Research Products

    (44 results)

All 2006 2005 2004 2003 Other

All Journal Article (37 results) Publications (7 results)

  • [Journal Article] 実時間視点追従機能を有する立体映像提示法2006

    • Author(s)
      三輪創平, 陳謙, 和田俊和
    • Journal Title

      画像の認識・理解シンポジュウム(MIRU2006) (発表予定)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Stereoscopic vision with real-time viewpoint following function2006

    • Author(s)
      S.Miwa, Q.Chen, T.Wada
    • Journal Title

      MIRU2006 (accepted)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A Light Modulation/Demodulation Method for Real-time 3D Imaging2005

    • Author(s)
      陳謙, 和田俊和
    • Journal Title

      Proc.5^th International Conference on 3-D Digital Imaging and Modeling (3DIM05)

      Pages: 15-21

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Visula Direction Estimation from a Monocular Image2005

    • Author(s)
      H.WU, Q.CHEN, T.WADA
    • Journal Title

      Journal of The Transactions of the Institute of Electronics, Inforamtion and Communication Engineers Vol.E88-D, No.10

      Pages: 2277-2285

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] K-means tracking with variable ellipse model2005

    • Author(s)
      C.HUA, H.WU, T.WADA, Q.CHEN
    • Journal Title

      Information Processing Society of Japan (CVIM12) Vol.46 No.SIG15

      Pages: 59-68

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] K-meansトラッカー : 追跡失敗の発見と修復ができる対象追跡法2005

    • Author(s)
      華春生, 呉海元, 陳謙, 和歌俊和
    • Journal Title

      画像の認識・理解シンポジュウム(MIRU2005) Vol.2005 No.7

      Pages: 359-402

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 平行線パターンを用いたカメラの自己位置・姿勢の推定2005

    • Author(s)
      横森良介, 和田俊和, 陳謙
    • Journal Title

      画像の認識・理解シンポジュウム(MIRU2005) Vol.2005 No.7

      Pages: 610-617

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] K-means tracker : A Multiple Colors Object Tracking Algorithm2005

    • Author(s)
      C.Hua, H.Oike, H.Wu, Q.Chen, W.Wada
    • Journal Title

      情処研報 CVIM151

      Pages: 1-8

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] High Performance Object Tracking System Using Active Camaeras2005

    • Author(s)
      H.Wu, Q.Chen, H.Oike, C.Hua, W.Wada, T.Kato
    • Journal Title

      10^th IEEE International Conferece on Computer Vision (DEMO section) ICCV'05

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A Light Modulation/Demodulation Method for Real-time 3D Imaging2005

    • Author(s)
      Q.Chen, T.Wada
    • Journal Title

      Proc.5th International Conference on 3-D Digital Imaging and Modeling (3DIM05)

      Pages: 15-21

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Visual Direction Estimation from a Monocular Image, Journal of The Transactions of the Institute of Electronics2005

    • Author(s)
      H.WU, Q.CHEN, T.WADA
    • Journal Title

      Information and Communication Engineers Vol.E88-D, No.10

      Pages: 2277-2285

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] K-means tracker : A Multiple Colors Object Tracking Algorithm2005

    • Author(s)
      C.Hua, H.Oike, H.Wu, Q.Chen, W.Wada
    • Journal Title

      CVIM151

      Pages: 1-8

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] High Performance Object Tracking System Using Active Cameras, 10th IEEE International Conference on Computer Vision, (DEMO section)2005

    • Author(s)
      H.Wu, Q.Chen, H.Oike, C.Hua, W.Wada, T.Kato
    • Journal Title

      ICCV'05 (CD)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A Light Modulation/Demodulation Method for Real-time 3D Imaging2005

    • Author(s)
      Q.Chen, T.Wada
    • Journal Title

      Proc, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM 2005)

      Pages: 15-21

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Visual Direction Estimation from a Monocular Image2005

    • Author(s)
      H.WU, Q.CHEN, T.Wada
    • Journal Title

      Journal of The Transactions of the Institute of Electronics, Information and Communication Engineers Vol.E88-D, No.10

      Pages: 2277-2285

    • Related Report
      2005 Annual Research Report
  • [Journal Article] K-means tracking with variable ellipse model2005

    • Author(s)
      C.HUA, H.WU, T.WADA, Q.CHEN
    • Journal Title

      Information Processing Society of Japan (CVIM12) Vol.46, No.SIG15

      Pages: 59-68

    • Related Report
      2005 Annual Research Report
  • [Journal Article] K-meansトラッカー:追跡失敗の発見と修復ができる対象追跡法2005

    • Author(s)
      華春生, 呉海元, 陳謙, 漁田俊和
    • Journal Title

      画像の認識・理解シンポジュウム(MIRU) Vol.2005, No.7

      Pages: 395-402

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 平行線パターンを用いたカメラの自己位置・姿勢の推定2005

    • Author(s)
      横守良介, 和田俊和, 陳謙
    • Journal Title

      画像の認識・理解シンポジュウム(MIRU) Vol.2005, No.7

      Pages: 610-617

    • Related Report
      2005 Annual Research Report
  • [Journal Article] K-means tracker : A Multiple Colors Object Tracking Algorithm2005

    • Author(s)
      C.Hua, H.Oike, H.Wu, Q.Chen, T.Wada
    • Journal Title

      情処研報 CVIM151

      Pages: 1-8

    • Related Report
      2005 Annual Research Report
  • [Journal Article] High Performance Object Tracking System Using Active Cameras2005

    • Author(s)
      H.WU, Q.CHEN, H.OIKE, C.HUA, T.WADA, T.KATO
    • Journal Title

      Tenth IEEE International Conference on Computer Vision (DEMO section) ICCV'05 CD

    • Related Report
      2005 Annual Research Report
  • [Journal Article] A Light Modulation/Demodulation Method for Real-time 3D Imaging2005

    • Author(s)
      陳謙, 和田俊和
    • Journal Title

      Proc.Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM05) (採録決定)

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Camera Calibration with Two Arbitrary Coplanar Circles2004

    • Author(s)
      陳謙, 呉海元, 和田俊和
    • Journal Title

      Proc. IEEE Conf. ECCV'04

      Pages: 521-532

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Conic-Based Algorithm for Visual Line Estimation from One Image2004

    • Author(s)
      呉海元, 陳謙, 和田俊和
    • Journal Title

      Proc. IEEE Conf. FG'04

      Pages: 260-265

    • NAID

      110003314242

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Visual Line Estimation from aSingle Image of Two Eyes2004

    • Author(s)
      呉海元, 陳謙, 和田俊和
    • Journal Title

      Proc. ICPR'04

      Pages: 290-293

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] DMDを用いた実時間レンジファインダの開発2004

    • Author(s)
      陳謙, 竹下昌弘, 和田俊和
    • Journal Title

      MIRU2004

      Pages: 733-738

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary 2004 Annual Research Report
  • [Journal Article] DMDを用いた実時間レンジファインダ2004

    • Author(s)
      陳謙, 和田俊和
    • Journal Title

      第9回知能メカトロニクスワークショップ講演論文集

      Pages: 255-260

    • NAID

      40007204998

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 視点追従機能を実現するための目・カメラ・ディスプレイ間のキャリブレーション2004

    • Author(s)
      正垣洋平, 陳謙
    • Journal Title

      信学技法 Vol.103 No.737

      Pages: 145-148

    • NAID

      110003273990

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Camera Calibration with Two Arbitrary Coplanar Circles2004

    • Author(s)
      Q.Chen, H.Wu, T.Wada
    • Journal Title

      Proc.IEEE Conf.ECCV'04

      Pages: 521-532

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Conic-Based Algorithm for Visual Line Estimation from One Image2004

    • Author(s)
      H.Wu, Q.Chen, T.Wada
    • Journal Title

      Proc.IEEE Conf.FG'04

      Pages: 260-265

    • NAID

      110003314242

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Visual Line Estimation from a Single Image of Two Eyes2004

    • Author(s)
      H.Wu, Q.Chen, T.Wada
    • Journal Title

      Proc.ICPR'04

      Pages: 290-293

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] A Real-time rangefinder using DMD device2004

    • Author(s)
      Q.Chen, M.Takeshita, T.Wada
    • Journal Title

      MIRU2004

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Camera Calibration with Two Arbitrary Coplanar Circles2004

    • Author(s)
      陳謙, 呉海元, 和田俊和
    • Journal Title

      Proc.IEEE Conf.ECCV'04

      Pages: 521-532

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Conic-Based Algorithm for Visual Line Estimation from One Image2004

    • Author(s)
      呉海元, 陳謙, 和田俊和
    • Journal Title

      Proc.IEEE Conf.FG'04

      Pages: 260-265

    • NAID

      110003314242

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Visual Line Estimation from a Single Image of Two Eyes2004

    • Author(s)
      呉海元, 陳謙, 和田俊和
    • Journal Title

      Proc.ICPR'04

      Pages: 290-293

    • Related Report
      2004 Annual Research Report
  • [Journal Article] DMDを用いた実時間レンジファインダ2004

    • Author(s)
      陳 謙, 和田俊和
    • Journal Title

      第9回 知能メカトロニクスワークショップ 講演論文集

      Pages: 255-260

    • NAID

      40007204998

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 視点追従機能を実現するための目・カメラ・ディスプレイ間のキャリブレーション2004

    • Author(s)
      正垣洋平, 陳謙
    • Journal Title

      信学技報 Vol.103 No.737

      Pages: 145-148

    • NAID

      110003273990

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Calibration between stereo-camera and display for 3D image presentation in VR systems2003

    • Author(s)
      Y.Shogaki, Q.Chen
    • Journal Title

      Technical report of IEICE.PRMU2003-280

      Pages: 145-148

    • NAID

      110003273990

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Publications] 陳謙, 呉海元, 和田俊和: "Camera Calibration with Two Arbitrary Coplanar Circles"Proc.of IEEE Conf.on ECCV'04. (採録決定). (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] 呉海元, 陳謙, 和岡俊和: "Conic-Based Algorithm for Visual Line Estimating from One Image"Proc.of IEEE Conf.on FG'04. (採録決定). (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] 呉海元, 和田俊和, 陳謙: "ロボットのボディを利用したカメラキャリブレーション"情報処理学会CVIM論文誌. 第8号. (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 正垣洋平, 陳謙: "視点追従機能を実現するための目・カメラ・ディスプレイ間のキャリブレーション"信学技報. Vol.103No.737. 145-148 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] 竹下昌宏, 陳謙, 和田俊和: "顔表情計測のための実時間レンジファインダの開発"信学技報. Vol.103No.738. 77-82 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] 呉海元, 陳謙, 飯尾太郎, 和田俊和: "二つの円パターンを利用した視線推定"信学技報. PRMU2003-244. 79-84 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] 飯尾太郎, 呉海元, 陳謙, 和田俊和: "広い視野を観測できる複数台カメラのキャリブレーション"信学技報. PRMU2003-243. 73-78 (2004)

    • Related Report
      2003 Annual Research Report

URL: 

Published: 2003-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi