• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2001 Fiscal Year Final Research Report Summary

Development of an Intelligent desk using computer vision and augmented reality

Research Project

Project/Area Number 11558018
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section展開研究
Research Field Educational technology
Research InstitutionThe University of Electro-Communications

Principal Investigator

KOIKE Hideki  The University of Electro-Communications, Graduate School of Information Systems, Associate Professor, 大学院・情報システム学研究科, 助教授 (70234664)

Project Period (FY) 1999 – 2001
Keywordscomputer vision / perceptual user interface / angmented reality / CAI / education / hand recognition / gaze recognition / two-handed drawing
Research Abstract

We developed augmented desk system, named Enhanced Desk, which smoothly integrates paper and digital information on a desk. The system provides users an intelligent environment that automatically retrieves and displays digital information corresponding to the real objects (e.g. books) on the desk by using computer vision. The system also provides users direct manipulation of digital information by using their own hands and fingers for more natural and more intuitive interaction.
We developed a novel method for real-time finger tracking on Enhanced Desk by introducing a infrared camera, pattern matching with normalized correlation, a pan-tilt camera. We extended the method from 2-D to 3-D by using multiple cameras. In order to recognize objects on Enhanced Desk, we first used 2-D barcode. However, it is sometimes difficult to attach the barcode to some objects. In order to, solve this problem, we developed a new method for interactive object registration and registration by using color information of the objects. Then we discussed the use of head pose and position for human-interaction by using real-time face tracking system.
Finally, we developed some applications on Enhanced Desk. The first application is Interactive Textbook, which is aimed at providing an effective learning environment. The second application is the Interactive Venn Diagram, which is aimed at supporting effective information retrieval. The third application is Snap Link, which enable interactive object registration and recognition. The forth application is a two-handed drawing tool on Enhanced Desk

  • Research Products

    (10 results)

All Other

All Publications (10 results)

  • [Publications] Hideki Koike: "Integrating Paper and Digital Information on Enhanced Desk : A Method for Real-time Finger Tracking on an Augmented Desk System"ACM Trans. on Computer-Human Interaction. Vol.8,Issue 4. 307-322 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Yoichi Sato: "Fast Tracking of Hands and Fingertips in Infrared Images for Augmented Desk Interface"Proc. of IEEE Automatic Face and Gesture Recognition (FG2000). 462-467 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Yoichi Sato: "Real-Time Input of 3D Pose and Gestures of a User's Hand and Its Applications for HCI"The 2001 IEEE Virtual Reality Conference (IEEE-VR2001). 79-86 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Takahiro Nishi: "Snap Link : Interactive Object Registration and Recognition for Augmented Desk Interface"IFIP Conference on Human-Computer Interaction (INTERACT2001). (2001)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Takahiro Nishi: "Interactive Object Registration and Recognition for Augmented Desk Interface"Extended Abstract of 2001ACM Conference on Human Factors in Computing Systems (CHI'2001). 371-372 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Kotaro Kitajima: "Vision-Based Face Tracking System for Window Interface : Phototype Application and Empirical Studies"Extended Abstract of 2001 ACM Conference on Human Factors in Computing Systems (CHI'2001). 359-36y0 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Hideki Koike: "Interactive Textbook and Interactive Benn Diagram : Natural and Intuitive Interfaces on Augmented Desk System"Proc. of Human Factors in Computing Systems (CHI'2000). 121-128 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Hiroaki Tobita: "Information Retrieval System using Real World Objects"Proc. of DARE 2000 on Designing Augmented Reality Environments. 161-162 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Xinlei Chen: "Two-Handed Drawing on Augmented Desk System"2002 International Conference on Advanced Visual Interfaces (AVI'2002). (2002)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Hideki Koike: "Two-Handed Drawing on Augmented Desk"Extended Abstract of 2002 ACM Conference on Human Factors in Computing Systems (CHI2002). (2002)

    • Description
      「研究成果報告書概要(欧文)」より

URL: 

Published: 2003-09-17  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi