• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Human-Centered Human-Computer Interface Using Computer Vision

Research Project

Project/Area Number 07650492
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field 計測・制御工学
Research InstitutionOsaka University

Principal Investigator

KUNO Yoshinori  Osaka University, Faculty of Engineering, Associate Professor, 工学部, 助教授 (10252595)

Co-Investigator(Kenkyū-buntansha) MIURA Jun  Osaka University, Faculty of Engineering, Research Associate, 工学部, 助手 (90219585)
SHIRAI Yoshiaki  Osaka University, Faculty of Engineering, Professor, 工学部, 教授 (50206273)
Project Period (FY) 1995 – 1996
Project Status Completed (Fiscal Year 1996)
Budget Amount *help
¥2,300,000 (Direct Cost: ¥2,300,000)
Fiscal Year 1996: ¥400,000 (Direct Cost: ¥400,000)
Fiscal Year 1995: ¥1,900,000 (Direct Cost: ¥1,900,000)
Keywordscomputer vision / human interface / gesture recognition / multiple view invariance / stereo / virtual reality / remote operation / human-centered / ヒューマンインタフェース / 空間指示 / 動作理解 / リアルタイム処理 / 空間認知
Research Abstract

In this research, we have realized a human-centered human-computer interface system that enables us to move a target object in a 3D CG world or a real robot by moving our hand.
Conventional systems have the following three issues from the human-centered viewpoint.
1.Need camera calibration.
2.Have a limited camera field of view. We need to keep our mind on our hand position so that it may not go outside the camera field of view.
3.Interpret hand motions only with respect to the reference frame fixed in the world. We sometimes, however, use the reference frame attached to our body in considering 3D spatial relation in such a way that, for example, the right direction is the direction of our right hand.
We have proposed a vision algorithm using the multiple view affine invariance theory to solve the above issues. Then, we have develop a human interface system with a computer-controllable active camera system. Since we use invariance under viewing transformations, we do not need to know any camera parameters, thus requiring no camera calibration. This feature also allows the system to to move the cameras with a simple mechanism to keep the user in the field of view. Moreover, the system can interpret hand motions with respect to the world-fixed coordinate system and the human-centered one by taking the reference frame to obtain the invariants on an object fixed in the world and that on the user's body, respectively. The system can select an appropriate interpretation depending on the situation. Operation experiments confirm the usefulness of the system.

Report

(3 results)
  • 1996 Annual Research Report   Final Research Report Summary
  • 1995 Annual Research Report
  • Research Products

    (18 results)

All Other

All Publications (18 results)

  • [Publications] K. H. Jo: "Vision-based human interface system with world-fixed and human-centered frames using multiple view invariance" IEICE Trans. Inf. & Syst.79-D. 6. 799-808 (1996)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] K. Hayashi: "Human robot interface with appropriate frame selection" IAPR Workshop on Machine Vision Applications. 187-190 (1996)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Y. Kuno: "Two applications of computer vison : surveillance and human interface" International Workshop on Computer Vision Technology. 126-133 (1996)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Y.Kuno, K.H.Jo, K.Hayashi, and Y.Shirai: "Human-centered human-computer interface using multiple view invariance" Proc.Int.Workshop on Automatic Face- and Gesture-Recognition. 266-271 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] K.H.Jo, Y.Kuno, and Y.Shirai: "Vision-based human interface system with world-fixed frame and human-centered frame" Y.Anzai, K.Ogawa, and H.Mori (Editors), Symbiosis of Human and Artifact, Elsevier. 193-198 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Y.Kuno, K.Hayashi, K.H.Jo, and Y.Shirai: "Human-robot interface using uncalibrated stereo vision" Proc.Int.Conf.on Intelligent Robots and Systems. 525-530 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] K.H.Jo, Y.Kuno, and Y.Shirai: "Invariance based human interface system using realtime tracker" Proc.Second Asian Conference on Computer Vision. II-22-26 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] K.H.Jo, K.Hayashi, Y.Kuno, and Y.Shirai: "Vision-based human interface system with world-fixed and human-centered frames using multiple view invariance" IEICE Trans.Inf.& Syst.Vol.E79-D,No.6. 799-808 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] K.Hayashi, Y.Kuno, and Y.Shirai: "Human robot interface with appropriate frame selection" Proc.IAPR Workshop on Machine Vision Applications. 187-190 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] Y.Kuno: "Two applications of computer vision" Proc.International Workshop on omputer Vision Technology. 126-133 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1996 Final Research Report Summary
  • [Publications] K.H.Jo: "Vision-based human interface system with world-fixed and human-centered frames using multiple view invariance" IEICE Trans.Inf.& Syst.79-D.6. 799-808 (1996)

    • Related Report
      1996 Annual Research Report
  • [Publications] K.Hayashi: "Human robot interface with appropriate frame selection" IAPR Workshop on Machine Vision Applications. 187-190 (1996)

    • Related Report
      1996 Annual Research Report
  • [Publications] Y.Kuno: "Two applications of computer vision : surveillance and human interface" International Workshop on Computer Vision Technology. 126-133 (1996)

    • Related Report
      1996 Annual Research Report
  • [Publications] Hang Hyum Jo: "Invariance Based Human Interface System using Realtime Tracker" Proc.Second Asian Conference on Computer Vision. 22-26 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] Yoshinori Kuno: "Human-Centered Human- Computer Interface Using Multiple View Invariants" Proc.Int.Workshop on Automatic face and Ctesture Recognition. 266-271 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] Yoshinori Kuno: "Human-Robot Interface Using Uncalibrated Stereo.Vision" Proc.Intelligent Robot and System 1995. 525-530 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] Kang Hyun Jo: "Vision-Based Human Interface System with World-fixed and Human-Centered Frames" Symposium of Human and Aritifact. 193-198 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] Kang Hyun Jo: "Vision-Based Human Interface System with World-Fixed and Human-Centered Frames Using Multiple View Invariace" IEICE Trans.on Information and Systems. E79-D. (1996)

    • Related Report
      1995 Annual Research Report

URL: 

Published: 1995-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi