• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A Research on a Pattern Language Processing system for Human-Machine Interface

Research Project

Project/Area Number 06808039
Research Category

Grant-in-Aid for General Scientific Research (C)

Allocation TypeSingle-year Grants
Research Field 情報システム学(含情報図書館学)
Research InstitutionKyushu Institute of Technology

Principal Investigator

YOSHIDA Takaichi (1995)  Department of Artificial Intelligence, Kyushu Institute of Technology, Associate Professor, 情報工学部, 助教授 (70200996)

江島 俊朗 (1994)  九州工業大学, 情報工学部, 教授 (00124553)

Co-Investigator(Kenkyū-buntansha) OHASHI Takeshi  Department of Artificial Intelligence, Kyushu Institute of Technology, Research, 情報工学部, 助手 (00233239)
EJIMA Toshiaki  Department of Artificial Intelligence, Kyushu Institute of Technology, Professor, 情報工学部, 教授 (00124553)
吉田 隆一  九州工業大学, 情報工学部, 助教授 (70200996)
Project Period (FY) 1994 – 1995
Project Status Completed (Fiscal Year 1995)
Budget Amount *help
¥1,900,000 (Direct Cost: ¥1,900,000)
Fiscal Year 1995: ¥600,000 (Direct Cost: ¥600,000)
Fiscal Year 1994: ¥1,300,000 (Direct Cost: ¥1,300,000)
Keywordshuman interface / multi-modal interface / information integration / image processing / image recognition / speech recognition / speech extraction / ヒューマンインターフェース / 並列分散処理
Research Abstract

We have built a basic environment which supports smooth communication between human and computers by gesture. At first, we aimed to build a pattern language processing system which make it possible to give instructions to computers by the finger's language. The system recognizes shapes and motion of fingers in a video camera image and interprets instructions which the finger's language intends to express. We designed a high speed algorithm which extracts finger shape from an image, and built the system as an experiment. This experiment afforded an opportunity for a new method substitutes for the finger language i.e.a method using a stick. This method has an advantage such as high speed processing and easiness to indicate a position of a stick.
We found that an interface using a stick is more useful than the finger language, and we built a prototype interface system. The prototype interface system extracts a stick from a video camera image, and obtains the estimated three-dimensional coo … More rdinate value in real time. Because it became clear that a stick was able to be used as a three-dimensional pointing device, we built a multi-modal interface combined with speech recognition to examine operability. Then we implemented the three-dimensional block world as a prototype application and evaluated it. As a result, we found that the multi-modal interface is easy to use for users.
At the same time, we carried on researches to make it possible to use the finger language as a pattern language in the future. To solve a problem of occlusion which is a main problem when we recognize pattern languages such as a finger language by using image processing, we examined a method using multi video cameras complementarily. Because speech recognition is necessary for a multi-modal interface, we examined a configuration of a speech recognition system and developed a new method which extracts human voice form background noise. According to its evaluation, we have conclude that the speech recognition system is useful even in a noisy environment. Less

Report

(3 results)
  • 1995 Annual Research Report   Final Research Report Summary
  • 1994 Annual Research Report
  • Research Products

    (21 results)

All Other

All Publications (21 results)

  • [Publications] 大橋健: "指示棒と音声を用いたコミュニケーション環境CoSMoS" インタラクティブシステムとソフトウェアII. 29-36 (1994)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1995 Final Research Report Summary
  • [Publications] 山之内毅: "指示棒と音声を用いたコミュニケーション環境CoSMoSの音声認識処理の検討" 電子情報通信学会技術研究会報告. PRU94-81. 71-78 (1994)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1995 Final Research Report Summary
  • [Publications] 小野伸文: "3次元空間の運動を指示するジェスチャ認識" 画像の理解・認識シンポジウム(MIRU '94)講演論文集. 分冊II. 183-190 (1994)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1995 Final Research Report Summary
  • [Publications] Takeshi Ohashi: "Multimodal interface with Speech and Motion of Stick : CoSMoS" Symbiosis of Human and Artifact,Anzai et al. (Editors),Elsevier. 20A. 207-212 (1995)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1995 Final Research Report Summary
  • [Publications] 伊藤隆史: "調波構造とホルマントに着目した音声抽出" 情報処理学会九州支部研究会報告. 44-53 (1996)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1995 Final Research Report Summary
  • [Publications] 大橋健: "指示棒を用いた仮想オブジェクト操作" 電子情報通信学会技術報告. MVE95-63. 25-32 (1996)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1995 Final Research Report Summary
  • [Publications] Takeshi Ohashi, Takeshi Yamanouchi, Atsushi Matsunaga and Toshiaki Ejima: ""Communication with Speech and Motion of Stick : CoSMoS" (in Japanese)" Interactive system and software II. 29-36 (1994)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1995 Final Research Report Summary
  • [Publications] Takeshi Yamanouchi, Takeshi Ohashi and Toshiaki Ejima: ""A Design of CoSMoS witch is the communication environment with speech and motion of stick" (in Japanese)" Technical report of IEICE. PRU94-81. 71-78 (1994)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1995 Final Research Report Summary
  • [Publications] Nobufumi Ono, Atsushi Matsunaga, Takeshi Ohashi and Toshiaki Ejima: ""Gesture recognition to command motions in three dimensional space" (in Japanese)" Proc.of Meeting of Image Recognition and Understanding, MIRU'94. Vol.II. 183-190 (1994)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1995 Final Research Report Summary
  • [Publications] Takeshi Ohashi, Takaichi Yoshida, Toshiaki Ejima: ""Multimodal interface with Speech and Motion of Stick : CoSMoS"" Symbiosis of Human and Artifact, Anzai et al. (Editors) , Elsevier. Vol.20A. 207-212 (1995)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1995 Final Research Report Summary
  • [Publications] Takeshi Ito, Takeshi Ohashi and Toshiaki Ejima: ""Voice detection using harmonic structure and formant" (in Japanese)" Proc.of IPJ Kyushu branch workshop. 44-53 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1995 Final Research Report Summary
  • [Publications] Takeshi Ohashi, Takaichi Yoshida and Toshiaki Ejima: ""A manipulation method of virtual objects using a stick" (in Japanese)" Technical report of IEICE. MVE95-63. 25-32 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1995 Final Research Report Summary
  • [Publications] T.Ohashi: "Multimodal interface with Speech and Motion of Stick : CoSMoS" Symbiosis of Human and Artifact,Auzai et al. (Editors), Elsevier. 20A. 207-212 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] 伊藤隆史: "調波構造とホルマントに着目した音声抽出" 情報処理学会九州支部研究会報告. 44-53 (1996)

    • Related Report
      1995 Annual Research Report
  • [Publications] 大橋 健: "指示棒を用いた仮想オブジェクト操作" 電子情報通信学会技術報告. MVE95-63. 25-32 (1996)

    • Related Report
      1995 Annual Research Report
  • [Publications] 大橋,山之内,松永,江島: "指示棒と音声を用いたコミュニケーション環境CoSMoS" インタラクティブシステムとソフトウェアII. 29-36 (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] 山之内,大橋,松永,江島: "指示棒と音声を用いたコミュニケーション環境CoSMoSの音声認識処理の検討" 電子情報通信学会技術研究会報告. PRU94-81. 71-78 (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] 小野,松永,大橋,江島: "3次元空間の運動を指示するジェスチャ認識" 画像の理解・認識シンポジウム(MIRU'94)講演論文集. 分冊II. 183-190 (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] Y.Ito,T.Ohashi and T.Ejima: "Considerations on Designing a Decision-Tree with Multiple Features" Fourth International Workshop on Frontiers of Handwriting Recoginition. 362-369 (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] R.Santos,T.Ohashi and T.Ejima: "Using Perceptual Texture Features for Image Classification Using the Txture Spectrum Approach" 画像の理解・認識シンポジウム(MIRU'94)講演論文集. 分冊II. 183-190 (1994)

    • Related Report
      1994 Annual Research Report
  • [Publications] 吉永,吉田: "オブジェクト指向地図データベースにおける仮想地図に関する研究" 情報処理学会九州支部研究会報告. 170-179 (1995)

    • Related Report
      1994 Annual Research Report

URL: 

Published: 1994-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi