• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

STUDY ON ABSTRACTION OF MOUTH SHAPE AND DEVELOPMENT OF ALGORITHM FOR QUICK RECOGNITION OF VOWELS TO REALIZE LIP READING IN ENGINEERING

Research Project

Project/Area Number 07650314
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent mechanics/Mechanical systems
Research InstitutionKINKI UNIVERSITY

Principal Investigator

KUROSU Kenji  KINKI UNIVERSITY,DEPARTMENT OF MANAGEMENT,PROF., 九州工学部, 教授 (30117303)

Project Period (FY) 1995 – 1997
Project Status Completed (Fiscal Year 1997)
Budget Amount *help
¥2,200,000 (Direct Cost: ¥2,200,000)
Fiscal Year 1997: ¥500,000 (Direct Cost: ¥500,000)
Fiscal Year 1996: ¥700,000 (Direct Cost: ¥700,000)
Fiscal Year 1995: ¥1,000,000 (Direct Cost: ¥1,000,000)
KeywordsVISUAL SERVO / NERAL NETWORK / LIP READING / IMAGE PROCESSING / ビジュアル・サーボ / ニューラル・ネット / 画像合成 / 近似分岐点 / ファジィ類似度
Research Abstract

To realize lip reading by image processing, It is necessary to get the mouth shape correctly. As the means to do this, one approach is getting the front image of the mouth by using visual-servo which follows the movement of a face arid another approach is correcting the distortion caused by the angle of a camera to make pattern-matching with the standard pattern easy.
In the first rind second year, visual servo which follows the movement of a face by using a robot with a camera in hand. Controller by neural network which follows the one or two dimensional marker are designed and tested experimentally. The main results are as follows :
Neural network is composed of three layers which include 6 input neurons, 20 neurons in the second layer and 5 neurons in the output layer. The input signals are three feature points of an initial picture and an object picture, respectively. The manipulating variables for five joint angles are selected as the output signals and BP algorithm are used in network-learning to make the error of positioning zero . By this method, we can move the initial position of a camera to the target position by one step, if the Initial error is not so large.
In the 3rd year, the correction of distortion caused by an angle of a camera is done using the 3rd order polynomials, whose parameters are determined by the least mean square error method. The matching with the standard pattern is performed using by the fuzzy degree of similarity and neural network and the results are successful in case of the same person. The correction method of the 3rd order polynomials is efficient for the correction of distortion in the inspection picture of Inside of pipes. So, application experiments for construction of panoramic pictures of Inside of pipes is reported as the paper on the journal.
Moreover, survey of researches about lip reading is outlined.

Report

(4 results)
  • 1997 Annual Research Report   Final Research Report Summary
  • 1996 Annual Research Report
  • 1995 Annual Research Report
  • Research Products

    (25 results)

All Other

All Publications (25 results)

  • [Publications] 黒須顕二,守田圭他: "視覚特徴量を用いたマニピュレータの位置・姿勢制御(1)" 近畿大学九州工学部研究報告(理工学編). 25. 111-130 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1997 Final Research Report Summary
  • [Publications] 太田稔,黒須顕二他: "画像合成技術による小径配管内面溶接部概観観察装置の開発" 溶接学会論文集. 16. 487-493 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1997 Final Research Report Summary
  • [Publications] Kenji Kurosu et al: "A Study on Assembling of Subpictures with Visual Servo" Proc.of the 1996 IEEE IECON. 3. 864-869 (1996)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1997 Final Research Report Summary
  • [Publications] Kenji Kurosu et al: "A Study on Assembling of Sub Pictures Using Approximate Junc." Proc.of the 1997 IEEE IECON. 4. 1163-1168 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1997 Final Research Report Summary
  • [Publications] Kenji Kurosu et al: "A Study on Composing Panoramic Views of Inside of Pipes" Proc.of the 1997 IEEE IECON. 1. 248-251 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1997 Final Research Report Summary
  • [Publications] Kenji Kurosu et al: "A Study on Assembling of Sub Picture using Approximate Junctions" Proc.of the 3th Asian Fuzzy Systems Symp.284-287 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1997 Final Research Report Summary
  • [Publications] Kenji Kurosu et al: "Study on Position and Pose Control of Manipulator using Visual Features (1)" REPORTS OF THE FACULTY OF ENGINEERING, KINKI UNIVERSITY IN KYUSYU (Science and Technology Section). Vol.25. 111-130 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1997 Final Research Report Summary
  • [Publications] Minoru Ohta, Kenji Kurosu et al: "A Development of Appearance Inspection System for Root Pass Welds of Small Caliber Pipes by Composing Images" Transactions of The Society of Welding. Vol.16 No.4. 487-493 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1997 Final Research Report Summary
  • [Publications] Kenji Kurosu et al: "A Study on Assembling of Subpictures with Visual Servo" Proceedings of the 1996 IEEE IECON. Vol.3. 864-869 (1996)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1997 Final Research Report Summary
  • [Publications] Kenji Kurosu et al: "A Study on Assembling of Sub Pictures Using Approximate Junctions" Proceedings of the 1997 IEEE IECON. Vol.4. 1163-1168 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1997 Final Research Report Summary
  • [Publications] Kenji Kurosu et al: "A Study on Composing Panoramic Views of Inside of Pipes" Proceedings of the 1997 IEEE IECON. Vol.1. 248-251 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1997 Final Research Report Summary
  • [Publications] Kenji Kurosu et al: "A Study on Assembling of Sub Picture using Approximate Junctions" Proceedings of the 3rd Asian Fuzzy Systems Symposium. 284-287 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1997 Final Research Report Summary
  • [Publications] Kenji Kurosu et al: "Study on Position and Pose Control of Manipulator using Visual Features" Proceedings of the 4th JAPAN-FRANCE CONGRESS & the 2nd ASIA-EUROPE CONGRESS on Mechatronics. Vol.2. 661-664 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1997 Final Research Report Summary
  • [Publications] 黒須顕二, 守田 圭: "近似分岐点を用いた画像合成実験II" 第13回ファジィシステムシンポジウム講演論文集. 107-108 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] 黒須, 石川, 太田, 梶原: "管内目視検査のためのパノラマ写真の合成" 電子情報通信学会技術研究報告. 97/351. 7-11 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] K.Kurosu, et.al.: "A Study on Composing Panoramic Views of Inside of Pipes" Proc.of the '97 IEEE IECON. 1/4. 248-251 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] K.Kurosu, et.al.: "A Study on Assembing of Sub Pictures Using Approximate Junctions" Proc.of the '97 IEEE IECON. 3/4. 1163-1168 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] 黒須顕二・守田 圭: "ビジュアルサーボを利用した画像合成実験(3)" 第16回計測自動制御学会九州支部学術講演会予稿集. 227-230 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] 黒須顕二,守田圭他: "視覚特徴量を用いたマニピュレータの位置・姿勢制御" 近畿大学九州工学部研究報告(理工学編). 25巻. 111-130 (1996)

    • Related Report
      1996 Annual Research Report
  • [Publications] K.KUROSU et al: "A Study on Assembling of Subpictures with Visual Servo" Proc. of the '96 IEEE IECON. 2. 864-869 (1996)

    • Related Report
      1996 Annual Research Report
  • [Publications] 黒須顕二,守田圭他: "視覚特徴量を入力としたニューラルネットによるマニピュレータの位置・姿勢制御" 第15回計測自動制御学会九州支部学術講演会予講集. 227-230 (1996)

    • Related Report
      1996 Annual Research Report
  • [Publications] 黒須顕二 他: "目視検査のためのインテリジェント・インタフェースの開発" (株)北九州テクノセンター研究成果報告書. (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] 黒須顕二 他: "医用画像合成アルゴリズムについて" HUMAN INTERFACE NEWS AND REPORTS. 10. 475-482 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] 黒須顕二 他: "ビジュアルサーボを利用した画像合成" 第38回自動制御連合講演会予稿集. 373-376 (1995)

    • Related Report
      1995 Annual Research Report
  • [Publications] 黒須顕二 他: "管内目視検査のためのパノラマ写真の合成" 電子情報通信学会研究報告. R95. 25-30 (1995)

    • Related Report
      1995 Annual Research Report

URL: 

Published: 1995-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi