• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Fusion of array signal processing and facial image proccessing for hands-free robust communication and authenticaion

Research Project

Project/Area Number 11680426
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field 情報システム学(含情報図書館学)
Research InstitutionOsaka Electro-Communication University

Principal Investigator

MATSUMURA Masafumi  Osaka Electro-Communication University, Faculty of Enginering, Professor, 工学部, 教授 (80209618)

Co-Investigator(Kenkyū-buntansha) NIIKAWA Takuya  Osaka Electro-Communication University, Faculty of Engineering, Assistant Professor, 工学部, 講師
Project Period (FY) 1999 – 2001
Project Status Completed (Fiscal Year 2001)
Budget Amount *help
¥2,700,000 (Direct Cost: ¥2,700,000)
Fiscal Year 2001: ¥500,000 (Direct Cost: ¥500,000)
Fiscal Year 2000: ¥600,000 (Direct Cost: ¥600,000)
Fiscal Year 1999: ¥1,600,000 (Direct Cost: ¥1,600,000)
KeywordsAuthentication / Array signal processing / Color image processing / Facial image / 3D shape of vocal tract / Articulatory model / Dialog system / hands-free rebust communication / 整合フィルタ / 音声強調 / カラー顔画像 / 三次元声道 / 有限要素法
Research Abstract

Human speech sounds with speaker characteristics involve complex interactions of the larynx, nasal cavity, oral cavity, and oropharynx. Authentication technique can be used to verify the identity claimed by people accessing systems ; that is, it enables access control of various services by voice and face images
In conventional approach, however, there is few study on fusion of array signal processing and facial image processing for hands-free robust communication and authentication. The primary aim of our research is to develop new techniques for automatically recognizing who is speaking by using speaker-specific information included in speech wave and facial image. Intelligent audiovisual sensing system with four-microphone-array and CCD camera has been developed for hands-free robust communication and authentication. Array signal processing performed accurate estimatio fo mouth position. An articulatory model of three-dimensional vocal tract obtained by magnetic resonance imaging was proposed for extraction of speaker-specific information. A Color image pocessing technique was proposed for face segmentation and facial feature detection. Our group has successfully developed and tested the intellignet audiovisual sensing system for hands-free robust communication and authentication. The proposed techniques have wide application in the areas of speech communication and in the study of human interaction

Report

(4 results)
  • 2001 Annual Research Report   Final Research Report Summary
  • 2000 Annual Research Report
  • 1999 Annual Research Report
  • Research Products

    (22 results)

All Other

All Publications (22 results)

  • [Publications] 松村雅史: "力センサを配置した人工口蓋床による舌-口蓋接触圧分布と舌力の計測"バイオメカニズム. 16(発表予定). (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 新川拓也: "三次元声道内の音圧分布に基づく声道長の推定"バイオメカニズム. 16(発表予定). (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 松村雅史: "力センサ一体型人工口蓋床による舌-口蓋接触圧分布と舌力の計測"Technical report, Information science center, Osaka Electro-Communication university. ISC2001-02. 13-22 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 新川拓也: "母音生成時における声道内音圧分布に基づく声道長の推定"Technical report, Information science center, Osaka Electro-Communication university. ISC2001-01. 1-11 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 新川拓也: "有限要素法を用いた摩擦音発声時の声道内呼気流の推定"電気学会論文誌(C). 119-C, No.11. 1323-1328 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Takuya Niikawa: "Modeling of a speech production system based on MRI measurement of three-dimensional vocal tract shapes during fricative consonant phonation"International Conference on Spoken Language Processing 2000. Vol.2. 174-177 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Takuya Niikawa: "FEM analysis of aspirated air flow in three dimensional vocal tract during fricative consonant phonation"Trans. IEE of Japan. Vol.119-C, No.11. 1323-1328 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Masafumi Matsumura: "Measurement of Palatolingual contact pressure and tongue force using a force-sensor-mounted palatal plate"international Conference on Spoken Language Processing 2000. Vol.3, 893. 893-896 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Takuya Niikawa: "Modeling of a speech production system based on MRI measurement of three-dimensional vocal tract shapes during fricative consonant phonation"international Conference on Spoken Language Processing 2000. Vol.2, 174. 174-177 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Takuya Niikawa: "Esimation of vocal-tract length based on distribution of sound pressure in the production of vowel phonations"Information science center, Osaka Electro-Cmmunication University, Technical report. ISC2001-01. (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Masafumi Matsumura: "Measurement of Palatolingual contact pressure and tongue force using a force-sensor-mounted palatal plate"Information science center, Osaka Electro-Cmmunication University, Technical report. ISC2001-02. (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Takuya Niikawa: "Estimation of vocal-tract length based on distribution of sound pressure"Biomechanism. 16(to appear).

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Masafumi Matsumura: "Measurement of Palatolingual contact pressure and tongue force using a force-sensor-mounted palatal plate"Biomechanism. 16. To appear

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 松村雅史: "力センサを配置した人工口蓋床による舌-口蓋接触圧分布と舌力の計測"バイオメカニズム. 16(発表予定). (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 新川拓也: "三次元声道内の音圧分布に基づく声道長の推定"バイオメカニズム. 16(発表予定). (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 松村雅史: "力センサ一体型人工口蓋床による舌-口蓋接触圧分布と舌力の計測"Technical report, Information science center, Osaka Electro-Communication university. ISC2001-02. 13-22 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 新川拓也: "母音生成時における声道内音圧分布に基づく声道長の推定"Technical report, Information science center, Osaka Electro-Communication university. ISC2001-01. 1-11 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] Niikawa,Takuya: "Modeling of a speech production system based on MRI measurement of three-dimensional vocal tract shapes during fricative consonant phonation."International Conference on Spoken Language Processing 2000. Vol.2,174. 174-177 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] Matsumura,Masafumi: "Measurement of palatolingual contact pressure and tongue force using a force-sensor-mounted palatal plate"International Conference on Spoken Language Processing 2000. Vol.3,893. 893-896 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] Niikawa,Takuya: "Modeling of a speech production system during fricative consonant phonation."Technical report, Information science center, Osaka Electro-Communication university. (発表予定). (2001)

    • Related Report
      2000 Annual Research Report
  • [Publications] Matsumura,Masafumi: "Measurement of palatolingual contact pressure and tongue force using a force-sensor-mounted palatal plate"Technical report, Information science center, Osaka Electro-Communication university. (発表予定). (2001)

    • Related Report
      2000 Annual Research Report
  • [Publications] 新川拓也: "有限要素法を用いた摩擦音発声時の声道内呼気流の推定"電気学会論文誌. 119巻11号. 1323-1328 (1999)

    • Related Report
      1999 Annual Research Report

URL: 

Published: 1999-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi