• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

1992 Fiscal Year Final Research Report Summary

Intelligent pattern recognition and understanding by integrating probabilistic and symbolic reasoning

Research Project

Project/Area Number 02452281
Research Category

Grant-in-Aid for General Scientific Research (B)

Allocation TypeSingle-year Grants
Research Field Informatics
Research InstitutionKYOTO UNIVERSITY

Principal Investigator

DOSHITA Shuji  Kyoto Univ. Faculty of Engineering Professor, 工学部, 教授 (00025925)

Co-Investigator(Kenkyū-buntansha) ISHIBASHI Hayato  Kyoto Univ. Data Processing Center Assistant Professor, 大型計算機センター, 助手 (70212925)
KAWAHARA Tatsuya  Kyoto Univ. Faculty of Engineering Assistant Professor, 工学部, 助手 (00234104)
KITAZAWA Shigeyoshi  Shizuoka Univ. Faculty of Engineering Associate Professor, 工学部, 助教授 (00109018)
YAMADA Atsushi  Kyoto Univ. Faculty of Engineering Assistant Professor, 工学部, 助手 (20240004)
NISHIDA Toyoaki  Kyoto Univ. Faculty of Engineering Associate Professor, 工学部, 助教授 (70135531)
Project Period (FY) 1990 – 1992
KeywordsPattern Understanding / Speech Recognition / Speech Understanding / HMM / Context-Free Grammar / Keyword Spotting / Semantic Network / A^*Search
Research Abstract

For intelligent speech recognition and understanding, we have examined reasoning strategies on several knowledge-levels, and integrated them into speech understanding systems as follows:
(1) Phoneme recognition
We have firstly improved phoneme recognition, which is the base of the whole system. Phoneme HMM based on pair-wise Bayes classifiers is proposed with 27 phoneme recognition rate of 83.1% and 653 word recognition rate of 84.8%.
(2) Syntactic analysis
Syntactic analyzer is developed by integrating probabilistic reasoning and symbolic reasoning on vocabulary and syntax level. Here heuristic search is performed based on prediction by syntax rules and probabilities of HMM. A^*-admissible context-free parsing with word-pair constraints as heuristics is presented.
(3) Keyword spotting
It is possible to make sense of sentences with multiple keywords, without syntax rules. However, conventional method extracts keywords using only the scores of their own, thus insufficient. A new spotting algorithm is presented with assumes logical constraint that the input is a phoneme or word sequence containing target keywords.
(4) Semantic analysis
Network-based semantic analyzer is developed which accepts both N-best word sequences and a keyword lattice and obtains a semantic representation. Here semantic, pragmatic and dialog-level knowledge is integrated and plausible hypothesis is obtained by combining probabilities of candidate words.
(5) Speech understanding system
Two reasoning strategies are implemented on speech understanding systems. One is syntactic-driven which integrates (1), (2) and (4). The other is semantic-driven which integrates (1), (3) and (4). We have evaluated both systems on a task whose vocabulary size is 244 and word perplexity is 80. For grammatical utterances, syntactic-driven approach got an accuracy of 65.5%, while semantic-driven achieved just 44.0%. However, semantic-driven approach is effective for out-of-grammar utterances.

  • Research Products

    (13 results)

All Other

All Publications (13 results)

  • [Publications] 河原 達也,堂下 修司,北澤 茂良: "判別分析とHMMの統合による不特定話者子音認識" 電子情報通信学会論文誌. J73-D2. 1363-1372 (1990)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] T.Kawahara and S.Doshita.: "Phoneme recognition by combining discriminant analysis and HMM" In Proc.of IEEE-ICASSP. 1. 557-560 (1991)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] T.KAwahara and S.Doshita.: "HMM based on pair-wise Bayes classifiers" In Proc.of IEEE-ICASSP. 1. 365-368 (1992)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] T.Kawahara,S.Matsumoto and S.Doshita.: "A^*-admissible context-free parsing on HMM trellis for speech understanding" In Proc.of Pacific Rim Int'l Conf.on Artificial Intelligence. 2. 1203-1208 (1992)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] M.Araki,T.Kawahara,T.Nishida,and S.Doshita.: "Keyword-driven speech parser using dialog-level knowledge" In Proc.of Pacific Rim Int'l Conf.on Artificial Intelligence. 2. 1025-1029 (1992)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 河原 達也,堂下 修司: "対判別に基づく連続型HMMによる音声認識" 電子情報通信学会論文誌. J75-D2. 1641-1648 (1992)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] T.Kawahara, T.Ogawa, S.Kitazawa, and S.Doshita.: "Phoneme recognition by combining Bayesian linear discriminations of selected pairs of classes." In Proc. of Int'l Conf. on Spoken Language Processing. 7.8. (1990)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] T.Kawahara and S.Doshita: "Phoneme recognition by combining discriminant analysis and HMM." In Proc. of IEEE-ICASSP. 557-560 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] P.Fung, T.Kawahara, and S.Doshita: "Unsupervised speaker normalization by speaker Markov model converter for speaker-independent speech recognition." In Proc. of European Conf. on Speech Communication and Technology. 1111-1115 (1991)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] T.Kawahara and S.Doshita: "HMM based on pair-wise Bayes classifiers." In Proc. of IEEE-ICASSP. volume 1. 365-368 (1992)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] T.Kawahara, S.Matsumoto, and S.Doshita: "A^*-admissible context-free parsing on HMM trellis for speech understanding." In Proc. of Pacific Rim Int'l Conf. on Artificial Intelligence. volume 2. 1203-1208 (1992)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] M.Araki, T.Kawahara, T.Nishida, and S.Doshita: "Keyword-driven speech parser using dialog-level knowledge." In Proc. of Pacific Rim Int'l Conf. on Artificial Intelligence. volume 2. 1025-1029 (1992)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] T.Kawahara and S.Doshita: "Comparison of discrete and continuous classifier-based HMM." Journal of Acoustical Society of Japan (E). Vol.13, No.6. 361-367 (1992)

    • Description
      「研究成果報告書概要(欧文)」より

URL: 

Published: 1994-03-24  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi