• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Study on Probabilistic Control Mechanism for Establishing Harmonic Cognitive State between Human and Systems

Research Project

Project/Area Number 14208033
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionNATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY

Principal Investigator

ASOH Hideki  National Institute of Advanced Industrial Science and Technology, Information Technology Research Institute, Senior Research Scientist, 情報技術研究部門, 主任研究員 (10344194)

Co-Investigator(Kenkyū-buntansha) ASANO Futoshi  National Institute of Advanced Industrial Science and Technology, Information Technology Research Institute, Group Leader, 情報技術研究部門, 研究グループ長 (00231895)
MOTOMURA Yoichi  National Institute of Advanced Industrial Science and Technology, Digital Human Research Center, Senior Research Scientist, デジタルヒューマン研究センター, 主任研究員 (30358171)
AKIBA Tomoyoshi  Toyohashi University of Technology, Department of Information and Computer Sciences, Associate Professor, 情報工学系, 助教授 (00356346)
ITOU Katsunobu  Nagoya University, Department of Media Science, Graduate School of Information Science, Associate Professor, 工学部, 助教授 (30356472)
HAYAMIZU Satoru  Gifu University, Department of Information Science, Graduate School of Engineering, Professor, 工学部, 教授 (90345794)
Project Period (FY) 2002 – 2004
Project Status Completed (Fiscal Year 2004)
Budget Amount *help
¥30,680,000 (Direct Cost: ¥23,600,000、Indirect Cost: ¥7,080,000)
Fiscal Year 2004: ¥8,060,000 (Direct Cost: ¥6,200,000、Indirect Cost: ¥1,860,000)
Fiscal Year 2003: ¥7,930,000 (Direct Cost: ¥6,100,000、Indirect Cost: ¥1,830,000)
Fiscal Year 2002: ¥14,690,000 (Direct Cost: ¥11,300,000、Indirect Cost: ¥3,390,000)
KeywordsHuman Interface / Dialog System / Dialog Control / Probabilistic Inference / Bayesian Network / Cognitive Harmonic State / ユーザインタフェース / インタラクション / ユーザ・インタフェース / 確立的推論
Research Abstract

We conducted research aiming to establish harmonic cognitive state between human and information systems based on statistical techniques, and achieved the following results.
1.We proposed a statistical method of detecting and tracking moving users' speech events using a microphone array,. The method was evaluated with data acquired in real office environment 85% correct rate for speech interval estimation was achieved.
2.We proposed a method of modeling users' utterances in the question answering task which include fixed phrases. We applied the proposed method to a speech-driven question answering system and confirmed that the accuracy of recognizing spoken questions and the task achievement rate were improved significantly. We also proposed a method to collect spontaneously spoken queries for speech-driven information retrieval systems. Using the method we collected spoken queries under the task of NTCIR-3 and NTCIR-4 information retrieval.
3.We proposed a statistical method of estimating users' knowledge level for interactive visitor guide systems. We collected dialog data for 12 users through the Wizard of Oz method. We evaluated the performance of the estimation method for the problem of discriminating users into 4 classes. The correct rate about 87% was achieved.
4.We collected natural spoken dialog of 20 users for the task of controlling home electronic systems. We transcribed and labeled the speech data. These result supports that the statistical methods based on dynamic Bayesian networks are effective for estimating users' status in the various interaction tasks. Future works include improving the estimation methods and evaluating with collected data in detail, investigating the way of using the estimated state for systems decision making and answering, and constructing various dialog systems.

Report

(4 results)
  • 2004 Annual Research Report   Final Research Report Summary
  • 2003 Annual Research Report
  • 2002 Annual Research Report
  • Research Products

    (43 results)

All 2005 2004 2003 2002 Other

All Journal Article (25 results) Book (5 results) Publications (13 results)

  • [Journal Article] Tracking Human Speech Events Using a Particle Filter2005

    • Author(s)
      麻生 英樹 他
    • Journal Title

      Proceedings of 2005 IEEE International Conference on Acoustics, Speech and Signal Processing

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] ニューロコンピューティング研究から生まれたもの2005

    • Author(s)
      麻生 英樹 他
    • Journal Title

      電子情報通信学会誌 88巻・4号

      Pages: 234-239

    • NAID

      110003232018

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Tracking human speech events using particle filter2005

    • Author(s)
      Hideki Asoh et al.
    • Journal Title

      Proceedings of 2005 IEEE International Conference on Acoustics, Speech and Signal Processing

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Outcomes of neuro-computing research : theoretical and applicative aspects2005

    • Author(s)
      Hideki Asoh
    • Journal Title

      The Journal of the Institute of Electronics Information and Communication Engineers vol.88, no.4

      Pages: 234-239

    • NAID

      110003232019

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] ニューロコンピューティング研究から生まれたもの2005

    • Author(s)
      麻生 英樹 他
    • Journal Title

      電子情報通信学会誌 88巻・4号(印刷予定)

    • NAID

      110003232018

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Detection and Separation of Speech Event Using Audio and Video Information Fusion and Its Application to Robust Speech Interface2004

    • Author(s)
      浅野 太, 他
    • Journal Title

      Euraship Journal of Applied Signal Processing 2004巻11号

      Pages: 1727-1738

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Sound Source Localization and Separation Based on the EM Algorithm2004

    • Author(s)
      浅野 太 他
    • Journal Title

      Proceedings of ISCA Tutorial and Research Workshop on Statistical and Perceptual Audio Processing (CD-ROM)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] Collecting Spontaneous Queries for Information Retreaval2004

    • Author(s)
      秋葉 友良, 他
    • Journal Title

      Proceedings of the 4th International Conference on Language Resources and Evaluation

      Pages: 1439-1442

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] An Application of a Particle Filter to Bayesian Multiple Sound Source Tracking with Audio and Video Information Fusion2004

    • Author(s)
      麻生 英樹 他
    • Journal Title

      Proceedings of The 7th International Conference on Information Fusion

      Pages: 805-812

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Effects of Language Modeling on Speech-Driven Question Answering2004

    • Author(s)
      秋葉 友良 他
    • Journal Title

      Proceedings of the 8th International Conference on Spoken Language Processing (CD-ROM)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Annual Research Report 2004 Final Research Report Summary
  • [Journal Article] Detection and separation of speech event using audio and video information fusion and its application to robust speech interface2004

    • Author(s)
      Futoshi Asano, et al.
    • Journal Title

      Euraship Journal of Applied Signal Processing vol.2004:11

      Pages: 1727-1738

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Sound source localization and separation based on the EM algorithm2004

    • Author(s)
      Futoshi Asano, et al.
    • Journal Title

      Proceedings of ISCA Tutorial and Research Workshop on Statistical and Perceptual Audio Processing

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Collecting spontaneous queries for information retreaval2004

    • Author(s)
      Tomoyoshi Akiga, et al.
    • Journal Title

      Proceedings of the 4th International Conference on Language Resources and Evaluation

      Pages: 1439-1442

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] An application of a particle filter to Bayesian multiple sound source tracking with audio and video information fusion2004

    • Author(s)
      Hideki Asoh, et al.
    • Journal Title

      Proceedings of the 7th International Conference on Information Fusion

      Pages: 805-812

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Effects of language modeling on speech-driven question answering2004

    • Author(s)
      Tomoyoshi Akiba, et al.
    • Journal Title

      Proceedings of the 8th International Conference on Spoken Language Processing

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Collecting Spontaneous Queries for Information Retreaval2004

    • Author(s)
      秋葉 友良 他
    • Journal Title

      Proceedings of the 4th International Conferenceon Language Resources and Evaluation

      Pages: 1439-1442

    • Related Report
      2004 Annual Research Report
  • [Journal Article] An Application of a Particle Filter to Bayesian Multiple Sound Source Tracking with Audio and Video Information Fusion2004

    • Author(s)
      麻生 英樹 他
    • Journal Title

      Proceedings of the 7th International Conference on Information Fusion

      Pages: 805-812

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Fusion of audio and video information for detecting speech events2003

    • Author(s)
      浅野 太, 他
    • Journal Title

      Proceedings of The 6th International Conference on Information Fusion

      Pages: 386-393

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Detection and Separation of Speech Segment Using Audio and Video Information Fusion2003

    • Author(s)
      浅野 太, 他
    • Journal Title

      Proceedings of 8th European Conference on Speech Communication and Technology

      Pages: 2257-2260

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 機械の学習と人間の学習-統計的学習の立場から2003

    • Author(s)
      麻生 英樹, 他
    • Journal Title

      人工知能学会誌 18巻・5号

      Pages: 526-530

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Fusion of audio and video information for detecting speech events2003

    • Author(s)
      Futoshi Asano, et al.
    • Journal Title

      Proceedings of the 6th International Conference on Information Fusion

      Pages: 386-393

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Detection and separation of speech segment using audio and video information fusion2003

    • Author(s)
      Futoshi Asano, et al.
    • Journal Title

      Proceedings of 8th European Conference on Speech Communication and Technology

      Pages: 2257-2260

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Machine learning and human learning-from the view point of statistical learning2003

    • Author(s)
      Hideki Asoh
    • Journal Title

      Journal of the Japanese Society for Artificial Intelligence Vol.18, no.5

      Pages: 526-530

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 自然言語処理におけるベイジアンネット2002

    • Author(s)
      秋葉 友良, 他
    • Journal Title

      人工知能学会誌 17巻・5号

      Pages: 553-558

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Bayesian networks for natural language processing2002

    • Author(s)
      Tomoyoshi Akiba, et al.
    • Journal Title

      Journal of the Japanese Society for Artificial Intelligence vol.17, no.5

      Pages: 553-558

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Book] 高次認知のコネクショニストモデル2005

    • Author(s)
      麻生 英樹, 他
    • Publisher
      共立出版(印刷予定)
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Book] Cnnectionism and statistical learning, Connectionist Models of Higher Order Cognitive Processes2005

    • Author(s)
      Hideki Asoh
    • Publisher
      Kyoritsu Shuppan (in printing)
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Book] 高次認知のコネクショニストモデル2005

    • Author(s)
      麻生 英樹 他
    • Publisher
      共立出版株式会社(印刷予定)
    • Related Report
      2004 Annual Research Report
  • [Book] パターン認識と学習の統計学2003

    • Author(s)
      麻生 英樹, 他
    • Total Pages
      225
    • Publisher
      岩波書店
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Book] Pattern recognition and learning-from the perspective of Statistical Science, in Statistics of Pattern Recognition and Learning2003

    • Author(s)
      Hideki Asoh
    • Publisher
      Iwanami Shoten
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Publications] 浅野 太 他: "Detection and Separation of Speech Event Using Audio and Video Information Fusion and Its Application to Robust Speech Interface"Euraship Journal of Applied Signal Processing. 出版予定. (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] 浅野 太 他: "Fusion of audio and video information for detecting speech events"Proceedings, of The 6th International Conference on Information Fusion. 386-393 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 浅野 太 他: "Detection and Separation of Speech Segment Using Audio and Video Information Fusion"Proceedings of 8th European Conference on Speech Communication and Technology. 2257-2260 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 麻生 英樹 他: "機械の学習と人間の学習-統計的学習の立場から"人工知能学会誌. 18巻・5号. 526-530 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 麻生 英樹 他: "確率的推論を利用したマルチモーダル対話制御"2003年度人工知能学会全国大会(第17回)論文集. (CD-ROM). 1C1-04 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 麻生 英樹 他: "パーティクルフィルタを用いた複数話者の位置と発話状態の追跡"2003年度ベイジアンネットセミナー(BN2003)予稿集. 93-100 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 麻生英樹 他: "パターン認識と学習の統計学"岩波書店. 225 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 浅野 太, 他: "ベイジアンネットを用いた音響情報と画像情報の統合"2002年ベイジアンネットセミナーBN2002予稿集. 93-98 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 浅野 太, 他: "音響情報と画像情報の統合による発話区間検出-基本的なコンセプト-"日本音響学会2003年春季研究発表会講演論文集. 49-50 (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] 秋葉 友良, 他: "自然言語処理におけるベイジアンネット"人工知能学会誌. 17巻5号. 553-558 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 秋葉 友良, 他: "音声入力型情報検索のための自由発話収録"日本音響学会2003年春季研究発表会講演論文集. 59-60 (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] 本村 陽一, 他: "確率的タスクモデリングによるインタラクティブシステムの制御と学習"2002年度人工知能学会全国大会(第16回)論文集. (CD-ROM). 1B1-04 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 本村 陽一, 他: "確率的タスクモデルによる知的システムの学習"計算論的学習理論ワークショップ(IBIS2002)予稿集. 49-52 (2002)

    • Related Report
      2002 Annual Research Report

URL: 

Published: 2002-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi