• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Study of Multi-Modal Interface based on Simultaneous Understanding of Spoken Language

Research Project

Project/Area Number 10480070
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionNagoya University

Principal Investigator

INAGAKI Yasuyoshi  Nagoya Univ., School of Engineering, Professor, 工学研究科, 教授 (10023079)

Co-Investigator(Kenkyū-buntansha) KAJITA Shoji  Nagoya Univ., Center for Information Media Studies, Assist. Professor, 情報メディア教育センター, 助手 (30273296)
KAWAGUCHI Nobuo  Nagoya Univ., School of Engineering, Assist Professor, 工学研究科, 講師 (10273286)
TOYAMA Katsuhiko  Nagoya Univ., School of Engineering, Assoc. sor, 工学研究科, 助教授 (70217561)
MATUBARA Shigeki  Nagoya Univ., Faculty of Language and Culture, Assist. Professor, 言語文化部, 助手 (20303589)
Project Period (FY) 1998 – 1999
Project Status Completed (Fiscal Year 1999)
Budget Amount *help
¥7,300,000 (Direct Cost: ¥7,300,000)
Fiscal Year 1999: ¥2,300,000 (Direct Cost: ¥2,300,000)
Fiscal Year 1998: ¥5,000,000 (Direct Cost: ¥5,000,000)
KeywordsMulti-Modal Interface / Spoken Language Processing / Natural Language Processing / Incremental Interpretation of Natural Language / Simultaneous Understanding / Spontaneous Reply / Spoken Language Understanding / Spoken Dialogue / マルチモーダルインタフェース / 図形エディタ
Research Abstract

The spoken dialog systems has been studied to help persons who cannot use hands or pointing devices and who do not familiar with keyboard nor computers. In this research project, we develop the system named Sync/Mail, which is a multi-modal drawing tool which incrementally understands speech and quickly responds for inputs. To implement the system, we investigate following topics.
(1) Incremental Interpretation of Spoken Language
Conventional natural language processing systems manage natural language input by sentence-by-sentence basis process. Our incremental system processes the input by word-by-word basis. This method enables the spontaneous reply of input.
(2) Incremental Continuous Speech Recognition
(3) Method of Integration for Multi-Domain Systems
To build the unified system for multi-domain task, it is required the method to integrate the several single-domain dialogue system into the one unified system. We proposed an extensible and scalable architecture for the multi-domain, multi-modal conversational systems.

Report

(3 results)
  • 1999 Annual Research Report   Final Research Report Summary
  • 1998 Annual Research Report
  • Research Products

    (24 results)

All Other

All Publications (24 results)

  • [Publications] Nobuo Kawaguchi: "An Open Architechture for Multi-domain Conversational Systems"Proceedings of the ICICS '99. 1B-1-4. 1-5 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Shigeki Matsubara: "Sync/Trans : Simultaneous Machine Interpretation between English and Japanese"Lecture Note in Artificial Intelligence. 1747. 134-143 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Nobuo Kawaguchi: "An Architecture for Multi-Domain Spoken Dialog Systems"Proceedings of the NLPRS '99. 463-466 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Shigeki Matsubara: "Incremental Spoken Language Translation based on A Normal-Form Conversion of CFG"Proceedings of the NLPRS '99. 515-518 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Muhtar Mahsut: "A Method of Word Selection in Japanese-Uighur Machine Translation using Latent Semantic Analysis"Proceedings of the NLPRS '99. 459-462 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Yoshihide Kato: "Spoken Language Parsing with Robustness and Incrementality"Proceedings of the NLPRS '99. 132-137 (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Nobuo Kawaguchi, Shigeki Matsubara, Katsuhiko Toyama and Yasuyoshi Inagaki: "An open Architechture for Multi-domain Conversational Systems"Proceedings of 2nd International Conference on Information, Communication and Signal Processing (ICICS). (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Shigeki Matsubara, Katsuhiko Toyama and Yasuyoshi Inagaki: "Sync/Trans : Simultaneous Machine Interpretation between English and Japanese"Advanced Topics in Artificial Intelligence : AI'99, Lecture Note in Artificial Intelligence. 1747. 134-143 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Nobuo Kawaguchi, Shigeki Matsubara, Katsuhiko Toyama and Yasuyoshi Inagaki: "An Architechture for Multi-Domain Spoken Dialog Systems"Proceedings of the 5th Natural Language Processing Pacific Rim Symposium (NL-PRS'99). 463-466 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Shigeki Matsubara, Hiroshi Ogawa, Katsuhiko Toyama and Yasuyoshi Inagaki: "Incremental Spoken Language Translation based on A Normal-Form Conversionof CFG"Proceedings of the 5th Natural Language Processing Pacific Rim Symposium (NL-PRS'99). 515-518 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Muhtar Mahsut, Yasuyoshi Inagaki and Katsuhiko Toyama: "A Method of Word Selection in Japanese-Uighur Machine Translation using Latent Semantic Analysis"Proceedings of the 5th Natural Language Processing Pacific Rim Symposium (NL-PRS'99). 459-462 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] Yoshihide Kato, Shigeki Matsubara, Katsuhiko Toyama and Yasuyoshi Inagaki: "Spoken Language Parsing with Robustness and Incrementality"Proceedings of the 5th Natural Language Processing Pacific Rim Symposium (NL-PRS'99). 132-137 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1999 Final Research Report Summary
  • [Publications] 伊藤傑: "係り受け関係を用いた即時発話理解―音声対話メールシステムにおける手法―"平成12年度言語処理学会全国大会. 220-223 (2000)

    • Related Report
      1999 Annual Research Report
  • [Publications] Nobuo Kawaguchi: "An Architecture for Multi-Domain Spoken Dialog Systems"Proceedings of the NLPRS'99. 463-466 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 松原茂樹: "英日話し言葉翻訳のための漸進的文生成手法"情報処理学会研究報告 自然言語処理研究会NL. 132. 88-91 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 佐野諭: "漸進的処理に基づく音声対話メールツールSync/Mailの評価"情報処理学会第59回全国大会講演論文集. 4. 209-210 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 加藤芳秀: "確率文脈自由文法を用いた漸進的構文解析における出力タイミング決定手法"情報処理学会第59回全国大会講演論文集. 4. 120-121 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 田島慶一: "漸進的な連続音声認識システムの試作"平成11年度電気関係学会東海支部連合大会講演論文集. 598-598 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 河口 信夫: "発話同時理解に基づくマルチモーダル図形エディタ" 情報処理学会研究報告 音声言語研究会SLP. 22. 1-6 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 松原 茂樹: "マルチモーダル図形エディタのための漸進的な話し言葉処理手法" 情報処理学会研究報告 音声言語研究会SLP. 23. 7-12 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 松永 悟: "Sync/Mail:話し言葉の漸進的変換に基づく即時応答インタフェース" 情報処理学会研究報告 音声言語研究会SLP. 24. 33-40 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 加藤 芳秀: "文法的不適格文に対する漸進的構文解析手法" 電子情報通信学会技術研究報告NLC. 6. 39-46 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 松永 悟: "発話に即時応答可能なメールツールの提案" 情報処理学会第57回全国大会講演論文集. 4. 209-210 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 加藤 芳秀: "漸進的な構文解析における出力タイミング決定の一手法" 情報処理学会第57回全国大会講演論文集. 2. 203-204 (1998)

    • Related Report
      1998 Annual Research Report

URL: 

Published: 1998-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi