• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on Understanding of English Utterances by Second Language Speakers

Research Project

Project/Area Number 22520598
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Foreign language education
Research InstitutionDoshisha University

Principal Investigator

YAMAMOTO Seiichi  同志社大学, 理工学研究科, 教授 (20374100)

Co-Investigator(Kenkyū-buntansha) NISHIDA Masafumi  同志社大学, 理工学研究科, 准教授 (80361442)
Project Period (FY) 2010 – 2012
Project Status Completed (Fiscal Year 2012)
Budget Amount *help
¥3,900,000 (Direct Cost: ¥3,000,000、Indirect Cost: ¥900,000)
Fiscal Year 2012: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2011: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2010: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Keywords音声認識 / 言語処理 / CALL / 言語モデル
Research Abstract

In this research we constructed a learner corpus in which each expression was subjectively evaluated by English natives, and we developed a dialogue-based CALL system which showed answers in Japanese to questions from the system to restrict their utterances, using the learner corpus. The CALL system adopts not only commonly used automatic speech recognizers using ngram and finite state automata (FSA) designed for accepting utterances in a target domain but also one using a model of out-of-scope utterances. In this research we also propose a novel classification method which classifies the speech recognition result from the recognizer using the FSA into accepted or rejected. The classification method adopts differences among acoustic likelihoods from the multiple recognizers as well as edit distances among the multiple recognizers’ outputs as features for the classifier.

Report

(4 results)
  • 2012 Annual Research Report   Final Research Report ( PDF )
  • 2011 Annual Research Report
  • 2010 Annual Research Report
  • Research Products

    (51 results)

All 2013 2012 2011 2010 Other

All Journal Article (8 results) (of which Peer Reviewed: 8 results) Presentation (43 results)

  • [Journal Article] Selection and Rejection of Recognition Results Obtained with Multiple Recognizers of Various Recognition Units Using Support Vector Machine2012

    • Author(s)
      N. Suzuki, T. Tanaka, M. Nishida, S. Yamamoto
    • Journal Title

      Journal of Signal Processing

      Volume: Vol. 16, No. 4 Pages: 327-330

    • NAID

      130004457025

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] Speaker Clustering in Multi-party Conversation2011

    • Author(s)
      M. Nishida, Y. Ishikawa, S. Yamamoto
    • Journal Title

      Proceedings of the 3rd Nordic Symposium on Multimodal Communication. NEALT Proceedings Series

      Volume: Vol. 15 Pages: 56-61

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] Speaker Clustering in Multi-party Conversation2011

    • Author(s)
      M.Nishida
    • Journal Title

      NEALT Proceedings Series

      Volume: 15 Pages: 56-61

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Analysis on the Efficiency of Statistical Measures to Identify Network Structure of Chaos Coupled Systems2010

    • Author(s)
      Y. Ueoka, T. Suzuki, and S. Yamamoto
    • Journal Title

      J. of Modern Physics C

      Volume: vol. 21, No. 8 Pages: 1065-1079

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] 林克彦、渡辺太郎、塚田元、磯崎英樹、山本誠一2010

    • Author(s)
      統計的機械翻訳におけるマージン最大化学習
    • Journal Title

      人工知能学会論文誌

      Volume: Vol. 25, No. 5 Pages: 593-601

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] 統計的機械翻訳におけるマージン最大化学習2010

    • Author(s)
      林克彦
    • Journal Title

      人工知能学会誌

      Volume: 25 Pages: 593-601

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Analysis on the Efficiency of Statistical Measures to Identify Network Structure of Chaos Coupled Systems2010

    • Author(s)
      Yuta Ueoka
    • Journal Title

      J.of Modern Physics C

      Volume: 21 Pages: 1065-1079

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Gaze and Turn-taking Behavior in Casual Conversational Interactions

    • Author(s)
      K. Jokinen, H. Furukawa, M. Nishida, S. Yamamoto
    • Journal Title

      ACM Trans. Interactive Intelligent Systems, Tiis

      Volume: Vol. 6 Issue 2,(to publish)

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Presentation] Differences in Interactional Attitudes in Native and Second Language Conversations: Quantitative Analyses of Multimodal Three-Party Corpus2013

    • Author(s)
      S. Yamamoto, K. Taguchi, I. Umata, K. Kabashima, M. Nishida
    • Organizer
      Cogsci2013
    • Place of Presentation
      Berlin, Germany (to appear)
    • Related Report
      2012 Final Research Report
  • [Presentation] A Preliminary Investigation on Improving Chinese Pinyin to Character Conversion Using MI Based Automatic Lexical Formation2013

    • Author(s)
      J. Zhang , W. Li , X. Wang, M. Nishida, and S. Yamamoto
    • Organizer
      IEICE Technical Report
    • Place of Presentation
      (SP-2012-98, pp. 1-5)
    • Related Report
      2012 Final Research Report
  • [Presentation] A Study on Perceptual Training of Mandarin Tone 2 and Tone 3 by Japanese Learners2013

    • Author(s)
      J. Zhang, Y. Sun, T. Zou, X. Wang, M. Nishida, and S. Yamamoto
    • Organizer
      IEICE Technical Report
    • Place of Presentation
      (SP-2012-99, pp. 7-12)
    • Related Report
      2012 Final Research Report
  • [Presentation] 学習者コーパスを利用した音声対話型CALLシステムにおける想定外発話検出手法2013

    • Author(s)
      永井祐、王暁芸、西田昌史、山本誠一
    • Organizer
      電子情報通信学会 技報
    • Place of Presentation
      (SP-2012-100)
    • Related Report
      2012 Final Research Report
  • [Presentation] An MI Criterion Based Word Segmentation Method and Its Application to Chinese Pinyin-to-word Conversion2013

    • Author(s)
      J. Zhang , W. Li , X. Wang, M. Nishida, and S. Yamamoto
    • Organizer
      Proc. 2013 IEICE General Conf.,
    • Place of Presentation
      (D-14-2)
    • Related Report
      2012 Final Research Report
  • [Presentation] 学習者コーパスを利用した音声対話型 CALLシステムの開発2013

    • Author(s)
      王暁芸、永井祐、西田昌史、山本誠一
    • Organizer
      信学会総全大会
    • Place of Presentation
      (D-14-7)
    • Related Report
      2012 Final Research Report
  • [Presentation] Differences in Interactional Attitudes in Native and Second Language Conversations: Quantitative Analyses of Multimodal Three-Party Corpus2013

    • Author(s)
      S. Yamamoto
    • Organizer
      CogSci 2013
    • Place of Presentation
      Berlin, Gemany
    • Related Report
      2012 Annual Research Report
  • [Presentation] A Preliminary Investigation on Improving Chinese Pinyin-to-Character Conversion Using MI Based Automatic Lexical Formation2013

    • Author(s)
      Jinsong ZHANG
    • Organizer
      IEICE Technical Report, SP-2012-98
    • Place of Presentation
      Doshisha University
    • Related Report
      2012 Annual Research Report
  • [Presentation] A Study on Perceptual Training of Mandarin Tone 2 and Tone 3 by Japanese Learners2013

    • Author(s)
      Jinsong ZHANG
    • Organizer
      IEICE Technical Report, SP-2012-99
    • Place of Presentation
      同志社大学
    • Related Report
      2012 Annual Research Report
  • [Presentation] 学習者コーパスを利用した音声対話型CALLシステムにおける想定外発話検出手法2013

    • Author(s)
      永井 祐
    • Organizer
      電子情報通信学会 音声研究会
    • Place of Presentation
      同志社大学
    • Related Report
      2012 Annual Research Report
  • [Presentation] An MI Criterion Based Word Segmentation Method and Its Application to Chinese Pinyin-to-word Conversion2013

    • Author(s)
      Jinsong ZHANG
    • Organizer
      2013 IEICE General Conf.
    • Place of Presentation
      岐阜大学
    • Related Report
      2012 Annual Research Report
  • [Presentation] 学習者コーパスを利用した音声対話型CALLシステムの開発2013

    • Author(s)
      王 暁芸
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      岐阜大学
    • Related Report
      2012 Annual Research Report
  • [Presentation] Multimodal Corpus of Multi-party Conversations in Second Language2012

    • Author(s)
      S.Yamazaki
    • Organizer
      Int.Conf.on Language Resources and Evaluation2012
    • Place of Presentation
      Lutfi Kirdar Conv.& Exhib.Cent.(Turkey)
    • Year and Date
      2012-05-26
    • Related Report
      2011 Annual Research Report
  • [Presentation] Automatic Speech Recognition with Confidence Measures Obtained by Multiple Recognizers of Various Recognition Units2012

    • Author(s)
      N.Suzuki
    • Organizer
      Int.Workshop on Nonlinear Circuits, Commun.and Signal Processing 2012
    • Place of Presentation
      Waikiki Beach Marriot Resort & Spa (Hawaii)
    • Year and Date
      2012-03-02
    • Related Report
      2011 Annual Research Report
  • [Presentation] Sentence Classification with Grammatical Errors and those Out of Scope of Grammar Assumption for Dialogue-based CALL Systems2012

    • Author(s)
      Y. Nagai, T. Senzai, S. Yamamoto, M. Nishida
    • Organizer
      Proc. of TSD2012
    • Place of Presentation
      (616-623, Brno, Czech Republic, Springer)
    • Related Report
      2012 Final Research Report
  • [Presentation] Multimodal Corpus of Conversations in Mother Tongue and Second Language by Same Interlocutors2012

    • Author(s)
      K. Kabashima, M. Nishida, K. Jokinen, S. Yamamoto
    • Organizer
      Workshop on Eye Gaze in Intelligent Human Machine Interaction: Eye Gaze and Multimodality
    • Place of Presentation
      Santa Monica, Cal
    • Related Report
      2012 Final Research Report
  • [Presentation] Multimodal Corpus of Multi-party Conversations in Second Language2012

    • Author(s)
      S. Yamasaki, H. Furukawa, M. Nishida, K. Jokinen, S. Yamamoto
    • Organizer
      LREC2012
    • Place of Presentation
      Istanbul, Turkey(416-421)
    • Related Report
      2012 Final Research Report
  • [Presentation] Automatic Speech Recognition with Confidence Measures Obtained by Multiple Recognizers of Various Recognition Units2012

    • Author(s)
      N. Suzuki, T. Tanaka, M. Nishida, and S. Yamamoto
    • Organizer
      NCSP 2012
    • Place of Presentation
      Hawaii
    • Related Report
      2012 Final Research Report
  • [Presentation] 音声対話型CALLシステムでの信頼度評価の検討2012

    • Author(s)
      千歳智久,永井祐,西田昌史,山本誠一
    • Organizer
      信学会総全大会
    • Related Report
      2012 Final Research Report
  • [Presentation] 音声対話型CALLシステムの認識性能評価2012

    • Author(s)
      飛田麻夕子,千歳智久,永井祐,西田昌史,山本誠一
    • Organizer
      信学会総全大会
    • Related Report
      2012 Final Research Report
  • [Presentation] Multimodal Corpus of Multi-party Conversations in Second Language2012

    • Author(s)
      S. Yamasaki
    • Organizer
      LREC 2012
    • Place of Presentation
      Istanbul, Turkey
    • Related Report
      2012 Annual Research Report
  • [Presentation] Sentence Classification with Grammatical Errors and those Out of Scope of Grammar Assumption for Dialogue-based CALL Systems2012

    • Author(s)
      Y. Nagai
    • Organizer
      TSD 2012
    • Place of Presentation
      Brno, Czech Republic
    • Related Report
      2012 Annual Research Report
  • [Presentation] Multimodal Corpus of Conversations in Mother Tongue and Second Language by Same Interlocutors2012

    • Author(s)
      K. Kabashima
    • Organizer
      Workshop on Eye Gaze in Intelligent Human Machine Interaction: Eye Gaze and Multimodality
    • Place of Presentation
      Santa Monica ,USA
    • Related Report
      2012 Annual Research Report
  • [Presentation] Using Features from a Bilingual Alignment Model in Transliteration Mining2011

    • Author(s)
      T.Fukunishi
    • Organizer
      The 5^<th> International Joint Conference on Natural Language Processing
    • Place of Presentation
      Shangri-La hotel (Thailand)
    • Year and Date
      2011-11-10
    • Related Report
      2011 Annual Research Report
  • [Presentation] A Multimodal Corpus for Modeling Turn Management in Multi-party Conversations2011

    • Author(s)
      H.Furukawa
    • Organizer
      Oriental COCOSDA
    • Place of Presentation
      National Chiao Tung Univ.(Taiwan)
    • Year and Date
      2011-10-27
    • Related Report
      2011 Annual Research Report
  • [Presentation] The Application of Bayesian Alignment Techniques to Transliteration Generation and Mining2011

    • Author(s)
      A.Finch
    • Organizer
      Int.Universal Commun.Symposium2011
    • Place of Presentation
      Gumi Convention and Exhibition Cent.(Korea)
    • Year and Date
      2011-10-13
    • Related Report
      2011 Annual Research Report
  • [Presentation] Speaker Clustering Based on Non-negative Matrix Factorization2011

    • Author(s)
      M.Nishida
    • Organizer
      INTERSPEECH2011
    • Place of Presentation
      Firenze Fiera venue (Italy)
    • Year and Date
      2011-08-16
    • Related Report
      2011 Annual Research Report
  • [Presentation] Speaker Clustering in Multi-party Conversation and Research on CALL Systems2011

    • Author(s)
      M.Nishida
    • Organizer
      Nordic Symposium on Multi-modal Symposium
    • Place of Presentation
      Helsinki University (Finland)
    • Year and Date
      2011-05-09
    • Related Report
      2011 Annual Research Report
  • [Presentation] 日本語母語話者を対象としたモデル選択と話者適応に基づく英語音声認識2011

    • Author(s)
      椛島康輔
    • Organizer
      2011年 電子情報通信学会総合大会
    • Place of Presentation
      東京都市大学(紙上開催)
    • Year and Date
      2011-03-14
    • Related Report
      2010 Annual Research Report
  • [Presentation] Using Features from a Bilingual Alignment Model in Transliteration Mining2011

    • Author(s)
      T. Fukunishi, A. Finch, S. Yamamoto, E. Sumita
    • Organizer
      The 5th International Joint Conference on Natural Language Processing
    • Place of Presentation
      Chiang Mai, Thailand(49-57)
    • Related Report
      2012 Final Research Report
  • [Presentation] The Application of Bayesian Alignment Techniques to Transliteration Generation and Mining2011

    • Author(s)
      A. Finch, K. Yasuda, T. Fukunishi, S. Yamamoto, E. Sumita
    • Organizer
      The 5th International Universal Communication Symposium, IUCS2011
    • Place of Presentation
      Gumi, Korea
    • Related Report
      2012 Final Research Report
  • [Presentation] A Multimodal Corpus for Modeling Turn Management in Multi-party Conversations2011

    • Author(s)
      H. Furukawa, M. Nishida, K. Jokinen, S. Yamamoto
    • Organizer
      Oriental COCOSDA
    • Place of Presentation
      Hsinchu, Taiwan
    • Related Report
      2012 Final Research Report
  • [Presentation] Speaker Clustering Based on Non-negative Matrix Factorization2011

    • Author(s)
      M. Nishida, S. Yamamoto
    • Organizer
      Proceeding of INTERSPEECH2011
    • Place of Presentation
      Firenze
    • Related Report
      2012 Final Research Report
  • [Presentation] Speaker Clustering in Multi-party Conversation and Research on CALL Systems2011

    • Author(s)
      M. Nishida, S. Yamamoto
    • Organizer
      Nordic Symposium on Multi-modal Symposium
    • Place of Presentation
      Helsinki
    • Related Report
      2012 Final Research Report
  • [Presentation] 日本語母語話者を対象としたモデル選択と話者適応に基づく英語音声認識2011

    • Author(s)
      椛島康輔、西田昌史,山本誠一
    • Organizer
      信学会総全大会
    • Related Report
      2012 Final Research Report
  • [Presentation] Turn alignment using eye-gaze and speech in spoken interaction2010

    • Author(s)
      Kristiina Jokinen
    • Organizer
      Interspeech2010 11^<th> Annual Conference of the International Speech Communication Association
    • Place of Presentation
      Makuhari Messe, Chiba
    • Year and Date
      2010-09-29
    • Related Report
      2010 Annual Research Report
  • [Presentation] Hierarchical Phrase-based Machine Translation with Word-based Reordering Model2010

    • Author(s)
      Katsuhiko Hayashi
    • Organizer
      The 23rd International Conference on Computational Linguistics (Coling2010)
    • Place of Presentation
      Beijing International Convention Center, Beijing
    • Year and Date
      2010-08-26
    • Related Report
      2010 Annual Research Report
  • [Presentation] 単語並び換えモデルを考慮した統計的階層句機械翻訳システム2010

    • Author(s)
      林克彦
    • Organizer
      情報処理学会第196回自然言語処理研究会
    • Place of Presentation
      東京工業大学(東京)
    • Year and Date
      2010-05-27
    • Related Report
      2010 Annual Research Report
  • [Presentation] Demonstration of Conversational Eye-gaze Data2010

    • Author(s)
      Kristiina Jokinen
    • Organizer
      LREC2010-7th Language Resources and Evaluation Conference
    • Place of Presentation
      Mediterranean Conference Center, Marta
    • Year and Date
      2010-05-20
    • Related Report
      2010 Annual Research Report
  • [Presentation] Turn alignment using eye-gaze and speech in spoken interaction2010

    • Author(s)
      K. Jokinen, K. Harada, M. Nishida, S. Yamamoto
    • Organizer
      Proceedings of INTERSPEECH2010
    • Place of Presentation
      Makuhari Messe(018-2021)
    • Related Report
      2012 Final Research Report
  • [Presentation] Hierarchical Phrase-based Machine Translation with Word-based Reordering Model2010

    • Author(s)
      K. Hayashi, H. Tsukada, K. Sudo, K. Kevin and S. Yamamoto
    • Organizer
      Computational Linguistics
    • Place of Presentation
      (Computational Linguistics)
    • Related Report
      2012 Final Research Report
  • [Presentation] Demonstration of Conversational Eye-gaze Data2010

    • Author(s)
      K. Jokinen, S. Yamamoto, M. Nishida
    • Organizer
      Workshop of Multimodal Corpus of LREC2010
    • Related Report
      2012 Final Research Report
  • [Presentation] 単語並び換えモデルを考慮した統計的階層句機械翻訳システム2010

    • Author(s)
      林克彦、塚田元,須藤克仁,Kevin Duh,山本誠一
    • Organizer
      情報処理学会自然言語処理研究会
    • Related Report
      2012 Final Research Report

URL: 

Published: 2010-08-23   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi