• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2012 Fiscal Year Final Research Report

Research on Understanding of English Utterances by Second Language Speakers

Research Project

  • PDF
Project/Area Number 22520598
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Foreign language education
Research InstitutionDoshisha University

Principal Investigator

YAMAMOTO Seiichi  同志社大学, 理工学研究科, 教授 (20374100)

Co-Investigator(Kenkyū-buntansha) NISHIDA Masafumi  同志社大学, 理工学研究科, 准教授 (80361442)
Project Period (FY) 2010 – 2012
Keywords音声認識 / 言語処理 / CALL / 言語モデル
Research Abstract

In this research we constructed a learner corpus in which each expression was subjectively evaluated by English natives, and we developed a dialogue-based CALL system which showed answers in Japanese to questions from the system to restrict their utterances, using the learner corpus. The CALL system adopts not only commonly used automatic speech recognizers using ngram and finite state automata (FSA) designed for accepting utterances in a target domain but also one using a model of out-of-scope utterances. In this research we also propose a novel classification method which classifies the speech recognition result from the recognizer using the FSA into accepted or rejected. The classification method adopts differences among acoustic likelihoods from the multiple recognizers as well as edit distances among the multiple recognizers’ outputs as features for the classifier.

  • Research Products

    (27 results)

All 2013 2012 2011 2010 Other

All Journal Article (5 results) (of which Peer Reviewed: 5 results) Presentation (22 results)

  • [Journal Article] Selection and Rejection of Recognition Results Obtained with Multiple Recognizers of Various Recognition Units Using Support Vector Machine2012

    • Author(s)
      N. Suzuki, T. Tanaka, M. Nishida, S. Yamamoto
    • Journal Title

      Journal of Signal Processing

      Volume: Vol. 16, No. 4 Pages: 327-330

    • Peer Reviewed
  • [Journal Article] Speaker Clustering in Multi-party Conversation2011

    • Author(s)
      M. Nishida, Y. Ishikawa, S. Yamamoto
    • Journal Title

      Proceedings of the 3rd Nordic Symposium on Multimodal Communication. NEALT Proceedings Series

      Volume: Vol. 15 Pages: 56-61

    • Peer Reviewed
  • [Journal Article] Analysis on the Efficiency of Statistical Measures to Identify Network Structure of Chaos Coupled Systems2010

    • Author(s)
      Y. Ueoka, T. Suzuki, and S. Yamamoto
    • Journal Title

      J. of Modern Physics C

      Volume: vol. 21, No. 8 Pages: 1065-1079

    • Peer Reviewed
  • [Journal Article] 林克彦、渡辺太郎、塚田元、磯崎英樹、山本誠一2010

    • Author(s)
      統計的機械翻訳におけるマージン最大化学習
    • Journal Title

      人工知能学会論文誌

      Volume: Vol. 25, No. 5 Pages: 593-601

    • Peer Reviewed
  • [Journal Article] Gaze and Turn-taking Behavior in Casual Conversational Interactions

    • Author(s)
      K. Jokinen, H. Furukawa, M. Nishida, S. Yamamoto
    • Journal Title

      ACM Trans. Interactive Intelligent Systems, Tiis

      Volume: Vol. 6 Issue 2,(to publish)

    • Peer Reviewed
  • [Presentation] Differences in Interactional Attitudes in Native and Second Language Conversations: Quantitative Analyses of Multimodal Three-Party Corpus2013

    • Author(s)
      S. Yamamoto, K. Taguchi, I. Umata, K. Kabashima, M. Nishida
    • Organizer
      Cogsci2013
    • Place of Presentation
      Berlin, Germany (to appear)
    • Year and Date
      20130000
  • [Presentation] A Preliminary Investigation on Improving Chinese Pinyin to Character Conversion Using MI Based Automatic Lexical Formation2013

    • Author(s)
      J. Zhang , W. Li , X. Wang, M. Nishida, and S. Yamamoto
    • Organizer
      IEICE Technical Report
    • Place of Presentation
      (SP-2012-98, pp. 1-5)
    • Year and Date
      20130000
  • [Presentation] A Study on Perceptual Training of Mandarin Tone 2 and Tone 3 by Japanese Learners2013

    • Author(s)
      J. Zhang, Y. Sun, T. Zou, X. Wang, M. Nishida, and S. Yamamoto
    • Organizer
      IEICE Technical Report
    • Place of Presentation
      (SP-2012-99, pp. 7-12)
    • Year and Date
      20130000
  • [Presentation] 学習者コーパスを利用した音声対話型CALLシステムにおける想定外発話検出手法2013

    • Author(s)
      永井祐、王暁芸、西田昌史、山本誠一
    • Organizer
      電子情報通信学会 技報
    • Place of Presentation
      (SP-2012-100)
    • Year and Date
      20130000
  • [Presentation] An MI Criterion Based Word Segmentation Method and Its Application to Chinese Pinyin-to-word Conversion2013

    • Author(s)
      J. Zhang , W. Li , X. Wang, M. Nishida, and S. Yamamoto
    • Organizer
      Proc. 2013 IEICE General Conf.,
    • Place of Presentation
      (D-14-2)
    • Year and Date
      20130000
  • [Presentation] 学習者コーパスを利用した音声対話型 CALLシステムの開発2013

    • Author(s)
      王暁芸、永井祐、西田昌史、山本誠一
    • Organizer
      信学会総全大会
    • Place of Presentation
      (D-14-7)
    • Year and Date
      20130000
  • [Presentation] Sentence Classification with Grammatical Errors and those Out of Scope of Grammar Assumption for Dialogue-based CALL Systems2012

    • Author(s)
      Y. Nagai, T. Senzai, S. Yamamoto, M. Nishida
    • Organizer
      Proc. of TSD2012
    • Place of Presentation
      (616-623, Brno, Czech Republic, Springer)
    • Year and Date
      20120000
  • [Presentation] Multimodal Corpus of Conversations in Mother Tongue and Second Language by Same Interlocutors2012

    • Author(s)
      K. Kabashima, M. Nishida, K. Jokinen, S. Yamamoto
    • Organizer
      Workshop on Eye Gaze in Intelligent Human Machine Interaction: Eye Gaze and Multimodality
    • Place of Presentation
      Santa Monica, Cal
    • Year and Date
      20120000
  • [Presentation] Multimodal Corpus of Multi-party Conversations in Second Language2012

    • Author(s)
      S. Yamasaki, H. Furukawa, M. Nishida, K. Jokinen, S. Yamamoto
    • Organizer
      LREC2012
    • Place of Presentation
      Istanbul, Turkey(416-421)
    • Year and Date
      20120000
  • [Presentation] Automatic Speech Recognition with Confidence Measures Obtained by Multiple Recognizers of Various Recognition Units2012

    • Author(s)
      N. Suzuki, T. Tanaka, M. Nishida, and S. Yamamoto
    • Organizer
      NCSP 2012
    • Place of Presentation
      Hawaii
    • Year and Date
      20120000
  • [Presentation] 音声対話型CALLシステムでの信頼度評価の検討2012

    • Author(s)
      千歳智久,永井祐,西田昌史,山本誠一
    • Organizer
      信学会総全大会
    • Year and Date
      20120000
  • [Presentation] 音声対話型CALLシステムの認識性能評価2012

    • Author(s)
      飛田麻夕子,千歳智久,永井祐,西田昌史,山本誠一
    • Organizer
      信学会総全大会
    • Year and Date
      20120000
  • [Presentation] Using Features from a Bilingual Alignment Model in Transliteration Mining2011

    • Author(s)
      T. Fukunishi, A. Finch, S. Yamamoto, E. Sumita
    • Organizer
      The 5th International Joint Conference on Natural Language Processing
    • Place of Presentation
      Chiang Mai, Thailand(49-57)
    • Year and Date
      20110000
  • [Presentation] The Application of Bayesian Alignment Techniques to Transliteration Generation and Mining2011

    • Author(s)
      A. Finch, K. Yasuda, T. Fukunishi, S. Yamamoto, E. Sumita
    • Organizer
      The 5th International Universal Communication Symposium, IUCS2011
    • Place of Presentation
      Gumi, Korea
    • Year and Date
      20110000
  • [Presentation] A Multimodal Corpus for Modeling Turn Management in Multi-party Conversations2011

    • Author(s)
      H. Furukawa, M. Nishida, K. Jokinen, S. Yamamoto
    • Organizer
      Oriental COCOSDA
    • Place of Presentation
      Hsinchu, Taiwan
    • Year and Date
      20110000
  • [Presentation] Speaker Clustering Based on Non-negative Matrix Factorization2011

    • Author(s)
      M. Nishida, S. Yamamoto
    • Organizer
      Proceeding of INTERSPEECH2011
    • Place of Presentation
      Firenze
    • Year and Date
      20110000
  • [Presentation] Speaker Clustering in Multi-party Conversation and Research on CALL Systems2011

    • Author(s)
      M. Nishida, S. Yamamoto
    • Organizer
      Nordic Symposium on Multi-modal Symposium
    • Place of Presentation
      Helsinki
    • Year and Date
      20110000
  • [Presentation] 日本語母語話者を対象としたモデル選択と話者適応に基づく英語音声認識2011

    • Author(s)
      椛島康輔、西田昌史,山本誠一
    • Organizer
      信学会総全大会
    • Year and Date
      20110000
  • [Presentation] Turn alignment using eye-gaze and speech in spoken interaction2010

    • Author(s)
      K. Jokinen, K. Harada, M. Nishida, S. Yamamoto
    • Organizer
      Proceedings of INTERSPEECH2010
    • Place of Presentation
      Makuhari Messe(018-2021)
    • Year and Date
      20100000
  • [Presentation] Hierarchical Phrase-based Machine Translation with Word-based Reordering Model2010

    • Author(s)
      K. Hayashi, H. Tsukada, K. Sudo, K. Kevin and S. Yamamoto
    • Organizer
      Computational Linguistics
    • Place of Presentation
      (Computational Linguistics)
    • Year and Date
      20100000
  • [Presentation] Demonstration of Conversational Eye-gaze Data2010

    • Author(s)
      K. Jokinen, S. Yamamoto, M. Nishida
    • Organizer
      Workshop of Multimodal Corpus of LREC2010
    • Year and Date
      20100000
  • [Presentation] 単語並び換えモデルを考慮した統計的階層句機械翻訳システム2010

    • Author(s)
      林克彦、塚田元,須藤克仁,Kevin Duh,山本誠一
    • Organizer
      情報処理学会自然言語処理研究会
    • Year and Date
      20100000

URL: 

Published: 2014-08-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi