Spoken language processing for simultaneous speech understanding

• Project/Area Number: 22300051
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Intelligent informatics
• Research Institution: Nagoya University
• Principal Investigator: MATSUBARA Shigeki 名古屋大学, 情報科学研究科, 准教授 (20303589)
• Co-Investigator(Kenkyū-buntansha): KASHIOKA Hideki 独立行政法人情報通信研究機構, 脳情報通信融合研究センター, 室長 (10395022) ; KATO Yoshihide 名古屋大学, 情報連携統括本部, 准教授 (20362220) ; OHNO Tomohiro 名古屋大学, 情報基盤センター, 助教 (20402472)
• Project Period (FY): 2010-04-01 – 2015-03-31
• Project Status: Completed (Fiscal Year 2014)
• Budget Amount: ¥17,420,000 (Direct Cost: ¥13,400,000、Indirect Cost: ¥4,020,000); Fiscal Year 2013: ¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000); Fiscal Year 2012: ¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000); Fiscal Year 2011: ¥3,120,000 (Direct Cost: ¥2,400,000、Indirect Cost: ¥720,000); Fiscal Year 2010: ¥5,850,000 (Direct Cost: ¥4,500,000、Indirect Cost: ¥1,350,000)
• Keywords: 音声言語処理 / 構文解析 / 意味解析 / 機械翻訳 / 対話処理 / 字幕生成 / 言語資源 / コーパス / 自然言語処理 / 言語生成 / 文整形 / 音声要約 / 漸進的解釈 / 談話理解 / 構文木

Outline of Final Research Achievements

As one of language technologies for realization of real-time spoken language systems, we developed methods for incremental analysis of spoken languages. The incremental analysis means processing spoken languages and generating the analysis results synchronously with speech inputs. We defined a style of the dependency structure for incremental analysis and demonstrated the feasibility of such the analysis process. We applied the incremental analysis to spoken language systems such as real-time captioning and experimentally indicated the effectiveness of incremental language analysis.

Research Products

• [Journal Article] Incremental Dependency Parsing Identifying Dependencies and Independencies between Words (2015)
  • Author(s): 大野誠寛, 松原茂樹
  • Journal Title: 電子情報通信学会論文誌D 情報・システム Volume: J98-D Issue: 4 Pages: 709-718
  • DOI: 10.14923/transinfj.2014JDP7088
  • ISSN: 1880-4535, 1881-0225
  • Year and Date: 2015-04-01
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Identifying Nonlocal Dependencies in Incremental Parsing (2015)
  • Author(s): Yoshihide Kato, Shigeki Matsubara
  • Journal Title: IEICE Transactions on Information and Systems Volume: E98.D Issue: 4 Pages: 994-998
  • DOI: 10.1587/transinf.2014EDL8186
  • NAID: 130005061842
  • ISSN: 0916-8532, 1745-1361
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] 自然なニュース音声の自動生成に向けた体言止めの文への文末表現の補完 (2014)
  • Author(s): 松原茂樹, 村田匡輝
  • Journal Title: 電子情報通信学会論文誌 Volume: D-97(1) Pages: 181-185
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] 講演のリアルタイム字幕生成のための逐次的な改行挿入 (2013)
  • Author(s): 大野誠寛
  • Journal Title: 電気学会論文誌 Volume: 133-C(2) Pages: 418-426
  • NAID: 10031142454
  • Peer Reviewed
• [Journal Article] 同時通訳システムの現状と課題 (2012)
  • Author(s): 松原茂樹
  • Journal Title: 通訳翻訳研究 Volume: 12 Pages: 21-30
  • NAID: 130008121979
• [Journal Article] Design and Collection of Ontological Metadata for Enhancing Interoperability of Language Resources (2012)
  • Author(s): Shunsuke Kozawa
  • Journal Title: International Journal of Knowledge and Web Intelligence Volume: 3(3) Pages: 206-223
  • Peer Reviewed
• [Journal Article] 読点の用法的分類に基づく日本語テキストへの自動読点挿入 (2012)
  • Author(s): 村田匡輝
  • Journal Title: 電子情報通信学会論文誌 Volume: J95-D(9) Pages: 1783-1793
  • Peer Reviewed
• [Journal Article] 言語資源の用途情報の獲得と利用 (2012)
  • Author(s): 小澤俊介
  • Journal Title: 電子情報通信学会論文誌 Volume: J95-A(7) Pages: 611-622
  • Peer Reviewed
• [Journal Article] モノの使われ方の情報がノウハウ獲得に与える影響 (2012)
  • Author(s): 小澤俊介
  • Journal Title: 電子情報通信学会論文誌 Volume: J95-D(3) Pages: 506-517
  • Peer Reviewed
• [Journal Article] 外出行動前のユーザへの情報提供を目的としたWebからのアドバイス文抽出 (2012)
  • Author(s): 小澤俊介
  • Journal Title: 情報処理学会論文誌 Volume: 53(1) Pages: 105-116
  • Peer Reviewed
• [Journal Article] Storage of Usage Information on Research Resource Metadata Database: Corpus Construction Using Academic Articles (2011)
  • Author(s): Shunsuke Kozawa
  • Journal Title: ECTI Transactions on Computer and Information Technology Volume: 5(2) Pages: 98-106
  • Peer Reviewed
• [Journal Article] Correcting Syntactic Annotation Errors Using a Synchronous Tree Substitution Grammar (2010)
  • Author(s): Yoshihide Kato, Shigeki Matsubara
  • Journal Title: IEICE Transactions on Information and Systems Volume: E93-D No.9 Pages: 2660-2663
  • NAID: 10027640907
  • Peer Reviewed
• [Journal Article] Construction of Linefeed Insertion Rules for Lecture Transcript and their Evaluation, International Journal of Knowledge and Web Intelligence (2010)
  • Author(s): Masaki Murata, Tomohiro Ohno, Shigeki Matsubara
  • Journal Title: International Journal of Knowledge and Web Intelligence Volume: 1 No.3/4 Pages: 227-242
  • Peer Reviewed
• [Presentation] 未入力文節との構文的関係を考慮する漸進的な係り受け解析 (2014)
  • Author(s): 村田匡輝，大野誠寛，松原茂樹
  • Organizer: 言語処理学会第20回年次大会
  • Place of Presentation: 北海道大学
  • Year and Date: 2014-03-18 – 2014-03-20
• [Presentation] 組合せ範疇文法に基づく漸進的な意味解析 (2014)
  • Author(s): 加藤芳秀，松原茂樹
  • Organizer: 言語処理学会第20回年次大会
  • Place of Presentation: 北海道大学
  • Year and Date: 2014-03-18 – 2014-03-20
• [Presentation] Dependency Structure for Incremental Parsing of Japanese and its Application (2013)
  • Author(s): Tomohiro Ohno, Shigeki Matsubara
  • Organizer: Proceedings of the 13th International Conference on Parsing Technologies
  • Place of Presentation: Nara, Japan
  • Year and Date: 2013-11-27 – 2013-11-29
• [Presentation] Incremental Parsing and Its Applications (2012)
  • Author(s): Shigeki Matsubara
  • Organizer: Workshop on Future Directions in Translation Research
  • Place of Presentation: Nara
  • Invited
• [Presentation] 感性ロボティクスの未来を拓く言語の理解と生成 (2012)
  • Author(s): 松原茂樹
  • Organizer: 第14回感性工学会大会
  • Place of Presentation: 東京電機大学
  • Invited
• [Presentation] Personalization of News Speech Delivery Service based on Transformation from Written Language to Spoken Language (2012)
  • Author(s): Shigeki Matsubara
  • Organizer: IIMSS-2012
  • Place of Presentation: Gifu
• [Presentation] Personalized Text Formatting for E-mail Messages (2012)
  • Author(s): Masaki Murata
  • Organizer: IIMSS-2012
  • Place of Presentation: Gifu
• [Presentation] Detection of Favorite Phrases from Conversational Speech (2012)
  • Author(s): Tomohiro Ohno
  • Organizer: 9th International Symposium on Natural Language Processing
  • Place of Presentation: タイ
• [Presentation] Automatic Acquisition of Useful English Expressions Using Dependency Relations (2012)
  • Author(s): Yoshihide Kato
  • Organizer: 9th International Symposium on Natural Language Processing
  • Place of Presentation: タイ
• [Presentation] Corpus-based Analysis of Simultaneous Interpreters' Speech Rates (2012)
  • Author(s): Koichiro Ryu
  • Organizer: 9th International Symposium on Natural Language Processing
  • Place of Presentation: タイ
• [Presentation] Acquisition of Know-How Information from Web (2011)
  • Author(s): Shunsuke Kozawa
  • Organizer: 7th Asia Information Retrieval Societies Conference
  • Place of Presentation: UAE
• [Presentation] Advice Extraction fromWeb for Providing Prior Information Concerning Outdoor Activities (2011)
  • Author(s): Shunsuke Kozawa
  • Organizer: 4th International Conference on Intelligent Interactive Multimedia Systems and Services
  • Place of Presentation: ギリシャ
• [Presentation] Automatic Text Formatting for Social Media based on Linefeed and Comma Insertion (2011)
  • Author(s): Masaki Murata
  • Organizer: 4th International Conference on Intelligent Interactive Multimedia Systems and Services
  • Place of Presentation: ギリシャ
• [Presentation] Automatic Comma Insertion for Japanese Text Generation (2010)
  • Author(s): Masaki Murata, Tomohiro Ohno, Shigeki Matsubara
  • Organizer: Conference on Empirical Methods in Natural Language Processing (EMNLP-2010)
  • Place of Presentation: MIT State Center(ボストン/米国)
  • Year and Date: 2010-10-10
• [Presentation] Correcting Errors in a Treebank Based on Synchronous Tree Substitution Grammar (2010)
  • Author(s): Yoshihide Kato, Shigeki Matsubara
  • Organizer: The 48th Conference of Association for Computational Linguistics (ACL-2010)
  • Place of Presentation: Uppsala University(アップサラ/スウエーデン)
  • Year and Date: 2010-07-12
• [Presentation] 読点の用法的分類に基づく自動読点挿入 (2010)
  • Author(s): 村田匡輝, 大野誠寛, 松原茂樹
  • Organizer: 第196回自然言語処理/第81回音声言語情報処理合同研究会
  • Place of Presentation: 東京工業大学(東京都)
  • Year and Date: 2010-05-27
• [Book] Innovations in Intelligent Machines -2 (2011)
  • Author(s): Toyohide Watanabe
  • Total Pages: 279
  • Publisher: Springer-Verlag
• [Book] Computer Processing of Asian Spoken Languages (2010)
  • Author(s): Shuichi Itahashi
  • Total Pages: 372
  • Publisher: c/o The Americas Group
• [Remarks] http://www.matubara.net/
• [Remarks] http://www.matubara.net/
• [Remarks]
  • URL: http://www.matubara.net/kaken/slp/