• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Analysis of prosodic and syntactic features related to conversation timing using spontaneous conversation corpora

Research Project

Project/Area Number 18K11514
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 61060:Kansei informatics-related
Research InstitutionInstitute of Technologists (2022-2023)
National Institute for Japanese Language and Linguistics (2018-2021)

Principal Investigator

Ishimoto Yuichi  ものつくり大学, 技能工芸学部, 准教授 (50409786)

Co-Investigator(Kenkyū-buntansha) 榎本 美香  東京工科大学, メディア学部, 准教授 (10454141)
寺岡 丈博  拓殖大学, 工学部, 准教授 (30617329)
Project Period (FY) 2018-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
Fiscal Year 2020: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2019: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2018: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Keywords発話末予測 / 統語情報 / 韻律 / 次話者選択 / 自発会話 / 日常会話 / 談話機能 / 同時発話 / 自発発話 / 基本周波数 / 個人差 / 話者交替 / 発話単位 / 非対面環境 / 音響特徴量
Outline of Final Research Achievements

We investigated syntactic and prosodic information related to end-of-utterance prediction using the spontaneous conversation corpus. We defined a model to estimate bunsetsu-phrase order from syntactic and prosodic features. The model parameters were iteratively estimated using the Markov chain Monte Carlo (MCMC) method. The results showed that the number of modifiers whose modifying bunsetsu-phrases have not yet appeared in the middle of a sentence was significant as a syntactic feature regardless of the speaker. However, significant prosodic features varied among speakers. Additionally, it was found that the prosodic features of utterances differed depending on the method of next-speaker selection. These findings suggest that conversational listeners adapt to using predictive features that vary according to each speaker rather than relying on a fixed set of prosodic features.

Academic Significance and Societal Importance of the Research Achievements

コンピュータとの音声対話により日常生活支援を行う音声アシスタントが用いられるようになってきているが、まだ自然な話者交替をともなう会話は実現できていない。話者交替時に間断なく応答するためには聞き手による話し手の発話末の予測が必要であり、本研究では自発発話音声の統語特徴や韻律特徴を基に発話末予測が可能であるかどうかを調べた。統語情報として係り先未定文節数が発話末までの距離を測る指標となりうることと、韻律情報は発話の性質によって有効性が異なることを示しており、これらによりコンピュータによる自然な話者交替へ実現へと近づいたと考える。

Report

(7 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Research-status Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (49 results)

All 2024 2023 2022 2021 2020 2019 2018

All Journal Article (13 results) (of which Peer Reviewed: 11 results,  Open Access: 9 results) Presentation (36 results) (of which Int'l Joint Research: 3 results)

  • [Journal Article] Introduction to the featured tutorials: Exploring the order in the real world—Frontline of the field studies2022

    • Author(s)
      榎本 美香
    • Journal Title

      Cognitive Studies: Bulletin of the Japanese Cognitive Science Society

      Volume: 29 Issue: 4 Pages: 650-651

    • DOI

      10.11225/cs.2022.060

    • ISSN
      1341-7924, 1881-5995
    • Year and Date
      2022-12-01
    • Related Report
      2022 Research-status Report
  • [Journal Article] Design and Evaluation of the Corpus of Everyday Japanese Conversation2022

    • Author(s)
      Hanae Koiso, Haruka Amatani, Yasuharu Den, Yuriko Iseki, Yuichi Ishimoto, Wakako Kashino, Yoshiko Kawabata, Ken’ya Nishikawa, Yayoi Tanaka, Yasuyuki Usuda, Yuka Watanabe
    • Journal Title

      Proceedings of the 13th Language Resources and Evaluation Conference

      Pages: 5587-5594

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Recent studies on metaphor and metonymy in natural language processing2020

    • Author(s)
      寺岡 丈博
    • Journal Title

      Cognitive Studies: Bulletin of the Japanese Cognitive Science Society

      Volume: 27 Issue: 2 Pages: 227-232

    • DOI

      10.11225/cs.2020.015

    • NAID

      130007855045

    • ISSN
      1341-7924, 1881-5995
    • Year and Date
      2020-06-01
    • Related Report
      2020 Research-status Report
    • Open Access
  • [Journal Article] A Conversation-Analytic Annotation of Turn-Taking Behavior in Japanese Multi-Party Conversation and its Preliminary Analysis2020

    • Author(s)
      Mika Enomoto, Yasuharu Den, Yuichi Ishimoto
    • Journal Title

      Proceedings of the 12th Language Resources and Evaluation Conference

      Pages: 644-652

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Construction of Associative Vocabulary Learning System for Japanese Learners2020

    • Author(s)
      Takehiro Teraoka, Tetsuo Yamashita
    • Journal Title

      Proceedings of the 34th Pacific Asia Conference on Language, Information and Computation (PACLIC 34)

      Pages: 300-306

    • Related Report
      2020 Research-status Report
    • Peer Reviewed
  • [Journal Article] An Investigation of Prosodic Features Related to Next Speaker Selection in Spontaneous Japanese Conversation2019

    • Author(s)
      Yuichi Ishimoto, Takehiro Teraoka, and Mika Enomoto
    • Journal Title

      2019 22nd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques (O-COCOSDA)

      Volume: COCOSDA 2019 Pages: 1-5

    • DOI

      10.1109/o-cocosda46868.2019.9041205

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Speech corpora in NINJAL, Japan demonstration of corpus concordance systems: Chunagon and Kotonoha2019

    • Author(s)
      Hanae Koiso, Masayuki Asahara, Salvatore Carlino, Ken’ya Nishikawa, Kazuki Aoyama, Yuichi Ishimoto, Aya Wakasa, Michiko Watanabe, Yoshimi Yoshikawa, Nobuko Kibe, Kikuo Maekawa
    • Journal Title

      Proceedings of LPSS 2019

      Pages: 8-12

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Prosodic diversity according to relationship among participants in everyday Japanese conversation2019

    • Author(s)
      Yuichi Ishimoto, Hanae Koiso
    • Journal Title

      Proceedings of LPSS 2019

      Pages: 62-66

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Multimodal Interaction Analysis of the Usage of Japanese Spatial-Temporal Deixis "KORE" and "SORE" in Cooperative Activities Within Intricate Material Environments2019

    • Author(s)
      Mika Enomoto, Katsuya Takanashi
    • Journal Title

      Proceedings of the 6th IIEEJ International Conference on Image Electronics and Visual Computing (IEVC 2019)

      Volume: 4C-4 Pages: 1-4

    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] Spontaneous speech resources in Japan2018

    • Author(s)
      Yuichi Ishimoto and Tomoko Ohsuga
    • Journal Title

      Proceedings of the LREC 2018 Special Speech Sessions

      Volume: - Pages: 1-5

    • DOI

      10.15084/00001909

    • NAID

      120006705621

    • URL

      https://repository.ninjal.ac.jp/records/1925

    • Year and Date
      2018-05-09
    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] A Prediction Model for End-of-Utterance Based on Prosodic Features and Phrase-Dependency in Spontaneous Japanese2018

    • Author(s)
      Yuichi Ishimoto, Takehiro Teraoka, and Mika Enomoto
    • Journal Title

      Proceedings of APSIPA Annual Summit and Conference 2018

      Volume: - Pages: 1782-1786

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Criteria and Composition Method of Transcription for the Corpus of Everyday Japanese Conversation2018

    • Author(s)
      臼田泰如,川端良子,西川賢哉,石本祐一,小磯花絵
    • Journal Title

      国立国語研究所論集 = NINJAL Research Papers

      Volume: 15 Issue: 15 Pages: 177-193

    • DOI

      10.15084/00001602

    • NAID

      120006488297

    • URL

      https://repository.ninjal.ac.jp/records/1618

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Analysis of Associative Information for Second Language Learning of Japanese2018

    • Author(s)
      Takehiro Teraoka
    • Journal Title

      Proceedings of 4th Asia Pacific Corpus Linguistics Conference

      Volume: - Pages: 434-439

    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Presentation] 連鎖終端位置における同時発話開始減少について2024

    • Author(s)
      又村拓也, 榎本美香
    • Organizer
      人工知能学会 言語・音声理解と対話処理研究会
    • Related Report
      2023 Annual Research Report
  • [Presentation] Chronological Changes In The Form Of Festival Preparation works And Their Influence On The Local Community Bonds2024

    • Author(s)
      Mika Enomoto, Yasuharu Den
    • Organizer
      The 8th IIEEJ International Conference on Image Electronics and Visual Computing (IEVC 2024)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 会話場面による日常会話音声の韻律の違い2024

    • Author(s)
      石本祐一
    • Organizer
      シンポジウム「日常会話コーパス」IX
    • Related Report
      2023 Annual Research Report
  • [Presentation] 『日本語日常会話コーパス』にみる日常会話音声の基本周波数と談話行為の関係2023

    • Author(s)
      石本祐一
    • Organizer
      言語資源ワークショップ2023
    • Related Report
      2023 Annual Research Report
  • [Presentation] ユーザの回答に依存した疑問詞の同定とその効果2023

    • Author(s)
      千野愛実花, 寺岡丈博
    • Organizer
      2023年度人工知能学会全国大会(第37回)
    • Related Report
      2023 Annual Research Report
  • [Presentation] Relevance-Aware Question Generation in Non-task-Oriented Dialogue Systems2023

    • Author(s)
      Amika Chino, Takehiro Teraoka
    • Organizer
      25th International Conference on Human-Computer Interaction (HCI International 2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 祭りの準備作業の変遷が地域コミュニティの絆に及ぼす影響2023

    • Author(s)
      榎本美香, 伝康晴
    • Organizer
      人工知能学会 言語・音声理解と対話処理研究会
    • Related Report
      2023 Annual Research Report
  • [Presentation] 状況と発話の対極関係に基づいた皮肉表現の検出2023

    • Author(s)
      塚田晃平, 寺岡丈博
    • Organizer
      情報処理学会第85回全国大会
    • Related Report
      2022 Research-status Report
  • [Presentation] 非タスク指向型対話システムにおける関連性を考慮した質問生成2023

    • Author(s)
      千野愛実花, 寺岡丈博
    • Organizer
      情報処理学会第85回全国大会
    • Related Report
      2022 Research-status Report
  • [Presentation] Relevance-aware Question Generation in Non-task-oriented Dialogue Systems2023

    • Author(s)
      Amika Chino, Takehiro Teraoka
    • Organizer
      25th International Conference on Human-Computer Interaction (HCI International 2023)
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] 新型コロナウイルスに関する新聞報道の時系列変化の日中米比較2023

    • Author(s)
      童樺, 森川美幸, 榎本美香
    • Organizer
      言語処理学会 第29回年次大会
    • Related Report
      2022 Research-status Report
  • [Presentation] 『日本語歴史コーパス 明治・大正編Ⅵ落語SP盤』音声アラインメントの公開2022

    • Author(s)
      松崎安子, 西川賢哉, 石本祐一, 中村壮範, 小木曽智信
    • Organizer
      日本語学会2022年度秋季大会
    • Related Report
      2022 Research-status Report
  • [Presentation] 多人数インタラクションにおける参与者再編成システムの提案~分裂と統合に関する体系的記述~2022

    • Author(s)
      橋本樹, 榎本美香
    • Organizer
      人工知能学会研究会資料 言語・音声理解と対話処理研究会
    • Related Report
      2022 Research-status Report
  • [Presentation] マルチアクティビティにおける活動変遷パターンの解明2022

    • Author(s)
      中野真弓, 榎本美香
    • Organizer
      人工知能学会研究会資料 言語・音声理解と対話処理研究会
    • Related Report
      2022 Research-status Report
  • [Presentation] 『日本語日常会話コーパス』にみる日常会話音声の基本周波数の多様性2022

    • Author(s)
      石本祐一
    • Organizer
      シンポジウム「日常会話コーパス」VII
    • Related Report
      2021 Research-status Report
  • [Presentation] 『日本語日常会話コーパス』の設計と特徴2022

    • Author(s)
      小磯花絵, 天谷春香, 石本祐一, 井關友里子, 臼田泰如, 柏野和佳子, 川端良子, 田中弥生, 伝康晴, 西川賢哉, 渡邊友香
    • Organizer
      言語処理学会第28回年次大会
    • Related Report
      2021 Research-status Report
  • [Presentation] 日本語照応解析における深層格推定に基づいた先行詞の同定2022

    • Author(s)
      伊藤清晃, 寺岡丈博
    • Organizer
      言語処理学会第28回年次大会
    • Related Report
      2021 Research-status Report
  • [Presentation] 連想情報と時系列を考慮した文章の焦点推定による対話破綻検出2022

    • Author(s)
      山﨑翔太, 寺岡丈博
    • Organizer
      言語処理学会第28回年次大会
    • Related Report
      2021 Research-status Report
  • [Presentation] 『日本語日常会話コーパス』で観察される日常会話音声のF0の多様性2021

    • Author(s)
      石本祐一
    • Organizer
      言語資源活用ワークショップ2021
    • Related Report
      2021 Research-status Report
  • [Presentation] 聞き手の参与役割に応じたあいづちと笑いの種類とその生起位置2021

    • Author(s)
      若月美希, 榎本美香
    • Organizer
      人工知能学会第92回言語・音声理解と対話処理研究会
    • Related Report
      2021 Research-status Report
  • [Presentation] 二者間バイアス区間における3人目の振る舞い2021

    • Author(s)
      宮崎太我, 榎本美香
    • Organizer
      日本認知科学会第38回大会
    • Related Report
      2021 Research-status Report
  • [Presentation] 会話はいかにして分裂し、統合するのか2021

    • Author(s)
      橋本樹, 榎本美香
    • Organizer
      人工知能学会第93回言語・音声理解と対話処理研究会
    • Related Report
      2021 Research-status Report
  • [Presentation] 日本語日常会話コーパスから見える会話場面と声の高さの関係性2020

    • Author(s)
      石本祐一
    • Organizer
      言語資源活用ワークショップ2021
    • Related Report
      2020 Research-status Report
  • [Presentation] 三人会話の次話者選択に関わる言語・音響特徴の分析2020

    • Author(s)
      石本祐一, 寺岡丈博, 榎本美香
    • Organizer
      日本音響学会2020年春季研究発表会
    • Related Report
      2019 Research-status Report
  • [Presentation] 動詞出現頻度の偏りを用いた慣用表現の曖昧性解消2020

    • Author(s)
      舩藤裕文, 寺岡丈博
    • Organizer
      情報処理学会第82回全国大会
    • Related Report
      2019 Research-status Report
  • [Presentation] 述語の連想情報を用いた日本語ゼロ照応解析2020

    • Author(s)
      伊藤清晃, 寺岡丈博
    • Organizer
      情報処理学会第82回全国大会
    • Related Report
      2019 Research-status Report
  • [Presentation] 対話破綻の特徴に応じた回避手法の提案2020

    • Author(s)
      山﨑翔太, 寺岡丈博
    • Organizer
      情報処理学会第82回全国大会
    • Related Report
      2019 Research-status Report
  • [Presentation] 日本語日常会話コーパスを用いた会話場面と声の高さの関係性の検討2019

    • Author(s)
      石本祐一, 小磯花絵
    • Organizer
      日本音響学会2019年秋季研究発表会
    • Related Report
      2019 Research-status Report
  • [Presentation] 日常会話音声に対する基本周波数推定の課題2019

    • Author(s)
      石本祐一
    • Organizer
      言語資源活用ワークショップ2019
    • Related Report
      2019 Research-status Report
  • [Presentation] 話者移行適格場予測のための発話内文節位置推定モデルの構築2019

    • Author(s)
      石本祐一,寺岡丈博,榎本美香
    • Organizer
      日本音響学会2019年度春季研究発表会
    • Related Report
      2018 Research-status Report
  • [Presentation] 『日本語日常会話コーパス』モニター公開版の設計と特徴2019

    • Author(s)
      小磯花絵,天谷晴香,石本祐一,居關友里子,臼田泰如,柏野和佳子,川端良子,田中弥生,伝康晴,西川賢哉
    • Organizer
      言語処理学会第25回年次大会
    • Related Report
      2018 Research-status Report
  • [Presentation] 『日本語日常会話コーパス』から見える日常会話音声の韻律的特徴2019

    • Author(s)
      石本祐一,小磯花絵
    • Organizer
      シンポジウム「日常会話コーパス」IV
    • Related Report
      2018 Research-status Report
  • [Presentation] 二者間バイアス中の相槌・頷き2019

    • Author(s)
      宮崎太我,榎本美香
    • Organizer
      人工知能学会言語・音声理解と対話処理研究会第85回研究会
    • Related Report
      2018 Research-status Report
  • [Presentation] 日常における会話の多様性を考慮した『日本語日常会話コーパス』の構築2018

    • Author(s)
      石本祐一,天谷春香,居關友里子,臼田泰如,柏野和佳子,川端良子,田中弥生,伝康晴,西川賢哉,小磯花絵
    • Organizer
      日本音響学会2018年度秋季研究発表会
    • Related Report
      2018 Research-status Report
  • [Presentation] 方言音声に対するテキスト自動アライメントの試み2018

    • Author(s)
      石本祐一
    • Organizer
      言語資源活用ワークショップ2018
    • Related Report
      2018 Research-status Report
  • [Presentation] 二者間バイアスの間にどう割って入るか2018

    • Author(s)
      宮崎太我,榎本美香
    • Organizer
      人工知能学会言語・音声理解と対話処理研究会第84回研究会
    • Related Report
      2018 Research-status Report

URL: 

Published: 2018-04-23   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi