• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2010 Fiscal Year Final Research Report

On The Use of Non-Verbal Speech Sounds in Human Communication

Research Project

  • PDF
Project/Area Number 19300073
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Sensitivity informatics/Soft computing
Research InstitutionNational Institute of Information and Communications Technology

Principal Investigator

CAMPBELL Nick  National Institute of Information and Communications Technology, 情報科学研究科, 客員教授 (50395109)

Co-Investigator(Kenkyū-buntansha) SADANOBU Toshiyuki  神戸大学, 国際文化学部, 教授 (50235305)
KASHIOKA Hideki  奈良先端科学技術大学院大学, 情報科学研究科, 客員准教授 (10395022)
Project Period (FY) 2007 – 2010
Keywordsノンバーバル / 音声発話 / 情動情報 / センシング / 技術
Research Abstract

This project focused on the relationships between "dialogue structure" and the processes of "active listening". The project did not result in specific new technology but gave us a better understanding of the nature of spoken language in a way that will allow us improve speech synthesis and recognition technology. Our research theme inspired the new European project on Social Signal Processing. Further- more, we collected a large multi-modal corpora cooperating with other universities in three countries, published the database on the website (http://www.speech-data.jp/nick/mmx/d64.html). We finally made a prototype of a robot "Herme" which employs image and speech processing modules developed in this study. The robot is currently in exhibition in Ireland where it is collecting a new corpus of interactive speech.

  • Research Products

    (70 results)

All 2011 2010 2009 2008 2007 Other

All Journal Article (5 results) (of which Peer Reviewed: 5 results) Presentation (55 results) Book (8 results) Remarks (2 results)

  • [Journal Article] A comparison of automatic online and offline approaches using audiovisual data2011

    • Author(s)
      ニック・キャンベル
    • Journal Title

      ACM Trans-actions on Interactive Intelligent Systems (印刷中)

    • Peer Reviewed
  • [Journal Article] Affective speech in real-life interactions2011

    • Author(s)
      ニック・キャンベル
    • Journal Title

      Computer Speech and Language Vol.25

      Pages: 1-3

    • Peer Reviewed
  • [Journal Article] How Speech Effect and Discourse Information2007

    • Author(s)
      ニック・キャンベル
    • Journal Title

      NATO Se-curity through Science Se-ries, IOS, Press Vol.18

      Pages: 103-114

    • Peer Reviewed
  • [Journal Article] Differences in the Speaking Style of a Japanese Male According to Interlocutor; Showing the Effects of Affect in conversational Speech2007

    • Author(s)
      ニック・キャンベル
    • Journal Title

      Linguistics and Chinese Language Process-ing Vol.12, No.1

      Pages: 1-16

    • Peer Reviewed
  • [Journal Article] The Role and Use of Speech Gestures in Discourse2007

    • Author(s)
      ニック・キャンベル
    • Journal Title

      Archives of Acous-tic, WARSZAWA Vol.32, No.4

      Pages: 803-814

    • Peer Reviewed
  • [Presentation] Analysis of Laughter for Autistic Children2011

    • Author(s)
      田中宏季
    • Organizer
      COST Final Meeting
    • Place of Presentation
      ドリスデン(ドイツ)
    • Year and Date
      2011-03-25
  • [Presentation] 対話型音声合成のための話し言葉変換モジュールの検討2011

    • Author(s)
      井岡孝憲
    • Organizer
      日本音響学会2011年春季研究発表会
    • Place of Presentation
      東京
    • Year and Date
      2011-03-10
  • [Presentation] 波形接続型音声合成法を改良した高品質音声合成手法の提案2011

    • Author(s)
      豊川弘樹
    • Organizer
      日本音響学会2011年春季研究発表会
    • Place of Presentation
      東京
    • Year and Date
      2011-03-09
  • [Presentation] 自閉症児支援のための笑い分析2011

    • Author(s)
      田中宏季
    • Organizer
      日本音響学会2011年春季研究発表会
    • Place of Presentation
      東京
    • Year and Date
      2011-03-09
  • [Presentation] Speech Technology and Empathy in Conversational Interaction2010

    • Author(s)
      ニック・キャンベル, Stefan Schere
    • Organizer
      Oriental COCOSDA
    • Place of Presentation
      カトマンズ(インド)
    • Year and Date
      2010-11-28
  • [Presentation] Automatic detection of social aspects of in-teractive spoken conversation2010

    • Author(s)
      ニック・キャンベル
    • Organizer
      CogInfoCom
    • Place of Presentation
      東京
    • Year and Date
      2010-11-23
  • [Presentation] Comparing Measures of Synchrony and Alignment in Dialogue Speech Timing with respect to Turn-taking Activity2010

    • Author(s)
      ニック・キャンベル
    • Organizer
      Interspeech 2010
    • Place of Presentation
      東京
    • Year and Date
      2010-09-30
  • [Presentation] Processing 'niblets' for conversa-tional speech interaction.2010

    • Author(s)
      ニック・キャンベル, Stefan Schere
    • Organizer
      COST 2102
    • Place of Presentation
      ブダペスト(ハンガリー)
    • Year and Date
      2010-09-08
  • [Presentation] Towards a Description of the Dynamics of Spontaneous Speech based on Acoustic-Prosodic Properties of Fragmentary Discursive Events2010

    • Author(s)
      ニック・キャンベル, Helena Moniz, John Kane, Isabel Trancosor
    • Organizer
      COST 2102
    • Place of Presentation
      ブダペスト(ハンガリー)
    • Year and Date
      2010-09-08
  • [Presentation] Multimodal Expressivity (Conversation as a prelinguistic social activity)2010

    • Author(s)
      ニック・キャンベル
    • Organizer
      Hungarian Academy of Science
    • Place of Presentation
      ブダペスト(ハンガリー)
    • Year and Date
      2010-07-27
  • [Presentation] MMX - proc-essing MultiModal eXpressive inter-action, ЧЕТВЁРТАЯ МЕЖДУНАРОДНАЯ КОНФЕРЕНЦИЯ ПО КОГНИТИВНОЙ НАУКЕ.2010

    • Author(s)
      ニック・キャンベル
    • Organizer
      THE FOURTH INTERNA-TIONAL CONFERENCE ON COGNITIVE SCI-ENCE
    • Place of Presentation
      トモスク(ロシア)
    • Year and Date
      2010-06-23
  • [Presentation] Workshop on Preparation for a Digital Corpus of Japanese Everyday Talk.2010

    • Author(s)
      ニック・キャンベル
    • Organizer
      Univer-sity of Alberta
    • Place of Presentation
      アルベルタ(カナダ)
    • Year and Date
      2010-06-12
  • [Presentation] A corpus of richly recorded conversational in-teraction.2010

    • Author(s)
      ニック・キャンベル
    • Organizer
      Language Resources & Evaluation Conference
    • Place of Presentation
      マルタ(イタリア)
    • Year and Date
      2010-05-21
  • [Presentation] A software toolkit for viewing annotated mul-timodal data interactively over the web.2010

    • Author(s)
      ニック・キャンベル
    • Organizer
      Language Resources & Evaluation Conference
    • Place of Presentation
      マルタ(イタリア)
    • Year and Date
      2010-05-20
  • [Presentation] 発話タイミングを考慮した相槌の分析2010

    • Author(s)
      上野和哉
    • Organizer
      日本音響学会2011年春季研究発表会
    • Place of Presentation
      東京
    • Year and Date
      2010-03-10
  • [Presentation] 発話意図に基づく「はい」の音響的特徴の分析2010

    • Author(s)
      佃・友介
    • Organizer
      日本音響学会
    • Place of Presentation
      東京
    • Year and Date
      2010-03-08
  • [Presentation] On the continued use of prosody in speech technology2010

    • Author(s)
      ニック・キャンベル
    • Organizer
      ICCS/HCRC Seminar Series, Edinburgh University
    • Place of Presentation
      Edinburgh, Scotland
    • Year and Date
      2010-02-26
  • [Presentation] Language Re-sources of the Future (a speech-based position paper)2010

    • Author(s)
      ニック・キャンベル
    • Organizer
      FLaReNet Fo-rum
    • Place of Presentation
      バルセロナ(スペイン)
    • Year and Date
      2010-02-12
  • [Presentation] Language Re-sources of the Future (a speech-based position paper)2010

    • Author(s)
      ニック・キャンベル
    • Organizer
      Language Resources of the Future, FLaReNet Fo-rum
    • Place of Presentation
      Barcelona, Spain
    • Year and Date
      2010-02-12
  • [Presentation] マルチモーダルな会話データ収集と処理2009

    • Author(s)
      ニック・キャンベル
    • Organizer
      キャラクタの音声文法
    • Place of Presentation
      京都
    • Year and Date
      2009-12-19
  • [Presentation] 発話意図を考慮した対話型音声の音韻継続長制御に関する検討2009

    • Author(s)
      佃友介
    • Organizer
      日本音響学会
    • Place of Presentation
      京都
    • Year and Date
      2009-09-17
  • [Presentation] Tracking the second channel of information in speech2009

    • Author(s)
      ニック・キャンベル
    • Organizer
      IEEE International workshop on Social Signal Process-ing
    • Place of Presentation
      アムステルダム(オランダ)
    • Year and Date
      2009-09-13
  • [Presentation] An Audio-Visual Approach to Measuring Discourse Synchrony in Multimodal Conversation Data2009

    • Author(s)
      ニック・キャンベル
    • Organizer
      Interspeech
    • Place of Presentation
      Brigh-ton England
    • Year and Date
      2009-09-09
  • [Presentation] 対話型音声合成の時間制御2009

    • Author(s)
      佃友介
    • Organizer
      音声文法研究会
    • Place of Presentation
      奈良
    • Year and Date
      2009-07-18
  • [Presentation] The expanding role of prosody in speech communi-cation technology2009

    • Author(s)
      ニック・キャンベル
    • Organizer
      DIAHOLMIA, KTH
    • Place of Presentation
      スウェーデン
    • Year and Date
      2009-06-12
  • [Presentation] Multimodal Processing of Discourse Information ; the Effect of Synchrony2008

    • Author(s)
      ニック・キャンベル
    • Organizer
      ISUC2008
    • Place of Presentation
      大阪
    • Year and Date
      2008-12-15
  • [Presentation] The Expanding Role of Prosody Interpretation in Speech Communication and Speech Technology.2008

    • Author(s)
      ニック・キャンベル
    • Organizer
      Oriental COCOSDA2008
    • Place of Presentation
      京都
    • Year and Date
      2008-11-26
  • [Presentation] 音響的特徴を用いた統計的手法による断片発話の自動抽出2008

    • Author(s)
      瀬戸山勝義
    • Organizer
      日本音響学会2008年秋季研究発表会
    • Place of Presentation
      福岡
    • Year and Date
      2008-09-10
  • [Presentation] Automatic de-tection of participant status and topic changes in natural spoken dialogues2008

    • Author(s)
      ニック・キャンベル
    • Organizer
      日本音響学会2008年秋季研究発表会
    • Place of Presentation
      福岡
    • Year and Date
      2008-09-10
  • [Presentation] Automatic Laughter detection for Measuring Discourse Engagement.2008

    • Author(s)
      ニック・キャンベル
    • Organizer
      日本音響学会2008年秋季研究発表会
    • Place of Presentation
      福岡
    • Year and Date
      2008-09-10
  • [Presentation] Timing Expec-tancies in Japanese Speech2008

    • Author(s)
      ニック・キャンベル
    • Organizer
      2nd International Workshop in Language and Speech Science
    • Place of Presentation
      東京
    • Year and Date
      2008-09-05
  • [Presentation] Technology and Techniques for Talking Together2008

    • Author(s)
      ニック・キャンベル
    • Organizer
      the Third International Conference on Cognitive Science
    • Place of Presentation
      モスクワ,(ロシア)
    • Year and Date
      2008-06-25
  • [Presentation] Acoustic Correlates of Politeness2008

    • Author(s)
      Mark CAMPANA
    • Organizer
      4th International Sym-posium on Politeness (LPRG)
    • Place of Presentation
      マラケシュ,(モロッコ)
    • Year and Date
      2008-06-01
  • [Presentation] Resources for Synthesis2008

    • Author(s)
      ニック・キャンベル
    • Organizer
      LREC2008 Work-shop (Cocosda/WRTE Workshop)
    • Place of Presentation
      マラケシュ,(モロッコ)
    • Year and Date
      2008-06-01
  • [Presentation] Tools & Re-sources for visualizing Conversa-tional-Speech Interaction2008

    • Author(s)
      ニック・キャンベル
    • Organizer
      LREC2008
    • Place of Presentation
      マラケシュ,(モロッコ)
    • Year and Date
      2008-05-30
  • [Presentation] Speaking Style Variation and Speaker Personality2008

    • Author(s)
      ニック・キャンベル
    • Organizer
      Speech Prosody 2008
    • Place of Presentation
      カンピナス,(ブラジル)
    • Year and Date
      2008-05-08
  • [Presentation] Laughter in conversational speech .more than just amusement2008

    • Author(s)
      ニック・キャンベル
    • Organizer
      EMUS-Expressivity in Music and Speech
    • Place of Presentation
      カンピナス,(ブラジル)
    • Year and Date
      2008-05-05
  • [Presentation] Detecting Pro-sodic Boundaries in Spoken Dialogues through use of Non-lexical Expres-sions2008

    • Author(s)
      ニック・キャンベル
    • Organizer
      PCC2008 (the8th Phonetic Conference of China)
    • Place of Presentation
      北京,中国
    • Year and Date
      2008-04-19
  • [Presentation] Active listening characteristics confirm spoken dia-logue to be a very two-way interactive process.2008

    • Author(s)
      ニック・キャンベル
    • Organizer
      日本音響学会
    • Place of Presentation
      千葉
    • Year and Date
      2008-03-19
  • [Presentation] 断片発話の韻律特徴による分類2008

    • Author(s)
      瀬戸山勝義
    • Organizer
      日本音響学会2008年春季研究発表会
    • Place of Presentation
      千葉
    • Year and Date
      2008-03-19
  • [Presentation] 非語彙的な表現を利用した音声対話の節境界同定の検討2008

    • Author(s)
      牧本慎平
    • Organizer
      言語処理学会第14回年次大会
    • Place of Presentation
      東京
    • Year and Date
      2008-03-18
  • [Presentation] 音響的特徴を用いた機会学習によるノンバーバル発話の意図自動識別の検討」2008

    • Author(s)
      吉川哲史
    • Organizer
      日本音響学会2008年春季研究発表会
    • Place of Presentation
      千葉
    • Year and Date
      2008-03-18
  • [Presentation] 音響的特徴に基づくノンバーバル発話の意図自動識別の検討2008

    • Author(s)
      吉川哲史
    • Organizer
      第74回音楽情報科学研究会・第70回音声言語情報処理研究会共催研究会
    • Place of Presentation
      静岡
    • Year and Date
      2008-02-09
  • [Presentation] 統計学習を用いた対話からの非言語的表現の抽出2008

    • Author(s)
      牧本慎平
    • Organizer
      第74回音楽情報科学研究会・第70回音声言語情報処理研究会共催研究会
    • Place of Presentation
      静岡
    • Year and Date
      2008-02-09
  • [Presentation] Interactive Speech Technology.2008

    • Author(s)
      ニック・キャンベル
    • Organizer
      International Workshop on Interaction Dynamics Embodiment, and Implicit Primordial Knowledge Model.
    • Place of Presentation
      京都
    • Year and Date
      2008-01-15
  • [Presentation] Resources for Interacting with Large-Corpus Speech Data.2007

    • Author(s)
      ニック・キャンベル
    • Organizer
      Oriental COCOSDA
    • Place of Presentation
      ハノイ,(ベトナム)
    • Year and Date
      2007-12-05
  • [Presentation] 発話「うん」の音響的特徴に基づく意図の自動識別2007

    • Author(s)
      吉川哲史
    • Organizer
      日本音響学会2007年秋季研究発表会
    • Place of Presentation
      山梨
    • Year and Date
      2007-09-19
  • [Presentation] The Listening Eye. : a non-verbal sensing device for interactive systems.2007

    • Author(s)
      ニック・キャンベル
    • Organizer
      ACII2007
    • Place of Presentation
      リスボン(ポルトガル)
    • Year and Date
      2007-09-12
  • [Presentation] Translating Conversational Speech to Standard Linguistics Form.2007

    • Author(s)
      ニック・キャンベル
    • Organizer
      Interspeech2007
    • Place of Presentation
      アントワープ(ベルギー)
    • Year and Date
      2007-08-31
  • [Presentation] Processing Image and Audio Information for Recognizing Discourse Participation Status through Features of Face and Voice.2007

    • Author(s)
      ニック・キャンベル
    • Organizer
      Interspeech2007
    • Place of Presentation
      アントワープ(ベルギー)
    • Year and Date
      2007-08-29
  • [Presentation] Approaches to Conversational Speech Rhythm : Speech Activity In Two-Person Telephone Dialogues.2007

    • Author(s)
      ニック・キャンベル
    • Organizer
      ICPh2007
    • Place of Presentation
      サーブルケン(ドイツ)
    • Year and Date
      2007-08-09
  • [Presentation] Changes in Voice Quality with respect to Social Conditions.2007

    • Author(s)
      ニック・キャンベル
    • Organizer
      ICPh2007
    • Place of Presentation
      サーブルケン(ドイツ)
    • Year and Date
      2007-08-06
  • [Presentation] Whom we laugh with affects how we laugh. Workshop2007

    • Author(s)
      ニック・キャンベル
    • Organizer
      The Phonetics of Laughter 2007
    • Place of Presentation
      サーブルケン(ドイツ)
    • Year and Date
      2007-08-05
  • [Presentation] How to follow a conversation without listening to the words.2007

    • Author(s)
      ニック・キャンベル
    • Organizer
      ParaLing' 07
    • Place of Presentation
      サーブルケン(ドイツ)
    • Year and Date
      2007-08-03
  • [Presentation] On the Use of Nonverbal Sounds in Human Communi-cation.2007

    • Author(s)
      ニック・キャンベル
    • Organizer
      MLMI-07 (Machine Learning and Multi)
    • Place of Presentation
      サーブルケン(ドイツ)
    • Year and Date
      2007-08-03
  • [Book] Speech Technology2011

    • Author(s)
      ニック・キャンベル
    • Total Pages
      105-121
    • Publisher
      Springer
  • [Book] Development of Multimodal Interfaces2010

    • Author(s)
      ニック・キャンベル
    • Publisher
      Active Lis-tening&Synchrony, Springer
  • [Book] Development of Multimodal Interfaces2010

    • Author(s)
      ニック・キャンベル
    • Publisher
      Active Lis-tening & Synchrony, Springer
  • [Book] 音声文法 Speech and Grammar2010

    • Author(s)
      ニック・キャンベル
    • Total Pages
      137-148
    • Publisher
      くろしお出版
  • [Book] コミュニケーション、どうする?どうなる?2010

    • Author(s)
      ニック・キャンベル
    • Publisher
      (林博司・定延利之=編),ひつじ書房
  • [Book] Verbal and Non-verbal Features of Human-Human and Human-Machine Interaction (Individual Traits of Speaking Style and Speech Rhythm in a Spoken Discourse)2008

    • Author(s)
      ニック・キャンベル
    • Total Pages
      108-120
    • Publisher
      Springer
  • [Book] Machine Learning fro Multimodal Interaction2008

    • Author(s)
      ニック・キャンベル
    • Total Pages
      1-10
    • Publisher
      LNCS 4892, Springer
  • [Book] Verbal and Non-verbal Communication Behaviors2008

    • Author(s)
      ニック・キャンベル
    • Total Pages
      117-128
    • Publisher
      LNAI 4775, Springer
  • [Remarks] ホームページ等

    • URL

      http://sspnet.eu/2010/02/freetalk/

  • [Remarks]

    • URL

      http://www.speech-data.jp/nick/mmx/d64.html

URL: 

Published: 2012-01-26   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi