On The Use of Non-Verbal Speech Sounds in Human Communication
| Project/Area Number |
24500256
|
|---|
| Research Category |
Grant-in-Aid for Scientific Research (C)
|
| Allocation Type | Multi-year Fund |
|---|
| Section | 一般 |
|---|
| Research Field |
Sensitivity informatics/Soft computing
|
|---|
| Research Institution | Nara Institute of Science and Technology |
|---|
Principal Investigator |
CAMPBELL Nick 奈良先端科学技術大学院大学, 情報科学研究科, 教授 (50395109)
|
|---|
| Co-Investigator(Kenkyū-buntansha) |
SADANOBU Toshiyuki 神戸大学, 国際文化学部, 教授 (50235305)
|
|---|
| Project Period (FY) |
2012-04-01 – 2015-03-31
|
| Project Status |
Completed (Fiscal Year 2014)
|
| Budget Amount *help |
¥5,330,000 (Direct Cost: ¥4,100,000、Indirect Cost: ¥1,230,000)
Fiscal Year 2014: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2013: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Fiscal Year 2012: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
|
|---|
| Keywords | ノンバーバル / 音声発話 / 情動情報 / センシング / 技術 / ヒューマンインターフェース技術 / 非言語コミュニケーション / 感性情報処理 / 音声合成 / マルチモーダルインターフェース / バイオメトリックセンシング / 自律神経系 |
|---|
| Outline of Final Research Achievements |
This study focused on the processing of non-verbal information to facilitate the transfer of speaker intentions that underlie the spoken text of a social conversational interaction.The contents of natural dialogue, while conveying the semantic meaning of the utterance, also contribute greatly to social ties and informal bonding.
To be aware of such social exchanges, it is essential to process voice information and speaking style (perhaps more important than what was directly said in the conversation).We developed audio processing, alongside speech content information, that is targeted at achieving a more likely interpretation and understanding of speech-interaction.
Prediction of the intentions of the speaker varies depending on the circumstances and the history of the conversation, but reliable paralinguistic signals allow us to develop a system facilitating the interpretation of nonverbal information speech, and to moderate the words according to this extra non-verbal information.
|
Report
(4 results)
Research Products
(37 results)
-
-
-
-
-
-
-
-
-
-
-
-
-
-
[Presentation] "Investigating fine temporal dynamics of prosodic and lexical accommodation"2013
Author(s)
Francesca Bonin, Celine De Looze, Sucheta Ghosh, Emer Gilmartin, Carl Vogel, Anna Polychroniou, Hugues Salamin, Alessandro Vinciarelli and Nick Campbell
Organizer
14th Annual Conference of the International Speech Communication Association, INTERSPEECH, 2013
Place of Presentation
Lyon, France
Related Report
-
-
-
-
[Presentation] The Herme Database of Spontaneous Multimodal Human-‐Robot Dialogues
Author(s)
Han, J., Gilmartin, E., De Looze, C., Vaughan, B., & Nick Campbell,
Organizer
Conference on Language Resources and Evaluation (LREC'12),
Place of Presentation
Istanbul, Turkey
Related Report
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
[Book] Conversational Involvement and Synchronous Nonverbal Behaviour in, Esposito,"Cognitive Behavioural Systems"2012
Author(s)
A., Vinciarelli, A., Hoffmann, R., V. (Eds.) [Altmann, U., Oertel, C., & Campbell, N.]
Publisher
Springer
Related Report
