• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Measurement and analysis of paralinguistic information and motion for psychotherapy with rich sensibility

Research Project

Project/Area Number 23650111
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Sensitivity informatics/Soft computing
Research InstitutionWakayama University

Principal Investigator

IRINO Toshio  和歌山大学, システム工学部, 教授 (20346331)

Co-Investigator(Kenkyū-buntansha) HANADA Ryouko  京都教育大学, 教育学部, 准教授 (10418585)
FURUYAMA Nobuhiro  国立情報学研究所, 情報社会相関研究系, 准教授 (20333544)
INOUE Masashi  山形大学, 工学部, 助教 (50390597)
Project Period (FY) 2011 – 2013
Project Status Completed (Fiscal Year 2013)
Budget Amount *help
¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2013: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2012: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2011: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Keywords臨床心理面接 / 対話情報処理 / パラ言語情報 / 身体動作 / 感情推移観測システム / 認知心理学 / 音声音響工学 / 教育課程
Research Abstract

In training programs for psychotherapists, the instructors teach various techniques mainly based on their experience which could be annotated with written language. It is, however, not easy to explain nonlinguistic factors like nodding, prosody, and attitude which may carry emotional information important for sympathy and mutual trust. In this study, we tried to quantify the emotional factors based on the measurement of speech and motion as usable information in the training. We studied three issues: (1) Recording video, speech, and head motion in psychotherapy sessions and archiving them with annotations in the database, (2) Development of tools for data recording and emotional state evaluation, (3) Analysis of speech and nodding data to extract regularity. We collected forty four dialogues which are marvelously large for future studies. We developed a simple, portable recording system and EMO (EMOtional Movement Observation) system for emotional state evaluation.

Report

(4 results)
  • 2013 Annual Research Report   Final Research Report ( PDF )
  • 2012 Research-status Report
  • 2011 Research-status Report
  • Research Products

    (14 results)

All 2014 2013 2012 2011 Other

All Presentation (12 results) Remarks (2 results)

  • [Presentation] Continuous annotations for dialogue status and their change points2014

    • Author(s)
      Masashi Inoue, Toshio Irino, Ryoko Hanada, Nobuhiro Furuyama, and Hiroyasu Massaki
    • Organizer
      10th Multimodal Corpora : Combining applied and basic research targets
    • Place of Presentation
      Reykjavik, Iceland
    • Year and Date
      2014-05-27
    • Related Report
      2013 Final Research Report
  • [Presentation] 説明対話における韻律情報および頭部運動と感情評価値の関連性分析の試み2013

    • Author(s)
      八木みゆき , 森田礼子, 中井正人, 西村竜一, 河原英紀, 入野俊夫
    • Organizer
      電子情報通信学会/音響学会音声研究会
    • Place of Presentation
      千葉大, 千葉
    • Related Report
      2013 Final Research Report
  • [Presentation] 説明対話における韻律情報および頭部運動と感情評価値の関連性分析の試み2013

    • Author(s)
      八木みゆき,森田礼子, 中井正人, 西村竜一, 河原英紀, 入野俊夫
    • Organizer
      電子情報通信学会/音響学会 音声研究会
    • Place of Presentation
      千葉大学, 千葉
    • Related Report
      2013 Annual Research Report
  • [Presentation] Multimodal corpus for psychotherapeutic situation2012

    • Author(s)
      Masashi Inoue, Ryoko Hanada, Nobuhiro Furuyama, Toshio Irino, Takako Ichinomiya, and Hiroyasu Massaki
    • Organizer
      Workshop on Multimodal corpora : How Should Multimodal corpora Deal with the Situation? , (Pre-conference workshop of LREC 2012 )
    • Place of Presentation
      Istanbul, Turkey
    • Year and Date
      2012-05-22
    • Related Report
      2013 Final Research Report
  • [Presentation] 心理カウンセリング来談者の問題表現時の視点構造とマイクロスリップ-問題の所在が遷移した事例に関する質的検討2012

    • Author(s)
      末崎裕康, 古山宣洋, 花田里欧子, 井上雅史, 有久亘, 入野俊夫
    • Organizer
      日本生態心理学会第4回大会
    • Place of Presentation
      函館, 北海道
    • Related Report
      2013 Final Research Report
  • [Presentation] 心理カウンセリング来談者の問題表現時の視点構造 とマイクロスリップ ― 問題の所在が遷移した 事例に関する質的検討2012

    • Author(s)
      末崎裕康, 古山宣洋, 花田里欧子, 井上雅史, 有久亘,入野俊夫
    • Organizer
      日本生態心理学会第4回大会
    • Place of Presentation
      函館、北海道
    • Related Report
      2012 Research-status Report
  • [Presentation] Manual and Accelerometer Analysis of Head Nodding Patterns in Goal-oriented Dialogues2011

    • Author(s)
      Masashi Inoue, Toshio Irino, Nobuhiro Furuyama, Ryoko Hanada, Takako Ichinomiya, and Hiroyasu Massaki
    • Organizer
      Springer-Verlag Berlin Heidelberg (2011) , presented at HCI International 2011 Orlando
    • Place of Presentation
      Florida, USA
    • Related Report
      2013 Final Research Report
  • [Presentation] Manual and Accelerometer Analysis of Head Nodding Patterns in Goal-oriented Dialogues2011

    • Author(s)
      Inoue,M., Irino, T. Furuyama,N., Hanada,R., Ichinomiya,T., Massaki, H.
    • Organizer
      HCI International 2011
    • Place of Presentation
      Orlando, Florida,
    • Related Report
      2011 Research-status Report
  • [Presentation] 対話の流れと頷きパターン変化2011

    • Author(s)
      井上雅史, 入野俊夫, 古山宣洋, 花田里欧子, 一宮貴子,末崎裕康
    • Organizer
      HAIシンポジウム2010
    • Place of Presentation
      慶應義塾大, 神奈川
    • Related Report
      2011 Research-status Report
  • [Presentation] クライアントの主訴の遷移とその前後の身振り配置の変化2011

    • Author(s)
      末崎裕康, 古山宣洋, 花田里欧子, 井上雅史
    • Organizer
      日本心理臨床学会第30回秋季大会
    • Place of Presentation
      福岡国際会議場, 福岡
    • Related Report
      2011 Research-status Report
  • [Presentation] Continuous annotations for dialogue status and their change points

    • Author(s)
      Masashi Inoue, Toshio Irino, Ryoko Hanada, Nobuhiro Furuyama, and Hiroyasu Massaki
    • Organizer
      10th workshop on Multimodal Corpora: Combining applied and basic research targets
    • Place of Presentation
      Reykjavik, Iceland
    • Related Report
      2013 Annual Research Report
  • [Presentation] Multimodal corpus for psychotherapeutic situation

    • Author(s)
      Masashi Inoue, Ryoko Hanada, Nobuhiro Furuyama, Toshio Irino, Takako Ichinomiya, and Hiroyasu Massaki
    • Organizer
      Workshop on Multimodal corpora: How Should Multimodal corpora Deal with the Situation? , (Pre-conference workshop of LREC 2012 )
    • Place of Presentation
      Istanbul, Turkey
    • Related Report
      2012 Research-status Report
  • [Remarks] 入野俊夫 web page

    • URL

      http://www.wakayama-u.ac.jp/~irino/

    • Related Report
      2013 Final Research Report
  • [Remarks] 入野俊夫home page

    • URL

      http://www.wakayama-u.ac.jp/~irino/

    • Related Report
      2013 Annual Research Report

URL: 

Published: 2011-08-05   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi