• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Teaching communication skills for children with neurodevelopmental disorders

Research Project

Project/Area Number 18K11437
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 61030:Intelligent informatics-related
Research InstitutionNara Institute of Science and Technology

Principal Investigator

Tanaka Hiroki  奈良先端科学技術大学院大学, 先端科学技術研究科, 助教 (10757834)

Co-Investigator(Kenkyū-buntansha) 中村 哲  奈良先端科学技術大学院大学, データ駆動型サイエンス創造センター, 教授 (30263429)
岩坂 英巳  奈良県立医科大学, 医学部, 研究員 (70244712)
根來 秀樹  奈良教育大学, 教職開発講座, 教授 (80336867)
Project Period (FY) 2018-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2020: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Fiscal Year 2019: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2018: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Keywords自閉スペクトラム症 / マルチモーダル / 社会的認知 / 仮想エージェント / ラポール / 心の理論 / コミュニケーション支援 / 対話システム / 感情コンピューティング / コミュニケーションスキル / 音声処理 / 画像処理 / 音声対話 / 自閉症スペクトラム / 生体信号処理 / 認知行動療法
Outline of Final Research Achievements

We built a dialogue system that provides feedback that encourages positive reinforcement regarding the user's listening and expressive skills. The evaluation of the SST training effect was carried out using questionnaires (eg. Social Responsiveness Scale-2, general self-efficacy) and a rating by a psychiatrist. During this research period, we implemented a basic system and evaluated it by experiments with regard to listening to users, and how to provide appropriate feedback. We also explored the improvement of self-efficacy and the acceptability of virtual agents.

Academic Significance and Societal Importance of the Research Achievements

本研究により次の目的を達成することを目指す。日常生活の中で、自閉スペクトラム症をはじめとした発達障害児が自分の状態や都合に合わせ、オンデマンドでコミュニケーションスキルを訓練できるシステムを構築する。また、精神科医師が行うSSTの補助となるシステムを構築する。
ソーシャルスキルトレーニングを活用したトレーニング手法が、医療職者等による訓練手法に比してどの程度代替可能か、ないしは新たな貢献が可能か、当該訓練とその効果に関する研究に新たな展開を見出すことが可能になる。

Report

(5 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Research-status Report
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (22 results)

All 2022 2021 2020 2019 2018

All Journal Article (7 results) (of which Int'l Joint Research: 5 results,  Peer Reviewed: 6 results,  Open Access: 4 results) Presentation (15 results) (of which Int'l Joint Research: 15 results)

  • [Journal Article] The Acceptability of Virtual Characters as Social Skills Trainers: Usability Study2022

    • Author(s)
      Tanaka Hiroki、Nakamura Satoshi
    • Journal Title

      JMIR Human Factors

      Volume: 9 Issue: 1 Pages: e35358-e35358

    • DOI

      10.2196/35358

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Analyzing Self-Efficacy and Summary Feedback in Automated Social Skills Training2021

    • Author(s)
      Tanaka Hiroki、Iwasaka Hidemi、Matsuda Yasuhiro、Okazaki Kosuke、Nakamura Satoshi
    • Journal Title

      IEEE Open Journal of Engineering in Medicine and Biology

      Volume: 2 Pages: 65-70

    • DOI

      10.1109/ojemb.2021.3075567

    • Related Report
      2021 Annual Research Report 2020 Research-status Report
  • [Journal Article] Analysis of Conversational Listening Skills toward Agent-based Social Skills Training2020

    • Author(s)
      Hiroki Tanaka, Hidemi Iwasaka, Hideki Negoro, Satoshi Nakamura
    • Journal Title

      Journal on Multimodal User Interfaces

      Volume: 14 Issue: 1 Pages: 73-82

    • DOI

      10.1007/s12193-019-00313-y

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Neural Oscillation-Based Classification of Japanese Spoken Sentences During Speech Perception2019

    • Author(s)
      Hiroki Watanabe, Hiroki Tanaka, Sakriani Sakti, Satoshi Nakamura
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E102.D Issue: 2 Pages: 383-391

    • DOI

      10.1587/transinf.2018EDP7293

    • NAID

      130007586194

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2019-02-01
    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Synchronization between overt speech envelope and EEG oscillations during imagined speech2019

    • Author(s)
      Hiroki Watanabe, Hiroki Tanaka, Sakriani Sakti, Satoshi Nakamura
    • Journal Title

      Neuroscience Research

      Volume: Volume 153 Pages: 48-55

    • DOI

      10.1016/j.neures.2019.04.004

    • NAID

      120006847155

    • Related Report
      2020 Research-status Report 2019 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Electroencephalogram-Based Single Trial Detection of Language Expectation Violations in Listening to Speech2019

    • Author(s)
      Hiroki Tanaka, Hiroki Watanabe, Hayato Maki, Sakti Sakriani, Satoshi Nakamura
    • Journal Title

      Frontiers in Computational Neuroscience

      Volume: 13 Pages: 1-11

    • DOI

      10.3389/fncom.2019.00015

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Quality Prediction of Synthesized Speech Based on Tensor Structured EEG Signals2018

    • Author(s)
      Hayato Maki, Sakriani Sakti, Hiroki Tanaka, Satoshi Nakamura
    • Journal Title

      PloS One

      Volume: 13 Issue: 6 Pages: 1-13

    • DOI

      10.1371/journal.pone.0193521

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Virtual Agent Design for Social Skills Training Considering Autistic Traits2021

    • Author(s)
      Hiroki Tanaka, Satoshi Nakamura
    • Organizer
      42nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Objective Prediction of Social Skills Level for Automated Social Skills Training Using Audio and Text Information2020

    • Author(s)
      Takeshi Saga, Hiroki Tanaka, Hidemi Iwasaka, Satoshi Nakamura
    • Organizer
      Adjunct of the 2020 International Conference on Multimodal Interaction (ICMI), Workshop on Social Affective Multimodal Interaction for Health
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Linguistic Features during Speech Utterances in the Context of Social Skills Training2020

    • Author(s)
      Hiroki Tanaka, Hidemi Iwasaka, Hideki Negoro, Satoshi Nakamura
    • Organizer
      42nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Sequential Attention-based Detection of Semantic Incongrueties from EEG While Listening to Speech2020

    • Author(s)
      Shunnosuke Motomura, Hiroki Tanaka, Satoshi Nakamura
    • Organizer
      42nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Detecting Dementia from Face in Human-Agent Interaction2019

    • Author(s)
      Hiroki Tanaka, Hiroyoshi Adachi, Hiroaki Kazui, Manabu Ikeda, Takashi Kudo, Satoshi Nakamura
    • Organizer
      djunct of the 2019 International Conference on Multimodal Interaction (ICMI)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Detecting Syntactic Violations from Single-trial EEG using Recurrent Neural Networks2019

    • Author(s)
      Shunnosuke Motomura, Hiroki Tanaka, Satoshi Nakamura
    • Organizer
      Adjunct of the 2019 International Conference on Multimodal Interaction (ICMI)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Measuring Affective Sharing between Two People by EEG Hyperscanning2019

    • Author(s)
      Taiki Kinoshita, Hiroki Tanaka, Koichiro Yoshino, Satoshi Nakamura
    • Organizer
      Adjunct of the 2019 International Conference on Multimodal Interaction (ICMI)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Speech Quality Evaluation of Synthesized Japanese Speech using EEG2019

    • Author(s)
      Ivan Halim Parmonangan, Hiroki Tanaka, Sakti Sakriani, Shinnosuke Takamichi, Satoshi Nakamura
    • Organizer
      Interspeech
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Speech Artifact Removal from EEG Recordings of Spoken Word Production with Tensor Decomposition2019

    • Author(s)
      Holy Lovenia, Hiroki Tanaka, Sakriani Sakti, Ayu Purwarianti, Satoshi Nakamura
    • Organizer
      EEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Listening Skills Assessment through Computer Agents2018

    • Author(s)
      Hiroki Tanaka, Hideki Negoro, Hidemi Iwasaka, Satoshi Nakamura
    • Organizer
      ACM International Conference on Multimodal Interaction (ICMI)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Detection of dementia from responses to atypical questions asked by embodied conversational agents2018

    • Author(s)
      Tsuyoki Ujiro, Hiroki Tanaka, Hiroyoshi Adachi, Hiroaki Kazui, Manabu Ikeda, Takashi Kudo, Satoshi Nakamura
    • Organizer
      Interspeech
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Identifying Dementia Patients based on Behavioral Markers in Human-Avatar Interaction2018

    • Author(s)
      Tsuyoki Ujiro, Hiroki Tanaka, Hiroyoshi Adachi, Hiroaki Kazui, Manabu Ikeda, Takashi Kudo, Satoshi Nakamura
    • Organizer
      World Federation of Societies of Biological Psychiatry (WFSBP)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Single-trial Detection of Semantic Anomalies from EEG during Listening to Spoken Sentences2018

    • Author(s)
      Hiroki Tanaka, Hiroki Watanabe, Hayato Maki, Sakriani Sakti, Satoshi Nakamura
    • Organizer
      International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Prediction of Depressive Tendency from Multidimensional Health Data Collected through Crowdsourcing2018

    • Author(s)
      Shiori Yamaguchi, Hiroki Tanaka, Hayato Maki, Shigehiko Kanaya, Nobutaka Suzuki, Satoshi Nakamura,
    • Organizer
      International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Graph regularized tensor factorization for single-trial EEG analysis2018

    • Author(s)
      Hayato Maki, Hiroki Tanaka, Sakriani Sakti, Satoshi Nakamura
    • Organizer
      IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2018-04-23   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi