• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Detecting and Supporting People with Communication Difficulties using Multi-sensor and Statistical Models

Research Project

Project/Area Number 26540117
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Intelligent informatics
Research InstitutionNara Institute of Science and Technology

Principal Investigator

Nakamura Satoshi  奈良先端科学技術大学院大学, 情報科学研究科, 教授 (30263429)

Co-Investigator(Kenkyū-buntansha) 岩坂 英巳  奈良県立医科大学, 医学部, 研究員 (70244712)
根來 秀樹  奈良教育大学, 教育学研究科, 教授 (80336867)
サクリアニ サクティ  奈良先端科学技術大学院大学, 情報科学研究科, 助教 (00395005)
戸田 智基  名古屋大学, 情報基盤センター, 教授 (90403328)
Neubig Graham (NEUBIG Graham)  奈良先端科学技術大学院大学, 情報科学研究科, 助教 (70633428)
田中 宏季  奈良先端科学技術大学院大学, 情報科学研究科, 特任助教 (10757834)
Project Period (FY) 2014-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2016: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2015: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2014: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Keywordsコミュニケーション障害の計測 / 支援技術 / コミュニケーション測定
Outline of Final Research Achievements

We have attempted to automate one or several parts of social skills training through social signal processing. While the previous system was only tested by members of the general population of graduate students, in this paper we applied the system to people with autism spectrum disorders. Finally, we recruited 10 males (7-19 ages) of autism spectrum disorders, and they used the system. A clinical psychologist rated the overall speaking skills. As a result, we confirmed a significant improvement in speaking skills between pre and post training. We reported computer-based social skills training are useful for people with social 376 communication difficulties to improve narrative skills. This type of system can be widely used by teachers, therapists, and trainers of SST for supplementary use or home use anywhere and anytime.

Report

(4 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Research-status Report
  • 2014 Research-status Report
  • Research Products

    (20 results)

All 2017 2016 2015 2014

All Journal Article (5 results) (of which Peer Reviewed: 5 results,  Acknowledgement Compliant: 5 results,  Open Access: 3 results) Presentation (15 results) (of which Int'l Joint Research: 3 results,  Invited: 1 results)

  • [Journal Article] Multimodal Automated Social Skills Training in People with Autism Spectrum Disorders2017

    • Author(s)
      Hiroki Tanaka, Hideki Negoro, Hidemi Iwasaka, Satoshi Nakamura
    • Journal Title

      Plos One

      Volume: 印刷中

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Teaching Social Communication Skills through Human-Agent Interaction2016

    • Author(s)
      Hiroki Tanaka, Sakriani Sakti, Graham Neubig, Tomoki Toda, Hideki Negoro, Hidemi Iwasaka, Satoshi Nakamura
    • Journal Title

      ACM Transactions on Interactive Intelligent Systems

      Volume: 6(2) Issue: 2 Pages: 1-26

    • DOI

      10.1145/2937757

    • NAID

      120006309712

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Enhancing Event-Related Potentials Based on Maximum a Posteriori Estimation with a Spatial Correlation Prior2016

    • Author(s)
      Hayato Maki, Tomoki Toda, Sakriani Sakti, Graham Neubig, Satoshi Nakamura
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E99.D Issue: 6 Pages: 1437-1446

    • DOI

      10.1587/transinf.2015CBP0008

    • NAID

      130005154708

    • ISSN
      0916-8532, 1745-1361
    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Teaching Social Communication Skills through Human-Agent Interaction2016

    • Author(s)
      HIROKI TANAKA, SAKRIANI SAKTI, GRAHAM NEUBIG, TOMOKI TODA, HIDEKI NEGORO, HIDEMI IWASAKA, SATOSHI NAKAMURA,
    • Journal Title

      ACM Transactions on Interactive Intelligent Systems

      Volume: 9

    • NAID

      120006309712

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Automated Social Skills Trainer2015

    • Author(s)
      Hiroki Tanaka, Sakriani Sakti, Graham Neubig, Tomoki Toda, Hideki Negoro, Hidemi Iwasaka, Satoshi Nakamura
    • Journal Title

      International Conference on Intelligent User Interfaces (IUI)

      Volume: - Pages: 17-27

    • Related Report
      2014 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] EEG計測による脳活動に基づいた映像視聴時の感情状態の追従2017

    • Author(s)
      寺澤 直人, 田中 宏季, Sakriani Sakti, 中村 哲
    • Organizer
      電子情報通信学会技術研究報告(MEとバイオサイバネティックス研究会)
    • Place of Presentation
      機械振興会館(東京都・港区)
    • Year and Date
      2017-03-13
    • Related Report
      2016 Annual Research Report
  • [Presentation] EEG計測による脳活動に基づいた映像視聴時の感情状態の追従2017

    • Author(s)
      渡部 宏樹,田中 宏季,サクティ サクリアニ,中村 哲
    • Organizer
      電子情報通信学会技術研究報告(MEとバイオサイバネティックス研究会)
    • Place of Presentation
      九州大学病院キャンパス(福岡県・福岡市)
    • Year and Date
      2017-01-27
    • Related Report
      2016 Annual Research Report
  • [Presentation] 自閉スペクトラム症による自動ソーシャルスキルトレーナの訓練効果2016

    • Author(s)
      田中 宏季,根來 秀樹,岩坂 英巳,中村 哲
    • Organizer
      電 子情報通信学会技術研究報告(福祉情報工学研究会)
    • Place of Presentation
      産総研臨海副都心センター(東京都・江東区)
    • Year and Date
      2016-12-14
    • Related Report
      2016 Annual Research Report
  • [Presentation] Personalized Unknown Word Detection in Non-native Language Reading using Eye Gaze2016

    • Author(s)
      Rui Hiraoka, Hiroki Tanaka, Sakti Sakriani, Graham Neubig, Satoshi Nakamura
    • Organizer
      ACM International Conference on Multimodal Interaction (ICMI)
    • Place of Presentation
      日本科学未来館(東京都・江東区)
    • Year and Date
      2016-11-12
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 注視特徴を用いた非母語読解時の未知語検出における品詞タグの使用と個人適応の検討2016

    • Author(s)
      平岡 類,田中 宏季,Sakriani Sakti,Graham Neubig,中村 哲
    • Organizer
      電子情報通信学会技術研究報告(ヒューマン情報処理研究会)
    • Place of Presentation
      奈良春日野国際フォーラム(奈良県・奈良市)
    • Year and Date
      2016-09-27
    • Related Report
      2016 Annual Research Report
  • [Presentation] Eye Gaze-based Unknown Word Detection in Non-native Language Reading using SVMs and Random Forests2016

    • Author(s)
      Rui Hiraoka, Hiroki Tanaka, Sakti Sakriani, Koichiro Yoshino, Graham Neubig, Satoshi Nakamura
    • Organizer
      International Conference of the IEEE Engineering in Medicine and Biology Society
    • Place of Presentation
      フロリダ(米国)
    • Year and Date
      2016-08-16
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Automated Social Skills Training with Audiovisual Information2016

    • Author(s)
      Hiroki Tanaka, Sakriani Sakti, Graham Neubig, Hideki Negoro, Hidemi Iwasaka, Satoshi Nakamura
    • Organizer
      International Conference of the IEEE Engineering in Medicine and Biology Society
    • Place of Presentation
      フロリダ(米国)
    • Year and Date
      2016-08-16
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 注視特徴を用いたSVMによる非母語読解時の未知語検出2016

    • Author(s)
      平岡 類,田中 宏季,Sakriani Sakti,吉野 幸一郎,Graham Neubig,中村 哲
    • Organizer
      電子情報通信学会技術研究報告(ヒューマン情報処理研究会)
    • Place of Presentation
      沖縄産業支援センター(沖縄県・那覇市)
    • Year and Date
      2016-05-18
    • Related Report
      2016 Annual Research Report
  • [Presentation] マルチモーダル情報の提示を含んだ自動ソーシャルスキルトレーニングの訓練効果2016

    • Author(s)
      田中 宏季
    • Organizer
      日本音響学会 春季研究発表会
    • Place of Presentation
      桐蔭横浜大学(神奈川県横浜市)
    • Year and Date
      2016-03-09
    • Related Report
      2015 Research-status Report
  • [Presentation] マルチモーダル情報による自動ソーシャルスキルトレーナの開発2015

    • Author(s)
      田中 宏季
    • Organizer
      SST普及協会 第20回学術集会
    • Place of Presentation
      千里ライフサイエンスセンター(大阪府豊中市)
    • Year and Date
      2015-11-27
    • Related Report
      2015 Research-status Report
  • [Presentation] EEGを用いた未知語知覚の検出2015

    • Author(s)
      真木 勇人
    • Organizer
      第2回サイレント音声認識ワークショップ
    • Place of Presentation
      神戸大学(兵庫県神戸市)
    • Year and Date
      2015-10-16
    • Related Report
      2015 Research-status Report
  • [Presentation] マルチモーダル情報を伴った自動対話訓練システム2015

    • Author(s)
      田中 宏季
    • Organizer
      2015年10月度音声研究会
    • Place of Presentation
      神戸大学(兵庫県神戸市)
    • Year and Date
      2015-10-15
    • Related Report
      2015 Research-status Report
  • [Presentation] NIRSを用いた脳活動計測による認知トレーニングの客観的評価2015

    • Author(s)
      蓑田由花里
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      立命館大学びわこ・くさつキャンパス(滋賀県草津市)
    • Year and Date
      2015-03-10 – 2015-03-13
    • Related Report
      2014 Research-status Report
  • [Presentation] 感情コンピューティングによるソーシャルスキルトレーニング の自動化2015

    • Author(s)
      田中宏季
    • Organizer
      発達障害支援研究会 第2回「自閉症と音声」
    • Place of Presentation
      工学院大学(東京都新宿区)
    • Year and Date
      2015-03-08
    • Related Report
      2014 Research-status Report
    • Invited
  • [Presentation] ソーシャルスキルトレーニングの自動化2014

    • Author(s)
      田中宏季
    • Organizer
      第7回教育工学研究会(ET)
    • Place of Presentation
      大阪府立大学(大阪府堺市)
    • Year and Date
      2014-11-14
    • Related Report
      2014 Research-status Report

URL: 

Published: 2014-04-04   Modified: 2020-08-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi