• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A system to improve interpersonal communication skills of children and persons with developmental disabilities using VR technology

Research Project

Project/Area Number 18K11416
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 61020:Human interface and interaction-related
Research InstitutionKonan University

Principal Investigator

Tamura Yuichi  甲南大学, 知能情報学部, 教授 (50311212)

Co-Investigator(Kenkyū-buntansha) 梅谷 智弘  甲南大学, 知能情報学部, 准教授 (10397630)
中村 浩章  核融合科学研究所, ヘリカル研究部, 教授 (30311210)
内田 勇人  兵庫県立大学, 環境人間学部, 教授 (50213442)
大野 暢亮  兵庫県立大学, シミュレーション学研究科, 教授 (50373238)
Project Period (FY) 2018-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2021: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2020: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2019: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Fiscal Year 2018: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
KeywordsVirtual reality / Emotion recognition / Communication skills / Visual cognition / Developmental disability / Head mouted display / Support vector machine / 訓練システム / 大きさ知覚 / HMD / 発達障害 / 感情分析 / 感情認識 / VR / バーチャルリアリティ / 自転車 / SVM / 社会的感情 / 生体情報処理 / サポートベクターマシン / 深層学習 / 発達障害支援
Outline of Final Research Achievements

The purpose of this study is to construct an interpersonal communication support system for individuals with developmental disabilities using virtual reality (VR) technology.The main research objectives and outcomes are as follows:
1. Creation of an omnidirectional real image space within a VR environment.2. Research on methods to quantify the emotions experienced by users. 3. Development of a simulator to facilitate the VR environment experience.
To achieve the first objective, we have developed a technology capable of creating a 360° experimental image within the VR space. This technology allows for a comprehensive visual experience for the users. For the second objective, an emotion discriminator has been developed using Support Vector Machines (SVM) to accurately identify the emotions experienced by the subjects. To fulfill the third objective, we have developed a bicycle-based simulator that enables navigation and exploration within the VR environment.

Academic Significance and Societal Importance of the Research Achievements

本研究では次の領域で貢献があったと考える。一つは感情認識の分野である。感情分析の研究は主に表情を使ったものが多く,音声を利用しても映像情報の補完として利用される場合が多かった。本研究では音声情報からのみ感情情報を読み取る手法を提案したことに意義があると考えられる。もう一つはシミューレータの分野においてである。今回,自転車型のシミュレータの開発を行ったが,自転車型移動デバイスは自動車型シミュレータと比較して不安定である。そのため体験者は自らの視覚情報に大きく依存して,操作していることがわかり,視覚情報が幾何的に不自然な場合操作困難になることがわかった。本件については継続して研究を進めていく。

Report

(6 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Research-status Report
  • 2020 Research-status Report
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (26 results)

All 2022 2021 2020 2019 2018

All Journal Article (6 results) (of which Peer Reviewed: 6 results,  Open Access: 4 results) Presentation (19 results) (of which Int'l Joint Research: 10 results) Book (1 results)

  • [Journal Article] Isotope effect of rovibrational distribution of hydrogen molecules desorbed from amorphous carbon2022

    • Author(s)
      H. Nakamura, S. Saito, T. Sawada, K. Sawada, G. Kawamura, M. Kobayashi, and M. Hasuo
    • Journal Title

      Journal of Applied Physics

      Volume: 61 Issue: SA Pages: SA1005-SA1005

    • DOI

      10.35848/1347-4065/ac2435

    • NAID

      120007191897

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Electrical Muscle Stimulation to Develop and Implement Menstrual Simulator System2021

    • Author(s)
      Asada Chihiro、Tsutsumi Kotori、Tamura Yuichi、Hara Naoya、Omori Wataru、Otsuka Yuta、Sato Katsunari
    • Journal Title

      Journal of Robotics and Mechatronics

      Volume: 33 Issue: 5 Pages: 1051-1062

    • DOI

      10.20965/jrm.2021.p1051

    • NAID

      130008106032

    • ISSN
      0915-3942, 1883-8049
    • Year and Date
      2021-10-20
    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Image processing method for automatic measurement of number of DNA breaks2021

    • Author(s)
      Saito Seiki、Nakamura Hiroaki、Kenmotsu Takahiro、Oya Yasuhisa、Hatano Yuji、Tamura Yuichi、Fujiwara Susumu、Ohtani Hiroaki
    • Journal Title

      Journal of Advanced Simulation in Science and Engineering

      Volume: 8 Issue: 2 Pages: 173-193

    • DOI

      10.15748/jasse.8.173

    • NAID

      130008091216

    • ISSN
      2188-5303
    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] A theoretical approach to structural change of a polymer induced by beta decays of substituted tritium based on the linear response theory2021

    • Author(s)
      Fujiwara Susumu、Kawanami Ryuta、Li Haolun、Nakamura Hiroaki、Omata Kazumi
    • Journal Title

      Journal of Advanced Simulation in Science and Engineering

      Volume: 8 Issue: 2 Pages: 211-222

    • DOI

      10.15748/jasse.8.211

    • NAID

      130008091215

    • ISSN
      2188-5303
    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] 剣道を通した交流が中学剣道部員の高齢剣道実践者イメージに与える影響 : SD法による測定と横断分析2021

    • Author(s)
      松本 大佑, 濵口 郁枝, 濵口 雅行, 内田 勇人
    • Journal Title

      日本世代間交流学会誌

      Volume: 11 Pages: 31-39

    • NAID

      40022717036

    • Related Report
      2021 Research-status Report
    • Peer Reviewed
  • [Journal Article] Dissipative Particle Dynamics Simulation for Self-Assembly of Symmetric Bolaamphiphilic Molecules in Solution2018

    • Author(s)
      Susumu FUJIWARA, Yoshiki IIDA, Takehide TSUTSUI, Tomoko MIZUGUCHI, Masato HASHIMOTO, Yuichi TAMURA and Hiroaki NAKAMURA
    • Journal Title

      Plasma and Fusion Research

      Volume: 13 Issue: 0 Pages: 3401095-3401095

    • DOI

      10.1585/pfr.13.3401095

    • NAID

      130007472562

    • ISSN
      1880-6821
    • Year and Date
      2018-07-26
    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Presentation] Relationship between size perception and vergence in virtual space2022

    • Author(s)
      Hiroyuki Makino, Nobuaki Ohno and Yuichi Tamura
    • Organizer
      Proc. of the 41st JSST Annual International Conference on Simulation
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Development of Simulation Codes to Treat Hydrogen Molecules Process in Divertor Plasma Region including Divertor Plate2021

    • Author(s)
      Hiroaki Nakamura
    • Organizer
      28th IAEA Fusion Energy Conference (FEC 2020)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Molecular Dynamics Simulation on Hydrogen Isotope Molecules Emitted from Amorphous Carbon2021

    • Author(s)
      Hiroaki Nakamura
    • Organizer
      The 40th JSST Annual International Conference on Simulation Technology
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] A sharing system for the annoyance of menstrual symptoms using electrical muscle stimulation and thermal stimulations2021

    • Author(s)
      Chihiro Asada, Kotori Tsutsumi, Tamura Yuichi, Naoya Hara, Wataru Omori, Yuta Otsuka, Katsunari Sato
    • Organizer
      VRST '21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and TechnologyDecember
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Continuous collision avoidance model between pedestrians2021

    • Author(s)
      Kotori Tsutsumi, Yuichi Tamura and Katsunari Sato
    • Organizer
      Proceedings of the 40th JSST Annual International Conference on Simulation Technology
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Study for Recognizing and Simulating Deliberate Emotional Expressions in Japanese Speech2021

    • Author(s)
      Chihiro Asada , Yuichi Tamura , Ryo Nagata and Katsunari Sato
    • Organizer
      Proceedings of the 40th JSST Annual International Conference on Simulation Technology
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Change Detection of Sleeping Condition based on IoT Distributed Sensing for Bedclothes2021

    • Author(s)
      Tomohiro UMETANI, Shoichiro INOUE, Taiki YAMAMOTO, Mayuko ISHII, Yuichi TAMURA, Naoki SAIWAKI and Kiyoko YOKOYAMA
    • Organizer
      2021 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] 行動履歴情報を用いたユーザとコミュニケーションロボットによる対話制御の一検討2021

    • Author(s)
      梅谷智弘,西田有希,北村達也
    • Organizer
      第64回自動制御連合講演会講演論文集
    • Related Report
      2021 Research-status Report
  • [Presentation] 位置情報履歴を用いた人間とコミュニケーションロボットによる対話生成手法の検討2021

    • Author(s)
      西田有希,北村達也,梅谷智弘
    • Organizer
      日本音響学会音声研究会資料
    • Related Report
      2021 Research-status Report
  • [Presentation] 会話音声における社会的感情の分類2021

    • Author(s)
      麻田 千尋, 田村 祐一, 佐藤 克成
    • Organizer
      第22回計測自動制御学会 システムインテグレーション部門講演会
    • Related Report
      2021 Research-status Report
  • [Presentation] 連続回避本能再現のための歩行モデルパラメータの推定2021

    • Author(s)
      堤 琴里, 田村 祐一, 佐藤 克成
    • Organizer
      第22回計測自動制御学会 システムインテグレーション部門講演会
    • Related Report
      2021 Research-status Report
  • [Presentation] Effect of Exchange Through Kendo on the Image of the elderly of Junior High School Kendo Club Members -Measurement and cross-sectional analysis by SD method2021

    • Author(s)
      Daisuke Matsumoto, Hayato Uchida
    • Organizer
      The Gerontological Society of America 2021
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] 会話音声における社会的感情の分類2020

    • Author(s)
      麻田 千尋,田村 祐一,佐藤 克成
    • Organizer
      計測自動制御学会システムインテグレーション部門学術講演会
    • Related Report
      2020 Research-status Report
  • [Presentation] 音声から社会的感情を自動検出する手法の検討2020

    • Author(s)
      麻田 千尋,田村 祐一,佐藤 克成
    • Organizer
      第25回日本バーチャルリアリティ学会大会
    • Related Report
      2020 Research-status Report
  • [Presentation] 相手の発話意図を音声から自動検出する手法の検討2020

    • Author(s)
      麻田千尋,田村祐一,永田 亮
    • Organizer
      電子情報通信学会
    • Related Report
      2019 Research-status Report
  • [Presentation] 「ながらスマホ」の危険性を評価する自転車シミュレータの開発2019

    • Author(s)
      名倉成輝 , 大野暢亮, 内田勇人 , 田村祐一
    • Organizer
      日本バーチャルリアリティ学会
    • Related Report
      2019 Research-status Report
  • [Presentation] Change Detection of Sleeping Conditions based on Distributed IoT Sensing2018

    • Author(s)
      Tomohiro UMETANI, Mayuko ISHII, Yuichi TAMURA, Naoki SAIWAKI and Kiyoko YOKOYAMA
    • Organizer
      SICE Annual Conference 2018
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Change Detection of Sleeping Conditions based on Multipoint Ambient Sensing of Comforter on Bed2018

    • Author(s)
      Tomohiro UMETANI, Mayuko ISHII, Yuichi TAMURA, Naoki SAIWAKI and Kiyoko YOKOYAMA
    • Organizer
      40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] "ながらスマホ"の危険性を評価する自転車シミュレータの開発2018

    • Author(s)
      名倉成輝 大野暢亮 内田勇人 田村祐一
    • Organizer
      電気学会
    • Related Report
      2018 Research-status Report
  • [Book] スポーツビジネス概論42021

    • Author(s)
      内田勇人.黒田次郎、石黒大輔、萩原悟一
    • Total Pages
      280
    • Publisher
      叢文社
    • ISBN
      4794708173
    • Related Report
      2021 Research-status Report

URL: 

Published: 2018-04-23   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi