• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2023 Fiscal Year Annual Research Report

World in your hand: Investigating the underlying mechanism of thermal material recognition and its interaction with multisensory information

Research Project

Project/Area Number 22H03679
Allocation TypeSingle-year Grants
Research InstitutionKyushu University

Principal Investigator

Ho HsinNi  九州大学, 芸術工学研究院, 准教授 (60466406)

Co-Investigator(Kenkyū-buntansha) 佐藤 克成  奈良女子大学, 工学系, 准教授 (00708381)
Project Period (FY) 2022-04-01 – 2027-03-31
KeywordsShitsukan recognition / Thermal perception / Haptics / Material perception / Multisensory interaction
Outline of Annual Research Achievements

This year our research focued on (1) thermal analysis of artificial fingers for recording thermal transients during hand-object interactions, (2) material perception based on thermal cues, and (3) the temporal integration of thermal and tactile cues.

Based on our fingings, we (1) identified candidate materials for the artificial finger, (2) proposed a model for the relationship between physical thermal properties and the mental representation of material categories, and (3) determined the temporal window for integrating thermal and tactile information.

Our findings have been accepted by prestigious World Haptics 2023 and Eurohaptics 2024, and has submitted to the journal IEEE Transactions on Haptics. Our research has the potential to inform the engineering design of haptic technologies.

Current Status of Research Progress
Current Status of Research Progress

1: Research has progressed more than it was originally planned.

Reason

Our research has progressed more smoothly than initially planned. Originally, we intended to conduct human experiments on thermal material recognition this year. In the end, we not only completed the planned experiments but also investigated the temporal multisensory interactions. More importantly, we were able to present our findings at an international conference.

Strategy for Future Research Activity

In FY2024, we will advance our research on thermal analysis of hand-object interactions by developing an artificial finger based on our FY2023 findings. We will collect thermal transient data to support a machine-learning model for thermal displays and an automatic material classification system for robotic hands. Additionally, we will enhance our thermal display technology to simulate various materials under different thermal conditions, further examining the impact on material category judgments. Our findings will be presented at Eurohaptics 2024, and we aim to publish our research, contributing to the broader scientific discourse on haptic technology.

  • Research Products

    (10 results)

All 2024 2023 Other

All Int'l Joint Research (1 results) Journal Article (1 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 1 results) Presentation (8 results) (of which Invited: 1 results)

  • [Int'l Joint Research] Massachusetts Institute of Technology(米国)

    • Country Name
      U.S.A.
    • Counterpart Institution
      Massachusetts Institute of Technology
  • [Journal Article] Determination of the Thermal-tactile Simultaneity Window for Multisensory Cutaneous Displays*2023

    • Author(s)
      Jodai Takuya、Terao Masahiko、Jones Lynette A.、Ho Hsin-Ni
    • Journal Title

      Proceedings of 2023 IEEE World Haptics Conference (WHC)

      Volume: - Pages: -

    • DOI

      10.1109/WHC56415.2023.10224482

    • Peer Reviewed / Int'l Joint Research
  • [Presentation] オノマトペマップを用いた温度が生地の質感知覚に与える影響の評価2024

    • Author(s)
      室山 理奈, 何 昕霓
    • Organizer
      第19回日本感性工学会春季大会
  • [Presentation] 材質カテゴリーの心的表象に及ぼす熱特性の影響についての探求2024

    • Author(s)
      西村 惇, 三浦 飛鳥, 宮﨑 康次, 何昕霓
    • Organizer
      第19回日本感性工学会春季大会
  • [Presentation] 温・触覚間の多感覚相互作用2023

    • Author(s)
      Hsin-Ni Ho
    • Organizer
      日本基礎心理学会第42回大会
    • Invited
  • [Presentation] Exploring the Relationship between Thermal Property and Mental Representation of Material Categories2023

    • Author(s)
      Hsin-Ni Ho and Atsu Nishimura
    • Organizer
      日本基礎心理学会第42回大会
  • [Presentation] オノマトペマップを用いた温度が生地の質感知覚に与える影響の評価2023

    • Author(s)
      Rina Muroyama, Hsin-Ni Ho
    • Organizer
      ハプティクス研究委員会 第31回研究会.
  • [Presentation] Simultaneous Perception of Warming and Tactile Stimuli in Multisensory Cutaneous Displays2023

    • Author(s)
      Takuya Jodai, Masahiko Terao, Lynette A. Jones, Hsin-Ni Ho
    • Organizer
      ハプティクス研究委員会 第31回研究会
  • [Presentation] Verification of Thermal Property of Artificial Fingers for Recording Thermal Transients During Hand-Object Interaction2023

    • Author(s)
      亀山直生, Hsin-Ni Ho
    • Organizer
      ハプティクス研究委員会 第31回研究会
  • [Presentation] Determination of the thermal-tactile simultaneity window for multisensory displays2023

    • Author(s)
      Jodai, T., Terao, M., Jones, L.A., Ho, H.-N. (2023), "
    • Organizer
      第14回多感覚研究会

URL: 

Published: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi