• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

World in your hand: Investigating the underlying mechanism of thermal material recognition and its interaction with multisensory information

Research Project

Project/Area Number 23K24934
Project/Area Number (Other) 22H03679 (2022-2023)
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeMulti-year Fund (2024)
Single-year Grants (2022-2023)
Section一般
Review Section Basic Section 61060:Kansei informatics-related
Research InstitutionKyushu University

Principal Investigator

Ho HsinNi  九州大学, 芸術工学研究院, 准教授 (60466406)

Co-Investigator(Kenkyū-buntansha) 佐藤 克成  奈良女子大学, 工学系, 准教授 (00708381)
Project Period (FY) 2022-04-01 – 2027-03-31
Project Status Granted (Fiscal Year 2024)
Budget Amount *help
¥17,030,000 (Direct Cost: ¥13,100,000、Indirect Cost: ¥3,930,000)
Fiscal Year 2026: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2025: ¥2,600,000 (Direct Cost: ¥2,000,000、Indirect Cost: ¥600,000)
Fiscal Year 2024: ¥2,860,000 (Direct Cost: ¥2,200,000、Indirect Cost: ¥660,000)
Fiscal Year 2023: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
Fiscal Year 2022: ¥7,410,000 (Direct Cost: ¥5,700,000、Indirect Cost: ¥1,710,000)
KeywordsHaptics / Material recognition / Shitsukan perception / Shitsukan recognition / Thermal perception / Material perception / Multisensory interaction / Material percpetion / Temeprature
Outline of Research at the Start

Some materials feel colder to the touch than others, and this thermal information is useful for material recognition. Here we investigate its psychological process, including thermal cues for recognition, mental representation of materials, and multisensory influence. The findings will contribute to touch sharing utilizing digital touch technology, design practice emphasizing tactile quality and social welfare for the blind.

Outline of Annual Research Achievements

This year our research focued on (1) thermal analysis of artificial fingers for recording thermal transients during hand-object interactions, (2) material perception based on thermal cues, and (3) the temporal integration of thermal and tactile cues.

Based on our fingings, we (1) identified candidate materials for the artificial finger, (2) proposed a model for the relationship between physical thermal properties and the mental representation of material categories, and (3) determined the temporal window for integrating thermal and tactile information.

Our findings have been accepted by prestigious World Haptics 2023 and Eurohaptics 2024, and has submitted to the journal IEEE Transactions on Haptics. Our research has the potential to inform the engineering design of haptic technologies.

Current Status of Research Progress
Current Status of Research Progress

1: Research has progressed more than it was originally planned.

Reason

Our research has progressed more smoothly than initially planned. Originally, we intended to conduct human experiments on thermal material recognition this year. In the end, we not only completed the planned experiments but also investigated the temporal multisensory interactions. More importantly, we were able to present our findings at an international conference.

Strategy for Future Research Activity

In FY2024, we will advance our research on thermal analysis of hand-object interactions by developing an artificial finger based on our FY2023 findings. We will collect thermal transient data to support a machine-learning model for thermal displays and an automatic material classification system for robotic hands. Additionally, we will enhance our thermal display technology to simulate various materials under different thermal conditions, further examining the impact on material category judgments. Our findings will be presented at Eurohaptics 2024, and we aim to publish our research, contributing to the broader scientific discourse on haptic technology.

Report

(2 results)
  • 2023 Annual Research Report
  • 2022 Annual Research Report
  • Research Products

    (12 results)

All 2024 2023 2022 Other

All Int'l Joint Research (1 results) Journal Article (1 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 1 results) Presentation (10 results) (of which Invited: 1 results)

  • [Int'l Joint Research] Massachusetts Institute of Technology(米国)

    • Related Report
      2023 Annual Research Report
  • [Journal Article] Determination of the Thermal-tactile Simultaneity Window for Multisensory Cutaneous Displays2023

    • Author(s)
      Jodai,T., Terao,M., Jones.L., Ho, H-N.
    • Journal Title

      IEEE World Haptics Conference

      Volume: 2023 Pages: 230-236

    • DOI

      10.1109/whc56415.2023.10224482

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Presentation] オノマトペマップを用いた温度が生地の質感知覚に与える影響の評価2024

    • Author(s)
      室山 理奈, 何 昕霓
    • Organizer
      第19回日本感性工学会春季大会
    • Related Report
      2023 Annual Research Report
  • [Presentation] 材質カテゴリーの心的表象に及ぼす熱特性の影響についての探求2024

    • Author(s)
      西村 惇, 三浦 飛鳥, 宮﨑 康次, 何昕霓
    • Organizer
      第19回日本感性工学会春季大会
    • Related Report
      2023 Annual Research Report
  • [Presentation] 温・触覚間の多感覚相互作用2023

    • Author(s)
      Hsin-Ni Ho
    • Organizer
      日本基礎心理学会第42回大会
    • Related Report
      2023 Annual Research Report
    • Invited
  • [Presentation] Exploring the Relationship between Thermal Property and Mental Representation of Material Categories2023

    • Author(s)
      Hsin-Ni Ho and Atsu Nishimura
    • Organizer
      日本基礎心理学会第42回大会
    • Related Report
      2023 Annual Research Report
  • [Presentation] オノマトペマップを用いた温度が生地の質感知覚に与える影響の評価2023

    • Author(s)
      Rina Muroyama, Hsin-Ni Ho
    • Organizer
      ハプティクス研究委員会 第31回研究会.
    • Related Report
      2023 Annual Research Report
  • [Presentation] Simultaneous Perception of Warming and Tactile Stimuli in Multisensory Cutaneous Displays2023

    • Author(s)
      Takuya Jodai, Masahiko Terao, Lynette A. Jones, Hsin-Ni Ho
    • Organizer
      ハプティクス研究委員会 第31回研究会
    • Related Report
      2023 Annual Research Report
  • [Presentation] Verification of Thermal Property of Artificial Fingers for Recording Thermal Transients During Hand-Object Interaction2023

    • Author(s)
      亀山直生, Hsin-Ni Ho
    • Organizer
      ハプティクス研究委員会 第31回研究会
    • Related Report
      2023 Annual Research Report
  • [Presentation] Determination of the thermal-tactile simultaneity window for multisensory displays2023

    • Author(s)
      Jodai, T., Terao, M., Jones, L.A., Ho, H.-N. (2023), "
    • Organizer
      第14回多感覚研究会
    • Related Report
      2023 Annual Research Report
  • [Presentation] 温度手がかりに基づく材質知覚の研究2022

    • Author(s)
      西村惇 , 何昕霓
    • Organizer
      ハプティクス研究委員会 第29回研究会
    • Related Report
      2022 Annual Research Report
  • [Presentation] Determination of the thermal-tactile simultaneity window for multisensory displays2022

    • Author(s)
      Jodai, T , Ho, H.-N
    • Organizer
      ハプティクス研究委員会 第29回研究会
    • Related Report
      2022 Annual Research Report

URL: 

Published: 2022-04-19   Modified: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi