2016 Fiscal Year Annual Research Report
身体および接触対象への映像重畳投影が触質感知覚に及ぼす影響の解明
| Project/Area Number |
16J00049
|
|---|
| Research Institution | Osaka University |
|---|
Principal Investigator |
|
|---|
| Project Period (FY) |
2016-04-22 – 2018-03-31
|
| Keywords | Augmented reality / Pseudo-haptic feedback / Softness perception / Product visualization |
|---|
| Outline of Annual Research Achievements |
In the past fiscal year, I investigated the method to visually enhance the perceive softness by proposing 2 types of visual feedbacks, 1) surface deformation and 2) augmented color on the hand or finger. The surface warping deformation and augmented color gradually changing the amount of color according to the input force of the user finger. I built the prototype system by integrating the deformation estimation technique from previous studies and the computer vision method using depth sensor to track a finger region. The system has controlled by a single PC. I conducted the psychophysical experiment to study the effect of proposed visual effects. I used the standard silicone sheet that well-calibrated with a durometer. From the experiment result, I founded that the modification of surface deformation appearance, and the change of finger color could enhanced the perceive softness in touching soft objects. The result of this studied has been presented at ACM SIGGRAPH 2016. The result of this study also invited to present at the domestic conference called MIRU2016.
|
| Current Status of Research Progress |
Current Status of Research Progress
1: Research has progressed more than it was originally planned.
Reason
In the previous fiscal year, I first performed experiments to measure visual deformation pattern of the flexible object. I selected the silicone sheets with different softness, placed on the force sensor and pushed with various force. The deformation pattern of the sheet at the pushed time was measured with an infrared camera that installed at the upper part of the measurement system. Next, I set up a system that establishes a projector next to the camera and performed the projection mapping to the silicone and the finger area to clarify whether or not softness perception can be manipulated. I conducted the psychophysical experiment to investigate how the change of visual feedback (surface projection pattern and finger color change) influence the softness perception. From the experiment result, I found that combined surface deformation projection pattern with finger color change could influence the softness perception. In particular, the participants felt the silicone sheet is softer than its physical softness when projected with larger visual feedback. I then find out the relationship between deformation amount of visual deformation pattern and perceived softness and find the most effective finger projection effect. To control the above experimental equipment, I used a single workstation connected to all sensors and programs. The result of this studied has been presented at ACM SIGGRAPH 2016 as the invited presentation, as well as published in the IEEE Transactions on Visualization and Computer Graphic (TVCG).
|
| Strategy for Future Research Activity |
Based on the psychophysical experiment obtained in the previous fiscal year, this fiscal year will focus on the application to manipulate the softness of the physical objects. For example, if you input the actual softness of the physical object and the softness as the target perception, an application system automatically calculates the projection pattern to be irradiated, perceives the desired softness of the target perception. To verify the effectiveness of this system, I will prepare various flexible objects and measure physical softness, setting various tenderness as a target softness perception. The softness that actually perceived is clarified through subject experiment. Furthermore, I plan to compare the conventional approach using virtual reality technology and clarify the effectiveness of the proposed method. Specifically, I plan to purchase a head-mounted display, a machine vision camera, a 3D haptic interface, and 3D computer graphics software at research expenses, build an application system, and conduct a subject experiment. The results obtained are presented at domestic and international conferences. The conclude of this study will submit as the journal paper.
|
