• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Human Interfaces Usag international and unintentional Nonverbal Behaviors

Research Project

Project/Area Number 12650249
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent mechanics/Mechanical systems
Research InstitutionSaitama University

Principal Investigator

KUNO Yoshinori  Saitama University, Faculty of Engineering, Professor, 工学部, 教授 (10252595)

Co-Investigator(Kenkyū-buntansha) SHIMADA Nobutaka  Osaka University, Graduate School of Engineering Research Associate, 大学院・工学研究科, 助手 (10294034)
NAKAMURA Akio  Saitama University, Faculty of Engineering, Research Associate, 工学部, 助手 (00334152)
Project Period (FY) 2000 – 2001
Project Status Completed (Fiscal Year 2001)
Budget Amount *help
¥3,500,000 (Direct Cost: ¥3,500,000)
Fiscal Year 2001: ¥2,000,000 (Direct Cost: ¥2,000,000)
Fiscal Year 2000: ¥1,500,000 (Direct Cost: ¥1,500,000)
KeywordsComputer vision / Human interface / Nonverbal communication / Gesture recognition / Gaze / Intention understanding / Motion analysis / Unintentional behavior / ヒューマンインタフェース / 無意識 / 仮想現実 / 追跡
Research Abstract

Unintentional nonverbal behaviors play an important role in human-human communication. However, only intentional nonverbal behaviors are used in human interfaces, which can be considered as human-machine communication. Thus we propose to use unintentional nonverbal behaviors in addition to intentional behaviors to realize user-friendly human interfaces. In this project, we have investigated the framework that is required in using unintentional behaviors effectively and have developed two application systems using such behaviors to prove the usefulness of our approach. As to the framework, we have devised a human-machine interaction method through gestures and verbal communication to recover failures, which cannot be avoided in recognizing unintentional behaviors by computer vision. One of the application systems is an intelligent wheelchair that can change how to avoid an approaching pedestrian according to the observation results of his/her head movements. If his/her head often turns toward it, he/she can be expected to notice it. Otherwise, he/she may not notice it. In the latter case, the wheelchair steps aside to avoid collision. In the former, it keeps observing the pedestrian because he/she usually starts avoiding it when it comes close to him/her. He/she does not move the head to show his/her noticing the wheelchair. However, the behavior can give valuable information for the wheelchair to determine the avoidance method. The second is a browser system that enables us to find necessary information speedily. Multiple windows containing information appear from the bottom of the display, moving upward swiftly. We move our eyes to obtain the information in the windows. The speed of such eye movements controls the upward moving speed of the windows so that we can get information from the system as fast as possible. Although we do not intend to move the eyes to control the speed, the action helps to realize a user-friendly human interface.

Report

(3 results)
  • 2001 Annual Research Report   Final Research Report Summary
  • 2000 Annual Research Report
  • Research Products

    (57 results)

All Other

All Publications (57 results)

  • [Publications] 村嶋照久, 久野義徳, 島田伸敬, 白井良明: "人間と機械のインタラクションを通じたジェスチャの理解と学習"日本ロボット学会誌. 18・4. 590-599 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y.Kuno, T.Murashima, N.Shimada, Y.Shirai: "Interactive Gesture Interface for Intelligent Wheelchairs"Proc. IEEE International Conference on Multimedia and Expo. (CD-ROM). (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y.Kuno, T.Murashima, N.Shimada, Y.Shirai: "Intelligent Wheelchair Remotely Controlled by Interactive Gestures"Proc. 15th International Conference on Pattern Recognition. 4. 672-675 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N.Shimada, K.Kimura, Y.Shirai, Y.Kuno: "Hand Posture Estimation by Combining 2-D Appearance-based and 3-D Model-based Approaches"Proc. 15th International Conference on Pattern Recognition. 3. 709-712 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N.Shimada, Y.Shirai, Y.Kuno: "Model Adaptation and Posture Estimation of Moving Articulated Object Using Monocular Camera"H.H Nagel and F. J. P. Lopez (Eds.), Articulated Motion and Deformable Objects, Lecture Notes in Computer Science 1899. 159-172 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y.Murakami, Y.Kuno, N.Shimada, Y.Shirai: "Intelligent Wheelchair Moving among People Based on Their Observations"Proc. 2000 International Conference on Systems, Man and Cybernetics. 1466-1471 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] S.Chong, Y.Kuno, N.Shimada, Y.Shirai: "Human-Robot Interface Based on Speech Understanding Assisted by Vision"T. Tan, Y. Shi, and W. Gao (Eds.), Advances in Multimodal Interfaces -ICMI 2000,Lecture Notes in Computer Science 1948. 16-23 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y.Kuno, T.Murashima, N.Shimada, Y.Shirai: "Understanding and Learning of Gestures through Human-Robot Interaction"Proc. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems. 2133-2138 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] O.Nishiyama, S.Chong, Y.Kuno, N.Shimada, Y.Shirai: "Speech and Gesture Based Interface Using Context and Visual Information"Proc. 6th International Conference on Control, Automation, Robotics and Vision. (CD-ROM). (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M.H.Jeong, Y.Kuno, N.Shimada, Y.Shirai: "Complex Hand-Gesture Recognition Using Active Contour and Switching Linear Model"Proc. 7th Korea-Japan Joint Workshop on Computer Vision. 151-156 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y.Kuno, Y.Murakami, N.Shimada, Y.Shirai: "Intelligent Wheelchair Observing the Faces of Both User and Pedestrians"Preprints of IFAC Workshop on Mobile Robot Technology. 232-237 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M.H.Jeong, Y.Kuno, N.Shimada, Y.Shirai: "Recognition of Shape-Changing Gestures Based on Switching Linear Model"Proc. 11th International Conference on Image Analysis and Processing. 14-19 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y.Murakami, Y.Kuno, N.Shimada, Y.Shirai: "Collision Avoidance by Observing Pedestrians' Faces for Intelligent Wheelchairs"Proc. 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. 2018-2023 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M.Yoshizaki, Y.Kuno, A.Nakamura: "Human-Robot Interface Based on the Mutual Assistance between Speech and Vision"Proc. Workshop on Perceptive User Interfaces. (CD-ROM). (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y.Kuno, Y.Murakami, N.Shimada, Y.Shirai: "User and Social Interfaces by Observing Human Faces for Intelligent Wheelchairs"Proc. Workshop on Perceptive User Interfaces. (CD-ROM). (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M.H.Jeong, Y.Kuno, N.Shimada, Y.Shirai: "Complex Gesture Recognition using Coupled Switching Linear Model"Proc. Fifth Asian Conference on Computer Vision. 132-137 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 村上佳史, 久野義徳, 島田伸敬, 白井良明: "知的車椅子のための歩行者の観察に基づく衝突回避"日本ロボット学会誌. (印刷中). (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y.Kuno, N.Shimada, Y.Shirai: "Robotic Wheelchair Based on the Integration of Human and Environment Observations"IEEE Robotics and Automation Magazine. (掲載予定).

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M.H.Jeong, Y.Kuno, N.Shimada, Y.Shirai: "Recognition of Shape-Changing Hand Gestures"JEICE Trans. Information and Systems. (掲載予定).

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] T. Murashima, Y. Kuno, N. Shimada, Y. Shirai: "Understanding and Learning of Gestures through Human-Machine Interaction"Journal of the Robotics Society of Japan, (in Japanese). Vol. 18, N0.4. 590-599 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y. Kuno, T. Murashima, N. Shimada, Y. Shirai: "Interactive Gesture Interface for Intelligent Wheelchairs"Proc. IEEE International Conference on Multimedia and Expo. (CD-ROM). (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y. Kuno, T. Murashima, N. Shimada, Y. Shirai: "Intelligent Wheelchair Remotely Controlled by Interactive Gestures"Proc. 15th International Conference on Pattern Recognition. Vol. 4. 672-675 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N. Shimada, K. Kimura, Y. Shirai, Y. Kuno: "Hand Posture Estimation by Combining 2-D Appearance-based and 3-D Model-based Approaches"Proc. 15th International Conference on Pattern Recognition. Vol.3. 709-712 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N. Shimada, Y. Shirai, Y. Kuno: "Model Adaptation and Posture Estimation of Moving Articulated Object Using Monocular Camera"H.H Nagel and F. J. P. Lopez (Eds.), Articulated Motion and Deformable Objects, Lecture Notes in Computer Science 1899. 159-172 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y. Murakami, Y. Kuno, N. Shimada, Y. Shirai: "Intelligent Wheelchair Moving among People Based on Their Observations"Proc. 2000 International Conference on Systems, Man and Cybernetics. 1466-1471 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] S. Chong, Y. Kuno, N. Shimada, Y. Shirai: "Human-Robot Interface Based on Speech Understanding Assisted by Vision"T. Tan, Y. Shi, and W. Gao (Eds.), Advances in Multimodal Interfaces-ICMI 2000,Lecture Notes in Computer Science 1948. 16-23 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y. Kuno, T. Murashima, N. Shimada, Y. Shirai: "Understanding and Learning of Gestures through Human-Robot Interaction"Proc. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems. 2133-2138 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] O. Nishiyama, S. Chong, Y. Kuno, N. Shimada, Y. Shirai: "Speech and Gesture Based Interface Using Context and Visual Information"Proc. 6th International Conference on Control, Automation, Robotics and Vision. (CD-ROM). (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M.H. Jeong, Y. Kuno, N. Shimada, Y. Shirai: "Complex Hand-Gesture Recognition Using Active Contour and Switching Linear Model"Proc. 7th Korea-Japan Joint Workshop on Computer Vision. 151-156 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y. Kuno, Y. Murakami, N. Shimada, Y. Shirai: "Intelligent Wheelchair Observing the Faces of Both User and Pedestrians"Preprints of IFAC Workshop on Mobile Robot Technology. 232-237 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M.H. Jeong, Y. Kuno, N. Shimada, Y. Shirai: "Recognition of Shape-Changing Gestures Based on Switching Linear Model"Proc. 11th International Conference on Image Analysis and Processing. 14-19 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y. Murakami, Y. Kuno, N. Shimada, Y. Shirai: "Collision Avoidance by Observing Pedestrians' Faces for Intelligent Wheelchairs"Proc. 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. 2018-2023 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M. Yoshizaki, Y. Kuno, A. Nakamura: "Human-Robot Interface Based on the Mutual Assistance between Speech and Vision"Proc. Workshop on Perceptive User Interfafces. (CD-ROM). (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y. Kuno, Y. Murakami, N. Shimada, Y. Shirai: "User and Social Interfaces by Observing Human Faces for Intelligent Wheelchairs"Proc. Workshop on Perceptive User Interfaces. (CD-ROM). (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M.H. Jeong, Y. Kuno, N. Shimada, Y. Shirai: "Complex Gesture Recognition using Coupled Switching Linear Model"Proc. Fifth Asian Conference on Computer Vision. 132-137 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y. Murakami, Y. Kuno, N. Shimada, Y. Shirai: "Collision Avoidance by Observing Pedestrians' Faces for Intelligent Wheelchairs"Journal of the Robotics Society of Japan, (in Japanese). (in press). (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y. Kuno, N. Shimada, Y. Shirai: "Robotic Wheelchair Based on the Integration of Human and environment Observations"IEEE Robotics and Automation Magazine. (accepted for publication).

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] M.H. Jeong, Y. Kuno, N. Shimada, Y. Shirai: "Recognition of Shape-Changing Hand Gestures"IEICE Trans. Information and Systems. (accepted for publication).

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y.Kuno, Y.Murakami, N.Shimada, Y.Shirai: "Intelligent Wheelchair Observing the Faces of Both User and Pedestrians"Preprints of IFAC Workshop on Mobile Robot Technology. 232-237 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] M.H.Jeong, Y.Kuno, N.Shimada, Y.Shirai: "Recognition of Shape-Changing Gestures Based on Switching Linear Model"Proc.11th International Conference on Image Analysis and Processing. 14-19 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] Y.Murakami, Y.Kuno, N.Shimada, Y.Shirai: "Collision Avoidance by Observing Pedestrians' Faces for Intelligent Wheelchairs"Proc.2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. (CD-ROM). (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] M.Yoshizaki, Y.Kuno, A.Nakamura: "Human-Robot Interface Based on the Mutual Assistance between Speech and Vision"Proc.Workshop on Perceptive User Interfaces. (CD-ROM). (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] Y.Kuno, Y.Murakami, N.Shimada, Y.Shirai: "User and Social Interfaces by Observing Human Faces for Intelligent Wheelchairs"Proc.Workshop on Perceptive User Interfaces. (CD-ROM). (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] M.H.Jeong, Y.Kuno, N.Shimada, Y.Shirai: "Complex Gesture Recognition using Coupled Switching Linear Model"Proc.Fifth Asian Conference on Computer Vision. 132-137 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 村上佳史, 久野義徳, 島田伸敬, 白井良明: "知的車椅子のための歩行者の観察に基づく衝突回避"日本ロボット学会誌. (採録決定).

    • Related Report
      2001 Annual Research Report
  • [Publications] Y.Kuno, N.Shimada, Y.Shirai: "Robotic Wheelchair Based on the Integration of Human and Environment Observations"IEEE Robotics and Automation Magazine. (採録決定).

    • Related Report
      2001 Annual Research Report
  • [Publications] 山根剛志,白井良明,三浦純,久野義徳,島田伸敬: "オプティカルフローと明度一様領域を統合した人間の実時間追跡"日本ロボット学会誌. 18・4. 521-528 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 村嶋照久,久野義徳,島田伸敬,白井良明: "人間と機械のインタラクションを通じたジェスチャの理解と学習"日本ロボット学会誌. 18・4. 590-599 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] Y.Kuno,T.Murashima,N.Shimada,and Y.Shirai: "Interactive Gesture Interface for Intelligent Wheelchairs"Proc.IEEE International Conference on Multimedia and Expo. (CD-ROM). (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] Y.Kuno,T.Murashima,N.Shimada,and Y.Shirai: "Intelligent Wheelchair Remotely Controlled by Interactive Gestures"Proc.15th International Conference on Pattern Recognition. 4. 672-675 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] N.Shimada,K.Kimura,Y.Shirai,and Y.Kuno: "Hand Posture Estimation by Combining 2-D Appearance-based and 3-D Model-based Approaches"Proc.15th International Conference on Pattern Recognition. 3. 709-712 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] N.Shimada,Y.Shirai,and Y.Kuno: "Model Adaptation and Posture Estimation of Moving Articulated Object Using Monocular Camera"H.H Nagel and F.J.P.Lopez (Eds.), Articulated Motion and Deformable Objects, Lecture Notes in Computer Science 1899. 159-172 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] Y.Murakami,Y.Kuno,N.Shimada,and Y.Shirai: "Intelligent Wheelchair Moving among People Based on Their Observations"Proc.2000 International Conference on Systems, Man and Cybernetics. 1466-1471 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] S.Chong,Y.Kuno,N.Shimada,and Y.Shirai: "Human-robot Interface Based on Speech Understanding Assisted by Vision"T.Tan, Y.Shi, and W.Gao (Eds.), Advances in Multimodal Interfaces-ICMI 2000, Lecture Notes in Computer Science 1948. 16-23 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] Y.Kuno,T.Murashima,N.Shimada,and Y.Shirai: "Understanding and Learning of Gestures through Human-Robot Interaction"Proc.2000 IEEE/RSJ International Conference on Intelligent Robots and Systems. 2133-2138 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] O.Nishiyama,S.Chong,Y.Kuno,N.Shimada,and Y.Shirai: "Speech and Gesture Based Interface Using Context and Visual Information"Proc.6th International Conference on Control, Automation, Robotics and Vision. (CD-ROM). (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] M.H.Jeong,Y.Kuno,N.Shimada,and Y.Shirai: "Complex Hand-Gesture Recognition Using Active Contour and Switching Linear Model"Proc.7th Korea-Japan Joint Wrokshop on Computer Vision. 151-156 (2001)

    • Related Report
      2000 Annual Research Report

URL: 

Published: 2000-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi