• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Hands-free/eyes-free interfaces based on active acoustic sensing

Research Project

Project/Area Number 18H04104
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Review Section Medium-sized Section 61:Human informatics and related fields
Research InstitutionUniversity of Tsukuba

Principal Investigator

Shizuki Buntarou  筑波大学, システム情報系, 教授 (20323280)

Co-Investigator(Kenkyū-buntansha) 高橋 伸  筑波大学, システム情報系, 准教授 (00272691)
嵯峨 智  熊本大学, 大学院先端科学研究部(工), 准教授 (10451535)
田中 二郎  早稲田大学, 理工学術院(情報生産システム研究科・センター), 教授(任期付) (20251043)
VASILACHE SIMONA  筑波大学, システム情報系, 助教 (30606934)
Project Period (FY) 2018-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥39,390,000 (Direct Cost: ¥30,300,000、Indirect Cost: ¥9,090,000)
Fiscal Year 2021: ¥9,750,000 (Direct Cost: ¥7,500,000、Indirect Cost: ¥2,250,000)
Fiscal Year 2020: ¥9,750,000 (Direct Cost: ¥7,500,000、Indirect Cost: ¥2,250,000)
Fiscal Year 2019: ¥10,010,000 (Direct Cost: ¥7,700,000、Indirect Cost: ¥2,310,000)
Fiscal Year 2018: ¥9,880,000 (Direct Cost: ¥7,600,000、Indirect Cost: ¥2,280,000)
Keywordsジェスチャ入力 / キーワード
Outline of Final Research Achievements

Our sensing method, called Active Acoustic Sensing, can recognize how an object is touched, including grasped, by vibrating the object at various frequencies and observing its response. This research shows that the sensing method can be used to recognize the states of the human body whose shape changes. This research also shows that the change in the detected states can be used as gestures for the hands-free / eyes-free interaction of information equipment.

Academic Significance and Societal Importance of the Research Achievements

「能動的な音響計測による把持状態認識」は、物体がどのように触られているのか(すなわち把持状態)を、物体を様々な周波数で振動させその響き具合を見ることによって簡単に認識できるというシンプルかつ強力な基本原理である。本研究では、これまで境界条件の変化に着目し固い物体(=形状が変化しない)における把持状態を検出対象としていた基本原理の応用範囲を、形状の変化に着目し人間などの柔らかい物(=形状が変化する)の状態検出に広げられることを明らかにした。また、身振り手振りに基づくジェスチャは、情報機器のハンズフリー/アイズフリー操作に使えるため、その新たな検出方法を示した点においても本研究成果は有用である。

Report

(5 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Annual Research Report
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • Research Products

    (36 results)

All 2022 2021 2020 2019 2018

All Journal Article (24 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 12 results,  Open Access: 4 results) Presentation (12 results) (of which Int'l Joint Research: 6 results,  Invited: 1 results)

  • [Journal Article] Gesture Recognition Method Using Acoustic Sensing on Usual Garment2022

    • Author(s)
      Takashi Amesaka, Hiroki Watanabe, Masanori Sugimoto, and Buntarou Shizuki
    • Journal Title

      Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

      Volume: 13

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] 能動的音響計測に基づくスタイラスの把持状態識別手法の検討2021

    • Author(s)
      高倉礼, 鈴木健介, 國分晴利, 志築文太郎
    • Journal Title

      第29回インタラクティブシステムとソフトウェアに関するワークショップ予稿集

      Volume: -

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] 通知としてファントムセンセーションを提示するデバイスの試作2021

    • Author(s)
      日高拓真, 志築文太郎
    • Journal Title

      第29回インタラクティブシステムとソフトウェアに関するワークショップ予稿集

      Volume: -

    • Related Report
      2021 Annual Research Report
    • Open Access
  • [Journal Article] ハンドジェスチャ学習のための電気的筋肉刺激を与えるグローブ型デバイスの試作2021

    • Author(s)
      西川宜利, 日高拓真, 志築文太郎
    • Journal Title

      第29回インタラクティブシステムとソフトウェアに関するワークショップ予稿集

      Volume: -

    • Related Report
      2021 Annual Research Report
    • Open Access
  • [Journal Article] User-based Mid-air Hand Gesture Set for Spreadsheet2021

    • Author(s)
      Yuta Takayama, Yuu Ichikawa, Buntarou Shizuki, Ikkaku Kawaguchi, and Shin Takahashi
    • Journal Title

      CHI 2021 symposia on Asian CHI Symposium: Emerging HCI Research Collection

      Volume: - Pages: 122-128

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Pilot Study on Notification Using Phantom Sensation on Hand2021

    • Author(s)
      Takuma Hidaka, Yusuke Sei, and Buntarou Shizuki
    • Journal Title

      CHI 2021 symposia on Asian CHI Symposium: Emerging HCI Research Collection

      Volume: - Pages: 157-159

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 手・指におけるファントムセンセーションを用いた通知のための事前実験設計2021

    • Author(s)
      日高拓真, 清佑輔, 志築文太郎
    • Journal Title

      インタラクション2021論文集

      Volume: - Pages: 607-611

    • Related Report
      2020 Annual Research Report
  • [Journal Article] 表計算ソフト向けのユーザ定義の空中ハンドジェスチャ2021

    • Author(s)
      高山雄太, 市川佑, 志築文太郎, 川口一画, 高橋伸
    • Journal Title

      情報処理学会研究報告

      Volume: 2021-HCI-191 Pages: 8-8

    • Related Report
      2020 Annual Research Report
  • [Journal Article] GUI操作における膝入力の応用可能性の調査2020

    • Author(s)
      市川佑, 志築文太郎, 高橋伸
    • Journal Title

      情報処理学会研究報告

      Volume: 2021-HCI-189 Pages: 7-7

    • Related Report
      2020 Annual Research Report
  • [Journal Article] スマートフォン背面の人差し指を用いた片手操作向け入力拡張手法の検討2020

    • Author(s)
      清佑輔, 舩越南斗, 志築文太郎
    • Journal Title

      第28回インタラクティブシステムとソフトウェアに関するワークショップ論文集

      Volume: - Pages: 6-6

    • Related Report
      2020 Annual Research Report
  • [Journal Article] Walking Support for Visually Impaired Using AR/MR and Virtual Braille Block2020

    • Author(s)
      Katsuya Hommaru and Jiro Tanaka
    • Journal Title

      Proceedings of 22nd International Conference on Human-Computer Interaction (HCI International 2020)

      Volume: - Pages: 336-354

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Expanding Input Vocabulary Using Index Finger on and Above Back of Smartphone2020

    • Author(s)
      Yusuke Sei, Minto Funakoshi, and Buntarou Shizuki
    • Journal Title

      CHI 2020 symposia on Asian CHI Symposium: Emerging HCI Research Collection

      Volume: - Pages: 4-4

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 物を叩いたり振ったりした際の音と手の動きを用いた物体識別及び内容量認識2020

    • Author(s)
      小口雄斗, 志築文太郎, 高橋伸
    • Journal Title

      インタラクション2020論文集

      Volume: - Pages: 951-954

    • Related Report
      2019 Annual Research Report
  • [Journal Article] スマートフォンにおける押下圧によるタップの拡張のための予備調査2019

    • Author(s)
      池田凌, 漆山裕太, 志築文太郎
    • Journal Title

      情報処理学会研究報告

      Volume: 2019-HCI-185

    • Related Report
      2019 Annual Research Report
  • [Journal Article] Vibrotactile Signal Generation with GAN2019

    • Author(s)
      Shotaro Agatsuma, Shin Takahashi, and Satoshi Saga
    • Journal Title

      Proceedings of the 26th International Display Workshops (IDW '19)

      Volume: - Pages: 20-23

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] AudioTouch: Minimally Invasive Sensing of Micro-Gestures via Active Bio-Acoustic Sensing2019

    • Author(s)
      Yuki Kubo, Yuto Koguchi, Buntarou Shizuki, Shin Takahashi, and Otmar Hilliges
    • Journal Title

      Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '19)

      Volume: -

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] 異なる手形状に対する周波数応答の予備調査2019

    • Author(s)
      漆山裕太, 高倉礼, 鈴木翔大, 志築文太郎, 高橋伸
    • Journal Title

      情報処理学会研究報告

      Volume: 2019-HCI-184

    • Related Report
      2019 Annual Research Report
  • [Journal Article] An Investigation of Figure Recognition with Electrostatic Tactile Display2019

    • Author(s)
      Hirobumi Tomita, Shotaro Agatsuma, Ruiyun Wang, Shin Takahashi, Satoshi Saga, and Hiroyuki Kajimoto
    • Journal Title

      Proceedings of 21st International Conference on Human-Computer Interaction (HCI International 2019)

      Volume: - Pages: 363-372

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 振動触覚ディスプレイのためのDCGANを用いた振動生成2019

    • Author(s)
      我妻正太郎, 黒木詢也, 嵯峨智, 高橋伸
    • Journal Title

      ロボティクス・メカトロニクス講演会2019論文集

      Volume: -

    • NAID

      130007774559

    • Related Report
      2019 Annual Research Report
  • [Journal Article] 静電気力を用いた触図ディスプレイにおける図形認識度の向上2019

    • Author(s)
      富田洋文, 嵯峨智, 梶本裕之, 高橋伸
    • Journal Title

      ロボティクス・メカトロニクス講演会2019論文集

      Volume: -

    • NAID

      130007774558

    • Related Report
      2019 Annual Research Report
  • [Journal Article] Pressure-Based One-Handed Interaction Technique for Large Smartphones Using Cursor2019

    • Author(s)
      Kyohei Hakka, Toshiyuki Ando, Buntarou Shizuki, and Shin Takahashi
    • Journal Title

      CHI 2019 symposia on Asian CHI Symposium: Emerging HCI Research Collection

      Volume: -

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Touch Sensing on the Forearm Using the Electrical Impedance Method2019

    • Author(s)
      Yutaro Suzuki, Kodai Sekimori, Buntarou Shizuki, and Shin Takahashi
    • Journal Title

      Proceedings of 2019 IEEE International Conference on Pervasive Computing and Communications Workshops

      Volume: 1

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 容器を振る際の音を用いた容量識別手法2019

    • Author(s)
      小口雄斗, 志築文太郎, 高橋伸
    • Journal Title

      情報処理学会第81回全国大会講演論文集

      Volume: 3 Pages: 363-364

    • NAID

      170000179967

    • Related Report
      2018 Annual Research Report
  • [Journal Article] Toward the Modeling of Tactile Sensation on Electrostatic Tactile Display2018

    • Author(s)
      Hirobumi Tomita, Shin Takahashi, Satoshi Saga, Simona Vasilache, and Hiroyuki Kajimoto
    • Journal Title

      Proceedings of International Display Workshops 2018

      Volume: 1

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Presentation] 物を叩いたり振ったりした際の音と手の動きを用いた物体識別及び内容量認識2020

    • Author(s)
      小口雄斗, 志築文太郎, 高橋伸
    • Organizer
      情報処理学会インタラクション2020
    • Related Report
      2019 Annual Research Report
  • [Presentation] スマートフォンにおける押下圧によるタップの拡張のための予備調査2019

    • Author(s)
      池田凌, 漆山裕太, 志築文太郎
    • Organizer
      情報処理学会第185回ヒューマンコンピュータインタラクション研究会
    • Related Report
      2019 Annual Research Report
  • [Presentation] Vibrotactile Signal Generation with GAN2019

    • Author(s)
      Shotaro Agatsuma, Shin Takahashi, and Satoshi Saga
    • Organizer
      The 26th International Display Workshops (IDW '19)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] AudioTouch: Minimally Invasive Sensing of Micro-Gestures via Active Bio-Acoustic Sensing2019

    • Author(s)
      Yuki Kubo, Yuto Koguchi, Buntarou Shizuki, Shin Takahashi, and Otmar Hilliges
    • Organizer
      The 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '19)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 異なる手形状に対する周波数応答の予備調査2019

    • Author(s)
      漆山裕太, 高倉礼, 鈴木翔大, 志築文太郎, 高橋伸
    • Organizer
      情報処理学会第184回ヒューマンコンピュータインタラクション研究会
    • Related Report
      2019 Annual Research Report
  • [Presentation] An Investigation of Figure Recognition with Electrostatic Tactile Display2019

    • Author(s)
      Hirobumi Tomita, Shotaro Agatsuma, Ruiyun Wang, Shin Takahashi, Satoshi Saga, and Hiroyuki Kajimoto
    • Organizer
      21st International Conference on Human-Computer Interaction (HCI International 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 振動触覚ディスプレイのためのDCGANを用いた振動生成2019

    • Author(s)
      我妻正太郎, 黒木詢也, 嵯峨智, 高橋伸
    • Organizer
      ロボティクス・メカトロニクス講演会2019
    • Related Report
      2019 Annual Research Report
  • [Presentation] 静電気力を用いた触図ディスプレイにおける図形認識度の向上2019

    • Author(s)
      富田洋文, 嵯峨智, 梶本裕之, 高橋伸
    • Organizer
      ロボティクス・メカトロニクス講演会2019
    • Related Report
      2019 Annual Research Report
  • [Presentation] Pressure-Based One-Handed Interaction Technique for Large Smartphones Using Cursor2019

    • Author(s)
      Kyohei Hakka, Toshiyuki Ando, Buntarou Shizuki, and Shin Takahashi
    • Organizer
      CHI 2019 symposia on Asian CHI Symposium: Emerging HCI Research Collection
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Touch Sensing on the Forearm Using the Electrical Impedance Method2019

    • Author(s)
      Yutaro Suzuki, Kodai Sekimori, Buntarou Shizuki, and Shin Takahashi
    • Organizer
      2019 IEEE International Conference on Pervasive Computing and Communications Workshops
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 容器を振る際の音を用いた容量識別手法2019

    • Author(s)
      小口雄斗, 志築文太郎, 高橋伸
    • Organizer
      情報処理学会第81回全国大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] Toward the Modeling of Tactile Sensation on Electrostatic Tactile Display2018

    • Author(s)
      Hirobumi Tomita, Shin Takahashi, Satoshi Saga, Simona Vasilache, and Hiroyuki Kajimoto
    • Organizer
      International Display Workshops 2018
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research

URL: 

Published: 2018-04-23   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi