A study on a novel interaction technique using onomatopoeia

• Project/Area Number: 21700132
• Research Category: Grant-in-Aid for Young Scientists (B)
• Allocation Type: Single-year Grants
• Research Field: Media informatics/Database
• Research Institution: Ochanomizu University
• Principal Investigator: KAMBARA Keisuke お茶の水女子大学, お茶大アカデミック・プロダクション, 特任リサーチフェロー (90532705)
• Project Period (FY): 2009 – 2010
• Project Status: Completed (Fiscal Year 2010)
• Budget Amount: ¥2,600,000 (Direct Cost: ¥2,000,000、Indirect Cost: ¥600,000); Fiscal Year 2010: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000); Fiscal Year 2009: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
• Keywords: バイオマス / 再生可能エネルギー / ナノ材料 / オノマトペ / マルチモーダルインタラクション / 音声認識 / ペイントシステム / ユーザインタフェース / 感性情報 / 感性情報学

Research Abstract

I propose an interactive technique using onomatopoeia. Onomatopoeia are imitative words such as "Zig-zag" and "Tick-tock". Some Asian languages, especially Japanese and Korean, have many onomatopoeia words, which are frequently used in ordinary conversation, as well as in the written language. Almost all onomatopoeic words represent the texture of materials, the state of things and emotions. I consider that onomatopoeia helps users transmit emotions and sensuous information to computers more effectively than ordinary input devices. In this study, I propose a multimodal interaction technique using pointing and onomatopoeic voice. I applied the proposed technique to a painting system and a video game, and developed prototypes of these systems. Then I evaluated the effectiveness by user testing. Finally I published papers and presented the results at international and domestic conferences.

Research Products

• [Journal Article] オノマトペン (2010)
  • Author(s): 神原啓介, 塚田浩二
  • Journal Title: 日本ソフトウェア科学会論文誌(コンピュータソフトウェア) Volume: Vol.27、No.1 Pages: 48-55
  • NAID: 10025982746
  • Peer Reviewed
• [Journal Article] オノマトペン (2010)
  • Author(s): 神原啓介, 塚田浩二
  • Journal Title: 日本ソフトウェア科学会論文誌(コンピュータソフトウェア) 27 Pages: 53-56
  • NAID: 10025982746
  • Peer Reviewed
• [Presentation] オノマトペを用いたマルチモーダルインタラクション (2011)
  • Author(s): 神原啓介
  • Organizer: 第25回人工知能学会全国大会
  • Place of Presentation: 岩手県盛岡市アイーナいわて県民情報交流センター
  • Year and Date: 2011-06-01
• [Presentation] オノマトペを用いたマルチモーダルインタラクション (2011)
  • Author(s): 神原啓介, 塚田浩二
  • Organizer: 2011 年度(第25 回)人工知能学会全国大会(JSAI2011)論文集
  • Place of Presentation: アイーナ いわて県民情報交流センター(岩手県盛岡市)
• [Presentation] Onomatopen : Painting Using Onomatopoeia (2010)
  • Author(s): 神原啓介
  • Organizer: 9th International Conference on Entertainment Computing (ICEC 2010)
  • Place of Presentation: 韓国ソウルCOEX
  • Year and Date: 2010-09-09
• [Presentation] Onomatopen: Painting Using Onomatopoeia (2010)
  • Author(s): Keisuke Kambara, Koji Tsukada
  • Organizer: Proceedings of 9th International Conference on Entertainment Computing (ICEC 2010)
  • Place of Presentation: COEX(韓国ソウル市)
• [Presentation] オノマトペン (2008)
  • Author(s): 神原啓介, 塚田浩二
  • Organizer: 日本ソフトウェア科学会 WISS2008 登壇発表
  • Place of Presentation: 神戸ポートピアホテル(兵庫県神戸市)
• [Remarks] 上記システムとそのソースコード、デモ動画などを公開
  • URL: http://sappari.org/onomatopen.html
• [Remarks]
  • URL: http://sappari.org/onomatopen.html
• [Remarks]
  • URL: http://sappari.org/onomatopen.html