• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

An Immersive Programming Support System with Perceptual Interfaces that utilize Humans' Body

Research Project

Project/Area Number 14380090
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Educational technology
Research InstitutionNational Institute of Multimedia Education

Principal Investigator

OSAWA Noritaka  National Institute of Multimedia Education, Research and Development, Professor, 研究開発部, 教授 (30251721)

Co-Investigator(Kenkyū-buntansha) NISHINA Emi  National Institute of Multimedia Education, Research and Development, Associate Professor, 研究開発部, 助教授 (20260010)
TAKAHASHI Hideaki  National Institute of Multimedia Education, Research and Development, Associate Professor, 研究開発部, 助教授 (30251002)
ASAI Kikuo  National Institute of Multimedia Education, Research and Development, Associate Professor, 研究開発部, 助教授 (90290874)
SUZUKI Motofumi  National Institute of Multimedia Education, Research and Development, Associate Professor, 研究開発部, 助教授 (90332147)
Project Period (FY) 2002 – 2004
Project Status Completed (Fiscal Year 2004)
Budget Amount *help
¥9,700,000 (Direct Cost: ¥9,700,000)
Fiscal Year 2004: ¥4,500,000 (Direct Cost: ¥4,500,000)
Fiscal Year 2003: ¥3,600,000 (Direct Cost: ¥3,600,000)
Fiscal Year 2002: ¥1,600,000 (Direct Cost: ¥1,600,000)
Keywordsvirtual reality / programming / perceptual user interface / perceptual feedback / physicality / immersion / direct manipulation by hand / stereoscopic view / 知覚的ユーザインタフェース / 3次元ウィジェット / グリフ / ジグソーパズル的
Research Abstract

We have investigated and developed an immersive programming learning support system that effectively uses a stereoscopic view of 3D visualization, direct manipulation by hand, and perceptual feedback.
We have created a 3D jigsaw-puzzle-like glyph representation for visualizing grammatical rules or constraints of programming in an immersive 3D virtual environment. It represents constraints by matching convex and concave shapes. We also conducted experiments using types of representations: textual representation typically used in programming, a sequence representation of numbers and symbols, 2D glyphs, and 3D glyphs. The experiments showed that the proposed jigsaw-puzzle-like representation is effective and that 3D glyph representation is easy for novice users to learn. This result was also supported by subjective evaluation using questionnaires.
Moreover, we studied interaction techniques using hands and devices to improve the usability of manipulating virtual objects in immersive virtual environments. We proposed and investigated manipulation using virtual gearbox widgets combined with direct manipulation by hand, and using direct manipulation by hand with automatic adjustments without widgets. Experimental evaluation showed that the proposed techniques are superior to conventional interaction techniques in immersive virtual environments.
Furthermore, we studied aromatic feedback for non-intrusive and ambient information display, and developed a multipoint transmission system using IPv6 multicasting for stereoscopic video in immersive environments, which facilitates efficient, cooperative work among remote virtual environments.
This study enabled us to create our effective programming learning support system for novice users in immersive virtual environments.

Report

(4 results)
  • 2004 Annual Research Report   Final Research Report Summary
  • 2003 Annual Research Report
  • 2002 Annual Research Report
  • Research Products

    (39 results)

All 2005 2004 2003 2002 Other

All Journal Article (27 results) Publications (12 results)

  • [Journal Article] Aromatic feedback for ambient and implicit interfaces2005

    • Author(s)
      Noritaka Osawa, Hideaki Kobayashi, Kikuo Asai
    • Journal Title

      11th International Conference on Human-Computer Interaction (to appear)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Aromatic feedback for ambient and implicit interfaces2005

    • Author(s)
      Noritaka Osawa, Hideaki Kobayashi, Kikuo Asai
    • Journal Title

      11th International Conference on Human-Computer Interaction

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Virtual 3D Gearbox Widget Technique for Precise Adjustment by Hand Motion in Immersive VR2004

    • Author(s)
      Noritaka Osawa, Xiangshi Ren
    • Journal Title

      電子情報通信学会IEICE Trans.on Information and Systems Vol.E87-D, No.10

      Pages: 2408-2414

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 3D video conference toolkit adaptable to various presentation environments2004

    • Author(s)
      Noritaka Osawa, Tomoki Yamagishi, Kikuo Asai, Yoshiro Miida
    • Journal Title

      The 8th IASTED International Conference on Internet & Multimedia Systems & Applications

      Pages: 379-384

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A Three-dimensional Authoring/Presentation System for Immersive Virtual Environments : Poster3D2004

    • Author(s)
      Noritaka Osawa, Kim Sangtae
    • Journal Title

      8th International Conference on Information Visualisation (IV2004)

      Pages: 785-785

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Virtual 3D Gearbox Widget Technique for Precise Adjustment by Hand Motion in Immersive VR2004

    • Author(s)
      Noritaka Osawa, Xiangshi Ren
    • Journal Title

      IEICE Trans.on Information and Systems Vol.E87-D, No.10

      Pages: 2408-2414

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 3D video conference toolkit adaptable to various presentation environments2004

    • Author(s)
      Noritaka Osawa, Tomoki Yamagishi, Kikuo Asai, Yoshiro Miida
    • Journal Title

      The 3rd IASTED International Conference on Communications, Internet, and Information Technology, (CIIT 2004)

      Pages: 213-219

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A Three-dimensional Authoring/Presentation System for Immersive Virtual Environments : Poster 3D2004

    • Author(s)
      Noritaka Osawa, Kim Sangtae
    • Journal Title

      8th International Conference on Information Visualisation (IV2004)

      Pages: 785-791

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Virtual 3D Gearbox Widget Technique for Precise Adjustment by H and Motion in Immersive VR2004

    • Author(s)
      Noritaka Osawa, Xiangshi Ren
    • Journal Title

      電子情報通信学会 IEICE Trans.on Information and Systems Vol.E87-D, No.10

      Pages: 2408-2414

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 3D video conference toolkit adaptable to various presentation environments2004

    • Author(s)
      Noritaka Osawa, Tomoki Yamagishi, Kikuo Asai, Yoshiro Miid
    • Journal Title

      The 8th IASTED International Conference on Internet & Multimedia Systems & Applications

      Pages: 379-384

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Investigating Text Entry Strategies for an Immersive Virtual Environment2003

    • Author(s)
      Noritaka Osawa, Xiangshi Ren, Motofumi T.Suzuki
    • Journal Title

      Information : An International Journal of International Information Institute Vol.6,No.5

      Pages: 577-582

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] An Evaluation on Approximate and Fine Adjustments by Hand Motion in an Immersive Environment2003

    • Author(s)
      Noritaka Osawa, Xiangshi Ren
    • Journal Title

      9th International Conference on Virtual Systems and MultiMedia 2003

      Pages: 322-329

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] 簡易型3次元ブレゼンテーションシステム2003

    • Author(s)
      大澤範高, 金 尚泰
    • Journal Title

      日本バーチャルリアリティ学会第8回大会

      Pages: 433-434

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] An Immersive Path Editor for Keyframe Animation using Hand Direct Manipulation and 3D Gearbox Widgets2003

    • Author(s)
      Noritaka Osawa, Kikuo Asai
    • Journal Title

      7th International Conference on Information Visualisation(IV2003)

      Pages: 524-531

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] An Evaluation of Text Entry Methods in a Standing Posture for Application to an Immersive Virtual Environment2003

    • Author(s)
      Noritaka Osawa, Xiangshi Ren, Motofumi T.Suzuki
    • Journal Title

      Human-Computer Interaction : Theory and Practice (HCII 2003) Volume 2

      Pages: 208-212

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Gearbox Widget for Fine Adjustments by Hand Motion2003

    • Author(s)
      Noritaka Osawa, Xiangshi Ren
    • Journal Title

      IPT/EGVE 2003 Workshop

      Pages: 313-314

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Investigating Text Entry Strategies for an Immersive Virtual Environment2003

    • Author(s)
      Noritaka Osawa, Xiangshi Ren, Motofumi T. Suzuki
    • Journal Title

      Information : An International Journal of International Information Institute Vol.6, No.5

      Pages: 577-582

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] An Evaluation on Approximate and Fine Adjustments by Hand Motion in an Immersive Environment2003

    • Author(s)
      Noritaka Osawa, Xiangshi Ren
    • Journal Title

      9th International Conference on Virtual Systems and MultiMedia

      Pages: 322-329

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] An Immersive Path Editor for Keyframe Animation using Hand Direct Manipulation and 3D Gearbox Widgets2003

    • Author(s)
      Noritaka Osawa, Kikuo Asai
    • Journal Title

      7th International Conference on Information Visualisation (IV2003)

      Pages: 524-531

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] A Simple Three-dimensional Presentation System (in Japanese)2003

    • Author(s)
      Noritaka Osawa, Kim.Sangtae
    • Journal Title

      8th Annual Conference of the virtual reality society of Japan

      Pages: 433-434

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] マルチモーダルインタフェースを利用した没入型プログラミングシステム:おうぎ2002

    • Author(s)
      大澤範高, 浅井紀久夫, 鈴木一史, 杉本裕二, 斎藤史彦
    • Journal Title

      日本バーチャルリアリティ学会第7回大会

      Pages: 545-434

    • NAID

      10013961541

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] An Interactive Toolkit Library for 3D Applications : it3d2002

    • Author(s)
      Noritaka Osawa, Kikuo Asai, Fumihiko Saito
    • Journal Title

      Eighth Eurographics Workshop on Virtual Environments

      Pages: 149-157

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Sound Glyphs Representing Inheritance Relationships2002

    • Author(s)
      Noritaka Osawa
    • Journal Title

      6th International Conference on Information Visualisation

      Pages: 10-15

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Jigsaw-puzzle-like 3D Diagrams to Represent Syntactical Constraints2002

    • Author(s)
      Noritaka Osawa
    • Journal Title

      6th International Conference on Information Visualisation

      Pages: 421-426

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] Multimodal Text Input in an Immersive Environment2002

    • Author(s)
      Noritaka Osawa, Yuji Y.Sugimoto
    • Journal Title

      The 12th International Conference on Artificial Reality and Telexistence

      Pages: 85-92

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] An Immersive Programming System : Ougi2002

    • Author(s)
      Noritaka Osawa, Kikuo Asai, Motofumi Suzuki, Yuji Y.Sugimoto, Fumihiko Saito
    • Journal Title

      The 12th International Conference on Artificial Reality and Telexistence

      Pages: 36-43

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Journal Article] An Immersive Programming System using Multimodal Interfaces : Ougi2002

    • Author(s)
      Noritaka Osawa, Kikuo Asai, Motofumi Suzuki, Yuji Y.Sugimoto, Fumihiko Saito
    • Journal Title

      7th Annual Conference of the virtual reality society of Japan

      Pages: 545-546

    • NAID

      10013961541

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2004 Final Research Report Summary
  • [Publications] Noritaka Osawa, Xiangshi Ren, Motofumi T.Suzuki: "Investigating Text Entry Strategies for an Immersive Virtual Environment"Information : An International Journal of International Information Institute. Vol.6,No.5. 577-582 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Noritaka Osawa, Xiangshi Ren: "An Evaluation on Approximate and Fine Adjustments by Hand Motion in an Immersive environment"9th International Conference on Virtual Systems and MultiMedia 2003. 322-329 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Noritaka Osawa, Kikuo Asai: "An Immersive Path Editor for Keyframe Animation using Hand direct Manipulation and 3D Gearbox Widgets"7th International Conference on Information Visualisation(IV2003). 524-531 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Noritaka Osawa, Xiangshi Ren, Motofumi T.Suzuki: "An Evaluation of Text Entry Methods in a Standing Posture for Application to an Immersive Virtual Environment"Human-Computer Interaction : Theory and Practice (HCII 2003). Volume 2. 208-212 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 大澤範高, 金 尚泰: "簡易型3次元プレゼンテーションシステム"日本バーチャルリアリティ学会第8回大会. 433-434 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Hiroshi Nakano, Kenichi Tokunaga, Noritaka Osawa, Hidenori Akiyama: "Full-scale and Real-time Virtual Experiments in Dynamics by using an Immersive Projection Display and Hand Manipulation"4th International Conference on Information Technology Based Higher Education and Training (ITHET03). (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] Noritaka Osawa, Kikuo Asai, Fumihiko Saito: "An Interactive Toolkit Library for 3D Applications : it3d"Eighth Eurographics Workshop on Virtual Environments. 149-157 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] Noritaka Osawa: "Sound Glyphs Representing Inheritance Relationships"6th International Conference on Information Visualisation. 10-15 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] Noritaka Osawa: "Jigsaw-puzzle-like 3D Diagrams to Represent Syntactical Constraints"6th International Conference on Information Visualisation. 421-426 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] Noritaka Osawa, Yuji Y.Sugimoto: "Multimodal Text Input in an Immersive Environment"The 12th International Conference on Artificial Reality and Telexistence. 85-92 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] Noritaka Osawa, Kikuo Asai, Motofumi Suzuki, Yuji Y.Sugimoto: "An Immersive Programming System : Ougi"The 12th International Conference on Artificial Reality and Telexistence. 36-43 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] Noritaka Osawa, Xiangshi Ren, Motofumi T.Suzuki: "An Evaluation of Text Entry Methods in a Standing Posture for Application to an Immersive Virtual Environment"10th International Conference on Human-Computer Interaction. (To appear). (2003)

    • Related Report
      2002 Annual Research Report

URL: 

Published: 2002-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi