• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of sound drawing methods using mixed reality

Research Project

Project/Area Number 18K00210
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 01070:Theory of art practice-related
Research InstitutionNagoya City University

Principal Investigator

Nakagawa Ryu  名古屋市立大学, 大学院芸術工学研究科, 准教授 (60631124)

Co-Investigator(Kenkyū-buntansha) 古川 聖  東京藝術大学, 美術学部, 教授 (40323761)
大村 英史  東京理科大学, 理工学部情報科学科, 講師 (90645277)
Project Period (FY) 2018-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000)
Fiscal Year 2020: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2019: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2018: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Keywordsmixed reality / 複合現実 / XR / cross reality / メディアアート / オーディオビジュアル / multi-participant / 複数人参加型 / extended reality / インタラクティブアート / 体験型作品 / 複数人参加型作品 / spatial user interaction / 芸術表現 / Audiovisual art / Mixed Reality
Outline of Final Research Achievements

Many artists and composers have explored sound drawing expressions (e.g. “Visual music” by artist of Abstract Film in the 1920s, “UPIC” developed by Iannis Xenakis in the 1970s, etc.). We challenged the development of “spatial sound drawing methods” that three-dimensionally expands such sound drawing expressions to real space with mixed reality (MR), and created and published the installation art works with that methods. Through these works, we clarified the characteristics of the spatial sound drawing methods.

Academic Significance and Societal Importance of the Research Achievements

近年,MRを活用した新たな情報環境が生まれつつあるが,未だデモンストレーションの範疇を超えるものは少なく,社会的に実装されるにはいくつもの課題を乗り越える必要がある。本研究ではそういった課題のうち,「MR表現の可能性」「MR体験者間コミュニケーション」「MR体験者と非体験者(MR共有空間の外部の者)との関係性」に焦点を当て,メディアアートの制作を通して検討を行なった。本研究での実作例が,今後の情報社会における人と情報環境との豊かでクリエイティブな関係創出の一助となることを期待する。

Report

(4 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (17 results)

All 2021 2020 2019 2018 Other

All Journal Article (7 results) (of which Peer Reviewed: 3 results) Presentation (8 results) (of which Int'l Joint Research: 5 results) Book (1 results) Remarks (1 results)

  • [Journal Article] 名古屋市立大学芸術工学研究科中川研究室バーチャルゼミ室 ~ ソーシャルVRを用いたオープンラボ、ウェブサイト、あるいはコミュニケーションの場の新しい形として ~t2021

    • Author(s)
      薗部 健 , 伊藤 夏希 , 片岡 愛富 , 中川 隆
    • Journal Title

      映像情報メディア学会技術報告

      Volume: 45 Pages: 61-64

    • Related Report
      2020 Annual Research Report
  • [Journal Article] Sound Architecture2021

    • Author(s)
      大城 佑樹 , 中川 隆
    • Journal Title

      映像情報メディア学会技術報告

      Volume: 45 Pages: 49-52

    • NAID

      40022536877

    • Related Report
      2020 Annual Research Report
  • [Journal Article] Encounters 2.0: A Multiparticipant Audiovisual Art Experience with XR2020

    • Author(s)
      Nakagawa Ryu、Sonobe Ken
    • Journal Title

      ACM SIGGRAPH 2020 Immersive Pavilion

      Volume: Article No.: 17 Pages: 1-2

    • DOI

      10.1145/3388536.3407882

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Things and Lighting ver.2 ~モバイルVRを用いた光をテーマにしたインスタレーション・アート2020

    • Author(s)
      神谷明里、中川 隆
    • Journal Title

      映像情報メディア学会技術報告

      Volume: 44 Pages: 225-228

    • Related Report
      2019 Research-status Report
  • [Journal Article] Drawing sound in MR space2019

    • Author(s)
      Nakagawa Ryu、Komatsubara Ryo、Ota Taku、Sonobe Ken、Mitsumori Takahisa、Hata Katsutoshi、Ohmura Hidefumi
    • Journal Title

      Proceedings of SIGGRAPH’19 Virtual, Augmented, and Mixed Reality

      Volume: 18 Pages: 1-1

    • DOI

      10.1145/3306449.3328811

    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] Encounters: A Multiparticipant Audiovisual Art Experience with XR2019

    • Author(s)
      Nakagawa Ryu、Sonobe Ken
    • Journal Title

      Proceedings of SA '19 SIGGRAPH Asia 2019 XR

      Volume: - Pages: 6-8

    • DOI

      10.1145/3355355.3361886

    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] VRによる90年代渋谷系の再現手法2019

    • Author(s)
      望月 聡司、中川 隆
    • Journal Title

      エンタテインメントコンピューティングシンポジウム2019論文集

      Volume: - Pages: 390-392

    • NAID

      170000180401

    • Related Report
      2019 Research-status Report
  • [Presentation] Encounters 2.0: A Multiparticipant Audiovisual Art Experience with XR2020

    • Author(s)
      Nakagawa Ryu、Sonobe Ken
    • Organizer
      ACM SIGGRAPH 2020 Immersive Pavilion
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Things and Lighting ver.2 ~モバイルVRを用いた光をテーマにしたインスタレーション・アート2020

    • Author(s)
      神谷明里、中川 隆
    • Organizer
      映像表現・芸術科学フォーラム 2020
    • Related Report
      2019 Research-status Report
  • [Presentation] Encounters: A Multiparticipant Audiovisual Art Experience with XR2019

    • Author(s)
      Nakagawa Ryu、Sonobe Ken
    • Organizer
      SIGGRAPH Asia 2019
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] VRによる90年代渋谷系の再現手法2019

    • Author(s)
      望月 聡司、中川 隆
    • Organizer
      エンタテインメントコンピューティングシンポジウム2019
    • Related Report
      2019 Research-status Report
  • [Presentation] Drawing Sound in MR Space2019

    • Author(s)
      Ryu Nakagawa, Ryo Komatsubara, Taku Ota, Ken Sonobe, Takahisa Mitsumori, Katsutoshi Hata, Hidefumi Ohmura
    • Organizer
      SIGGRAPH 2019
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Drawing Sound in MR Space: A Multi-User Audiovisual Experience in Mixed Reality Space2018

    • Author(s)
      Ryu Nakagawa, Ryo Komatsubara, Taku Ota, Takahisa Mitsumori
    • Organizer
      Laval Virtual 2018
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Air Maestros: A Multi-User Audiovisual Experience Using MR2018

    • Author(s)
      Ryu Nakagawa, Ryo Komatsubara, Taku Ota, Hidefumi Ohmura
    • Organizer
      ACM Spatial User Interaction 2018
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Multimodal ConnectoR : A Multiplayer Audiovisual System using Mixed-Reality2018

    • Author(s)
      小松原 崚, 中川 隆
    • Organizer
      NICOGRAPH 2018
    • Related Report
      2018 Research-status Report
  • [Book] 人と世界との間をつなぐインタラクションデザイン2020

    • Author(s)
      大坪, 牧人, 「芸術工学への挑戦」編集委員会
    • Total Pages
      195
    • Publisher
      岐阜新聞社
    • ISBN
      9784877972936
    • Related Report
      2020 Annual Research Report
  • [Remarks] Drawing Sound in MR Space (DSMR) project

    • URL

      https://nakagawalab.com/?page_id=566

    • Related Report
      2020 Annual Research Report

URL: 

Published: 2018-04-23   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi