In the resonance-loop: Musical field and its formation

• Project/Area Number: 15H03175
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Art at large
• Research Institution: Tokyo National University of Fine Arts and Music
• Principal Investigator: Furukawa Kiyoshi 東京藝術大学, 美術学部, 教授 (40323761)
• Co-Investigator(Kenkyū-buntansha): 堀 玄 亜細亜大学, 経営学部, 教授 (60322658) ; 中川 隆 名古屋市立大学, 大学院芸術工学研究科, 准教授 (60631124) ; 寺澤 洋子 筑波大学, 図書館情報メディア系, 助教 (70579094) ; 小林 祐貴 東京工業大学, 環境・社会理工学院, 助教 (70756668) ; 星 玲子 (柴玲子) 東京電機大学, 付置研究所, 助手 (90291921) ; 大村 英史 東京理科大学, 理工学部情報科学科, 助教 (90645277)
• Project Period (FY): 2015-04-01 – 2018-03-31
• Project Status: Completed (Fiscal Year 2017)
• Budget Amount: ¥15,210,000 (Direct Cost: ¥11,700,000、Indirect Cost: ¥3,510,000); Fiscal Year 2017: ¥5,850,000 (Direct Cost: ¥4,500,000、Indirect Cost: ¥1,350,000); Fiscal Year 2016: ¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000); Fiscal Year 2015: ¥5,980,000 (Direct Cost: ¥4,600,000、Indirect Cost: ¥1,380,000)
• Keywords: 実験音楽 / 音楽認知 / 人工知能 / 作曲 / 脳科学 / ソニフィケーション / アルゴリズム作曲 / コンピュータ音楽 / 認知科学 / マルチモーダル / ビジュアリゼーション / 音楽認知科学 / 視聴覚表現 / BCI / 視覚化 / インスタレーション / 芸術表現 / メディアアート / マルチモダール / BMI

Outline of Final Research Achievements

3 to 5 participants have subjected themselves to electroencephalogram (EEG): a noninvasive test that records electrical patterns of the brain. The extracted data was later on transformed into artistic expressions ― sound and visual images. The participants were again invited to be analyzed after being exposed to such expressions. It became evident that brainwaves and expressions do affect one another. An installation in which this experiment result can be recognized was created in a form of a feedback loop. In the next phase, the team hopes to publicly analyze more than 10 participants’ EEG, using an easily wearable EEG measurement tool.

Research Products

• [Journal Article] Development of a System to Generate Artificial Ambiance based on Entropy (2018)
  • Author(s): Ohmura Hidefumi、Shibayama Takuro、Yuasa Masahide、Hamano Takayuki、Nakagawa Ryu
  • Journal Title: Proceedings of the 10th International Conference on Agents and Artificial Intelligence (ICAART 2018) Volume: 2 Pages: 333-338
  • DOI: 10.5220/0006730103330338
  • Peer Reviewed / Open Access
• [Journal Article] “Investigation of a Computational Unit Model for Mode and Rhythm Based on Deviations and Realizations from Musical Expectations,” (2017)
  • Author(s): H. Ohmura, K. Hirata, S. Tojo, and T. Shibayama
  • Journal Title: Proceeding of 13th International Symposium on Computer Music Multidisciplinary Research (CMMR2017) Volume: 1 Pages: 439-449
  • Peer Reviewed
• [Journal Article] VRとニューロフィードバックによるマインドフルネス実践システムの検討 (2017)
  • Author(s): 長谷川阿華把，小松原崚，中川隆
  • Journal Title: 情報処理学会インタラクション2017論文集 Volume: 1 Pages: 333-336
• [Journal Article] 生体信号の「動き」を音にする (招待講演） (2017)
  • Author(s): 寺澤洋子
  • Journal Title: 日本音響学会 2017年 秋季研究発表会 スペシャルセッション「うごく！音のデザイン」 Volume: 1 Pages: 1475-1476
• [Journal Article] 音楽の終止構造と身体性の関わり (2016)
  • Author(s): 星-柴玲子，古川聖，根本幾
  • Journal Title: 日本認知科学会第29回大会抄録集 Volume: 1
  • Peer Reviewed
• [Journal Article] AEVE: an Audiovisual Experience using VRHMD and EEG（作品解説映像） (2016)
  • Author(s): 中川隆, 松本直也, 平田昌太朗
  • Journal Title: 芸術科学会誌「DiVA41号」 Volume: 1
  • Peer Reviewed
• [Journal Article] Signal Interpolation Method for EEG Devices with Shared ADC Advances (2016)
  • Author(s): Gen Hori
  • Journal Title: Cognitive Neurodynamics (V),Springer Volume: 5 Pages: 421427-421427
  • Peer Reviewed
• [Presentation] "Lp-Viterbi Algorithm for Automatic Fingering Decision," (2017)
  • Author(s): Gen Hori et al.
  • Organizer: Proc. 14th Sound and Music Computing Conference (SMC2017)
• [Presentation] "Variant of Viterbi algorithm based on p-norm," (2017)
  • Author(s): Gen Hori et al.
  • Organizer: Proc. 22nd International Conference on Digital Signal Processing (DSP2017)
• [Presentation] “Generative Music System Based on Expectation for Musical Structure,” (2017)
  • Author(s): H. Ohmura
  • Organizer: International Symposium for Advanced Computing and Information Technology (ISACI2017)
• [Presentation] ``音による雰囲気と色による雰囲気の関係についての検討,'' (2017)
  • Author(s): 大村英史, 湯浅将英, 中川隆
  • Organizer: 電子情報通信学会 人工知能と知識処理研究会 「コミュニケーションと雰囲気」
• [Presentation] ``音楽における期待感の逸脱・実現の計算論的定式化の試み, '' (2017)
  • Author(s): 大村英史, 平田圭二, 東条敏, 柴山拓郎
  • Organizer: 第31回人工知能学会全国大会, 2C4-OS-20b-1, 名古屋
• [Presentation] AEVE: An Audiovisual Experience Using VRHMD and EEG (2017)
  • Author(s): Ryu Nakagawa，Shotaro Hirata
  • Organizer: NIME 2017 Papers and Posters Proceedings，497-498，2017年
• [Presentation] Generative Music System with Quantitative Controllers Based on Expectation for Pitch and Rhythm Structure (2016)
  • Author(s): H. Ohmura, T. Shibayama, and T. Hamano
  • Organizer: International Conference on Knowledge and Systems Engineering (KSE2016)
  • Place of Presentation: Hanoi, Vietnam
  • Year and Date: 2016-10-06
• [Presentation] 空間楽器: 全身没入型ワイヤレスVR環境におけるインタラクティブ・オーディオビジュアル・システムの試作 (2016)
  • Author(s): 中川、松本直也、古川聖
  • Organizer: 情報処理学会インタラクション
  • Place of Presentation: 東京
  • Year and Date: 2016-03-02
• [Presentation] Musical Chord Progression and Alpha Band Desynchronization of EEG (2016)
  • Author(s): Gen Hori, Takayuki Hamano Hidefumi Ohmura, Ryu Nakagawa, Kiyoshi Furukawa and Kazuo Okanoya,
  • Organizer: CogMIR2016
  • Place of Presentation: Columbia University, New York City, USA
  • Int'l Joint Research
• [Presentation] 複合現実によるマルチプレイ・オーディオビジュアル表現システム”MusicaR (2016)
  • Author(s): 小松原崚, 中川隆
  • Organizer: インターカレッジ・ソニックアーツ・フェスティバル
  • Place of Presentation: 名古屋, 市立大学
• [Presentation] AEVE: an Audiovisual Experience using VRHMD and EEG (2016)
  • Author(s): 中川隆, 平田昌太朗
  • Organizer: 名古屋電子音響音楽コンサート「プチット・フォルム」
  • Place of Presentation: 北千種キャンパス 総合情報センター
  • Invited
• [Presentation] 定量的雰囲気の可能性 (2016)
  • Author(s): 大村英史, 柴山拓郎, 片上大輔, 湯浅将英
  • Organizer: HCGシンポジウム2016
  • Place of Presentation: 高知市
• [Presentation] 音高と音価の情報量操作による音楽と言語の構造 (2016)
  • Author(s): 大村英史, 柴山拓郎
  • Organizer: 第30回人工知能学会全国大会 3G3-OS-15a-1
  • Place of Presentation: 北九州国際会議場
• [Presentation] "Danza Española" (コンサート） (2015)
  • Author(s): T. Shibayama, T. Hamano, and H. Ohmura
  • Organizer: 16th International Society for Music Inrormation Retrieval Conference
  • Place of Presentation: Málaga, Spain
  • Year and Date: 2015-10-26
• [Presentation] "it's almost a song...": Interactive EEG audiovisual installation (2015)
  • Author(s): Kiyoshi Furukawa, Takayuki Hamano, Hiriko Terasawa,Nakagawa,Shiba
  • Organizer: Music & the Brain Symposium
  • Place of Presentation: 山梨学院大学
  • Year and Date: 2015-10-03
  • Int'l Joint Research / Invited
• [Presentation] "it's almost a song...": Interactive EEG audiovisual installation (2015)
  • Author(s): Kiyoshi Furukawa, Takayuki Hamano, Hiriko Terasawa,Nakagawa,Shiba
  • Organizer: International Workshop on Time Series Data Sonification in conjunction with Tsukuba Global Science Week
  • Place of Presentation: 筑波大学
  • Year and Date: 2015-09-29
  • Int'l Joint Research / Invited
• [Presentation] The brain activities of the expectation of cadence -A preliminary study (2015)
  • Author(s): Shiba R, Furukawa K, Nemoto I
  • Organizer: The 38th Annual Meeting of the Japan Neuroscience Society
  • Place of Presentation: Kobe
  • Year and Date: 2015-07-28
• [Presentation] “Guiding auditory attention toward the subtle components in electrocardiography sonification” (2015)
  • Author(s): Hiroko Terasawa, Yota Morimoto, Masaki Matsubara, Akira Sato, Makoto Ohara, Masatoshi Kawarasaki
  • Organizer: Proceedings of International Conference on Auditory Display
  • Place of Presentation: Graz, Austria
  • Year and Date: 2015-07-06
• [Presentation] "it's almost a song...": Interactive EEG audiovisual installation (2015)
  • Author(s): Kiyoshi Furukawa, Takayuki Hamano, Hiriko Terasawa,Nakagawa,Shiba
  • Organizer: Roppongi Art Night 2015
  • Place of Presentation: 東京、六本木ヒルズ
  • Year and Date: 2015-04-25
  • Invited