• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on Estimation, Utilization, and Control of Preferences for Music Content through the Combination of Informatics and Neuroscience

Research Project

Project/Area Number 21H04917
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Review Section Medium-sized Section 62:Applied informatics and related fields
Research InstitutionNational Institute of Advanced Industrial Science and Technology

Principal Investigator

Goto Masataka  国立研究開発法人産業技術総合研究所, 情報・人間工学領域, 首席研究員 (20357007)

Co-Investigator(Kenkyū-buntansha) 古屋 晋一  一般社団法人NeuroPiano(研究開発部), 研究開発部, シニアリサーチャー (20509690)
濱崎 雅弘  国立研究開発法人産業技術総合研究所, 情報・人間工学領域, 研究グループ付 (50419016)
中野 倫靖  国立研究開発法人産業技術総合研究所, 情報・人間工学領域, 研究グループ長 (10572927)
加藤 淳  国立研究開発法人産業技術総合研究所, 情報・人間工学領域, 主任研究員 (70738054)
佃 洸摂  国立研究開発法人産業技術総合研究所, 情報・人間工学領域, 主任研究員 (40760020)
渡邉 研斗  国立研究開発法人産業技術総合研究所, 情報・人間工学領域, 研究員 (50828324)
Project Period (FY) 2021-04-05 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥42,250,000 (Direct Cost: ¥32,500,000、Indirect Cost: ¥9,750,000)
Fiscal Year 2023: ¥13,520,000 (Direct Cost: ¥10,400,000、Indirect Cost: ¥3,120,000)
Fiscal Year 2022: ¥13,520,000 (Direct Cost: ¥10,400,000、Indirect Cost: ¥3,120,000)
Fiscal Year 2021: ¥15,210,000 (Direct Cost: ¥11,700,000、Indirect Cost: ¥3,510,000)
Keywords音楽情報処理 / 嗜好推定 / 音楽推薦 / 鑑賞支援インタフェース / 鑑賞支援 / 創作支援 / 音楽解析
Outline of Research at the Start

本研究では、音楽コンテンツ(楽曲や音楽動画)に対する個人の嗜好(好き嫌い)を推定し、それを鑑賞支援・創作支援に活用する方法を明らかにすることに加え、個人の嗜好を改変・防御するような制御ができる可能性があることを示す。そのために、情報学に基づくアプローチで音楽聴取履歴に加えて音楽解析結果も活用して嗜好を推定し、さらに、神経科学に基づくアプローチで生理計測指標から嗜好を推定する新たな手法を実現する。

Outline of Final Research Achievements

In this research project, we pursued the following three tasks to deepen our understanding of how to achieve technologies for estimating, utilizing, and controlling preferences for music content. In the "Estimation of Preferences" task, we estimated preferences by analyzing large-scale data on which groups of songs users indicated they liked. In addition, using brain function measurements and physiological measurements related to music preferences, we constructed a model to estimate preferences from physiological indicators. In the "Utilization of Preferences" task, we developed a music recommendation method based on estimated preferences and similarities between songs, as well as personalized adaptive interfaces for music appreciation. In the "Control of Preferences" task, we developed a music appreciation support interface that visualizes the relationship between users' preferences and a large number of songs.

Academic Significance and Societal Importance of the Research Achievements

音楽コンテンツに対する嗜好を推定して音楽推薦等で活用する技術は膨大なデジタルコンテンツの普及とともに重要性を増しており、人々が好みのコンテンツに出会え、多様なコンテンツがそれを好む人々に届くことは、コンテンツ文化を豊かにする意義がある。本研究のように情報学と神経生理学の研究者が議論をしながら、嗜好の推定・活用・制御の三つの課題に取り組む学術研究は先駆的である。情報学に基づく音楽推薦や神経科学に基づく脳機能計測・生理計測によって音楽の嗜好を推定した上で、音楽サービスで活用可能にすることは今後一層重要になるが、さらにユーザ自身がその推定結果を可視化等を通じて把握可能にすることも重要になっていく。

Report

(5 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Annual Research Report
  • 2021 Comments on the Screening Results   Annual Research Report
  • Research Products

    (19 results)

All 2024 2023 2022

All Journal Article (2 results) (of which Peer Reviewed: 2 results,  Open Access: 2 results) Presentation (17 results) (of which Int'l Joint Research: 11 results,  Invited: 3 results)

  • [Journal Article] MDX-Mixer: Music Demixing by Leveraging Source Signals Separated by Existing Demixing Models2024

    • Author(s)
      Tomoyasu Nakano, Masataka Goto
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E107.D Issue: 8 Pages: 1079-1088

    • DOI

      10.1587/transinf.2023EDP7044

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2024-08-01
    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Self-Supervised Contrastive Learning for Singing Voices2022

    • Author(s)
      Hiromu Yakura, Kento Watanabe, Masataka Goto
    • Journal Title

      IEEE/ACM Transactions on Audio, Speech, and Language Processing

      Volume: 30 Pages: 1614-1623

    • DOI

      10.1109/taslp.2022.3169627

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] 複数人による音楽アノテーション結果の項目反応理論に基づく統合と機械学習への応用2024

    • Author(s)
      中野 倫靖, 後藤 真孝
    • Organizer
      情報処理学会 音楽情報科学研究会
    • Related Report
      2023 Annual Research Report
  • [Presentation] ダイナフォーミックス:音楽を創造する喜びを創出する研究・開発・教育2023

    • Author(s)
      古屋 晋一
    • Organizer
      音学シンポジウム2023 (情報処理学会 音楽情報科学研究会)
    • Related Report
      2023 Annual Research Report
    • Invited
  • [Presentation] Overcoming the Ceiling Effect in Musicians2023

    • Author(s)
      Shinichi Furuya
    • Organizer
      ICMPC 2023 Symposium "Adaptive and maladaptive learning in musicians"
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Decoding Drums, Instrumentals, Vocals, and Mixed Sources in Music Using Human Brain Activity2023

    • Author(s)
      Vincent Cheung, Lana Okuma, Kazuhisa Shibata, Kosetsu Tsukuda, Masataka Goto, Shinichi Furuya
    • Organizer
      Proceedings of the 24th International Society for Music Information Retrieval Conference (ISMIR 2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Transformer-based Beat Tracking with Low-resolution Encoder and High-resolution Decoder2023

    • Author(s)
      Tian Cheng, Masataka Goto
    • Organizer
      Proceedings of the 24th International Society for Music Information Retrieval Conference (ISMIR 2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Unveiling the Impact of Musical Factors in Judging a Song on First Listen: Insights from a User Survey2023

    • Author(s)
      Kosetsu Tsukuda, Tomoyasu Nakano, Masahiro Hamasaki, Masataka Goto
    • Organizer
      Proceedings of the 24th International Society for Music Information Retrieval Conference (ISMIR 2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Chorus-Playlist: Exploring the Impact of Listening to Only Choruses in a Playlist2023

    • Author(s)
      Kosetsu Tsukuda, Masahiro Hamasaki, Masataka Goto
    • Organizer
      Proceedings of the 24th International Society for Music Information Retrieval Conference (ISMIR 2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Music Source Separation with MLP Mixing of Time, Frequency, and Channel2023

    • Author(s)
      Tomoyasu Nakano, Masataka Goto
    • Organizer
      Proceedings of the 24th International Society for Music Information Retrieval Conference (ISMIR 2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Music Exploration Interface Based on Vocal Timbre and Pitch in Popular Music2023

    • Author(s)
      Tomoyasu Nakano, Momoka Sasaki, Mayuko Kishi, Masahiro Hamasaki, Masataka Goto, and Yoshinori Hijikata
    • Organizer
      Proceedings of the 16th International Symposium on Computer Music Multidisciplinary Research (CMMR 2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] U-Beat: A Multi-Scale Beat Tracking Model Based on Wave-U-Net2023

    • Author(s)
      Tian Cheng, Masataka Goto
    • Organizer
      IEEE ICASSP 2023 (The 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Self-Supervised Contrastive Learning for Singing Voices2023

    • Author(s)
      Hiromu Yakura, Kento Watanabe, Masataka Goto
    • Organizer
      IEEE ICASSP 2023 (The 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 歌声のための自己教師あり対照学習による特徴量表現の獲得手法2022

    • Author(s)
      矢倉 大夢, 渡邉 研斗, 後藤 真孝
    • Organizer
      情報処理学会 音楽情報科学研究会
    • Related Report
      2022 Annual Research Report
  • [Presentation] MDX-Mixer: 複数の音楽音源分離モデルによる出力波形を時変混合するシステム2022

    • Author(s)
      中野 倫靖, 後藤 真孝
    • Organizer
      情報処理学会 音楽情報科学研究会
    • Related Report
      2022 Annual Research Report
  • [Presentation] 基調講演「メディアコンテンツの大規模蓄積・解析が生み出す価値」2022

    • Author(s)
      後藤 真孝
    • Organizer
      データサイエンティスト協会 9thシンポジウム
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] Rapidly Predicting Music Artistic Expression Preference From Heart Rate and Respiration Rate2022

    • Author(s)
      Shu Sakamoto, Vincent Cheung, Shinichi Furuya
    • Organizer
      ISMIR 2022 (The 23rd International Society for Music Information Retrieval Conference) Late-Breaking/Demo Session
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] What can music preference teach us about the auditory mismatch negativity?2022

    • Author(s)
      Vincent Cheung, Shinichi Furuya
    • Organizer
      MMN 2022 (The 9th Mismatch Negativity Conference)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 音楽家の卓越した技能を支える感覚運動統合機能2022

    • Author(s)
      古屋 晋一
    • Organizer
      日本音響学会 第148回(2022年秋季)研究発表会
    • Related Report
      2022 Annual Research Report
    • Invited

URL: 

Published: 2021-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi