• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of Mutual Adaptation Model of Communication based on Mutual Prediction and Its Verification Using Music

Research Project

Project/Area Number 16K16180
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Entertainment and game informatics 1
Research InstitutionNihon University

Principal Investigator

KITAHARA Tetsuro  日本大学, 文理学部, 准教授 (00454710)

Project Period (FY) 2016-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥3,900,000 (Direct Cost: ¥3,000,000、Indirect Cost: ¥900,000)
Fiscal Year 2018: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2017: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2016: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
Keywords音楽情報処理 / 自動作曲 / 演奏支援 / 音楽予測 / 自動作編曲 / 音楽生成 / 音楽 / 相互予測 / 相互適応 / 統計モデル / 予測モデル / 旋律予測 / 情報工学
Outline of Final Research Achievements

The main achievements are as follows:
1. We developed the JamSketch system, which automatically generate melodies according to melodic outlines which are drawn by the user. It has been confirmed that melodies generated by the system have quality close to those composed by non-expert human players.
2. We developed a method for generating jazz bass lines from a jazz database using a hidden Markov model. By learning emission probability distributions separately for each beat positions, we achieved to generate high quality bass lines.

Academic Significance and Societal Importance of the Research Achievements

音楽演奏という観点からコミュニケーションのモデル化を行った。それに加え、近年、機械学習によって芸術コンテンツの生成をすることで創造性のアルゴリズム的側面を探求する試みが増えてきている。本研究は、機械学習により自動で演奏を生成する方法に関して新たな手法を提案しており、当該分野に一定の貢献をもたらしたと考える。

Report

(4 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Research-status Report
  • 2016 Research-status Report
  • Research Products

    (47 results)

All 2019 2018 2017 2016 Other

All Int'l Joint Research (1 results) Journal Article (12 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 7 results,  Open Access: 4 results) Presentation (32 results) (of which Int'l Joint Research: 10 results) Remarks (2 results)

  • [Int'l Joint Research] ポンペウ・ファブラ大学(スペイン)

    • Related Report
      2017 Research-status Report
  • [Journal Article] Picognizer: 電子音の認識のための JavaScript ライブラリの開発と評価2019

    • Author(s)
      栗原 一貴, 植村 あい子, 板谷 あかり, 北原 鉄朗, 長尾 確
    • Journal Title

      情報処理学会論文誌

      Volume: Vol.60, No.2

    • NAID

      170000150111

    • Related Report
      2018 Annual Research Report
  • [Journal Article] "Two Approaches to Supporting Improvisational Ensemble for Music Beginners based on Body Motion Tracking"2019

    • Author(s)
      Shugo Ichinose, Souta Mizuno, Shun Shiramatsu, and Tetsuro Kitahara
    • Journal Title

      International Journal of Smart Computing and Artificial Intelligence

      Volume: Vol.3, No.1,

    • Related Report
      2018 Annual Research Report
  • [Journal Article] "JamSketch: Improvisation Support System with GA-Based Melody Creation from User’s Drawing"2018

    • Author(s)
      Tetsuro Kitahara, Sergio Giraldo, and Rafael Ramirez
    • Journal Title

      Music Technology with Swing, Springer

      Volume: - Pages: 509-521

    • Related Report
      2018 Annual Research Report
  • [Journal Article] "Four-Part Harmonization: Comparison of a Bayesian Network and a Recurrent Neural Network"2018

    • Author(s)
      Tatsuro Yamada, Tetsuro Kitahara, Hiroaki Arie, and Tetsuya Ogata
    • Journal Title

      Music Technology with Swing, Springer

      Volume: -

    • Related Report
      2018 Annual Research Report
  • [Journal Article] "JamGesture: An Improvisation Support System Based on Physical Gesture Observed with Smartphone"2018

    • Author(s)
      Souta Mizuno, Tetsuro Kitahara, Shun Shiramatsu, and Shugo Ichinose
    • Journal Title

      The 24th ACM Symposium on Virtual Reality Software and Technology (VRST 2018)

      Volume: -

    • Related Report
      2018 Annual Research Report
  • [Journal Article] An improvisation System for Disabilities based on Melody Creation with Gaze Control2018

    • Author(s)
      Tetsuro Kitahara, Yasuyuki Saito, Sergio Giraldo, Rafael Ramirez
    • Journal Title

      Computer Simulation of Musical Creativity (CMSC2018)

      Volume: Late-Breaking Abstract, No.3

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Support System for Excercising Guitar Chord Performance2018

    • Author(s)
      Mai Udagawa, Aiko Uemura, Tetsuro Kitahara
    • Journal Title

      Computer Simulation of Musical Creativity (CMSC2018)

      Volume: Late-Breaking Abstract, No.1

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Preliminary Study on Morphing of Chord Progression2018

    • Author(s)
      Aiko Uemura, Tetsuro Kitahara
    • Journal Title

      Proceeding of the 3rd conference on Computer Simulation of Musical Creativity (CSMC2018)

      Volume: Paper Session 3, No.2

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] HamoKara: A System for Practice of Backing Vocals for Karaoke2018

    • Author(s)
      Mina Shiraishi, Kozue Ogasawara, Tetsuro Kitahara
    • Journal Title

      Proceeding of the15th comference on Sound and Music Computing (SMC)

      Volume: - Pages: 543-550

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] カラオケを盛り上げるためのタンバリン演奏支援システム2017

    • Author(s)
      栗原拓也、木下尚洋、山口竜之介、横溝有希子、竹腰美夏、馬場哲晃、北原鉄朗
    • Journal Title

      情報処理学会論文誌

      Volume: 58 Pages: 1073-1092

    • NAID

      170000164919

    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Journal Article] "Picognizer: A JavaScript Library for Detecting and Recognizing Synthesized Sounds"2017

    • Author(s)
      Kazutaka Kurihara, Akari Itaya, Aiko Uemura, Tetsuro Kitahara, Katashi Nagao
    • Journal Title

      Advances in Computer Entertainmento Technology,Proceedings of ACE 2017, LNCS 10714

      Volume: - Pages: 339-359

    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Journal Article] "Music Generation Using Bayesian Networks"2017

    • Author(s)
      Tetsuro Kitahara
    • Journal Title

      Machine Learning and Knowledge Discovery in Databases, Proceedings of ECML PKDD 2017, Part III (Nectar Track), LNAI 10536

      Volume: - Pages: 368-372

    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Presentation] ジャズのベースラインの自動生成2019

    • Author(s)
      志賀 あゆみ, 北原 鉄朗
    • Organizer
      日本音響学会 2019年春季研究発表会
    • Related Report
      2018 Annual Research Report
  • [Presentation] コードモーフィングに基づくリハーモナイゼーションの一検討2019

    • Author(s)
      植村 あい子, 北原 鉄朗
    • Organizer
      日本音響学会 2019年春季研究発表会
    • Related Report
      2018 Annual Research Report
  • [Presentation] 歌詞と音楽が与える印象の分析2019

    • Author(s)
      河村 翔太, 植村 あい子, 北原 鉄朗
    • Organizer
      日本音響学会 2019年春季研究発表会
    • Related Report
      2018 Annual Research Report
  • [Presentation] 旋律概形と筆圧感知を用いた作曲支援システム2019

    • Author(s)
      安原 茜, 藤井 潤子, 北原 鉄朗
    • Organizer
      情報処理学会 インタラクション2019(インタラクティブ発表)
    • Related Report
      2018 Annual Research Report
  • [Presentation] メロディ生成における生成単位に関する一調査2018

    • Author(s)
      北原 鉄朗
    • Organizer
      情報処理学会 第121回音楽情報科学 研究会
    • Related Report
      2018 Annual Research Report
  • [Presentation] HMDを用いたヴァーチャルなドラム演奏環境の試作:合奏相手を表すヴァーチャルキャラクターの導入2018

    • Author(s)
      石山 俊之, 北原 鉄朗
    • Organizer
      エンタテインメントコンピューティングシンポジウム2018
    • Related Report
      2018 Annual Research Report
  • [Presentation] コード進行に関するモーフィングの初期検討2018

    • Author(s)
      植村 あい子, 北原 鉄朗
    • Organizer
      情報処理学会 音楽情報科学研究会(音学シンポジウム)
    • Related Report
      2018 Annual Research Report
  • [Presentation] “ギター初心者のための演奏練習支援システムの提案”2018

    • Author(s)
      宇田川真唯, 植村あい子, 北原鉄朗
    • Organizer
      情報処理学会 第80回全国大会
    • Related Report
      2017 Research-status Report
  • [Presentation] "カラオケのためのハモリパート練習システム~ハモリパートの自動生成および練習支援システムの試作~2018

    • Author(s)
      白石美南, 小笠原梢, 北原鉄朗
    • Organizer
      情報処理学会 第80回全国大会
    • Related Report
      2017 Research-status Report
  • [Presentation] "カラオケのためのハモリパート練習支援システム~試作システムを用いた被験者実験の報告~"2018

    • Author(s)
      小笠原梢, 北原鉄朗, 白石美南
    • Organizer
      情報処理学会 第80回全国大会
    • Related Report
      2017 Research-status Report
  • [Presentation] "HMD を用いたヴァーチャルなドラム演奏環境の試作"2018

    • Author(s)
      蓮井星良, 石山俊之, 北原鉄朗
    • Organizer
      情報処理学会 第80回全国大会
    • Related Report
      2017 Research-status Report
  • [Presentation] "合いの手「PPPH」が入る楽曲の特徴に関する一分析"2018

    • Author(s)
      甚野健太, 大野涼平, 北原鉄朗
    • Organizer
      情報処理学会 第80回全国大会
    • Related Report
      2017 Research-status Report
  • [Presentation] 言語情報を持たない音を用いたヒューマン・エージェント・インタラクションシステムの開発"2018

    • Author(s)
      棚橋徹, 小林一樹, 北原鉄朗
    • Organizer
      情報処理学会 第80回全国大会
    • Related Report
      2017 Research-status Report
  • [Presentation] LSTM を用いた四声体和声の生成2017

    • Author(s)
      山田 竜郎, 北原 鉄朗, 有江 浩明
    • Organizer
      人工知能学会 2017 年全国大会
    • Place of Presentation
      ウインクあいち(愛知県名古屋市)
    • Year and Date
      2017-05-23
    • Related Report
      2016 Research-status Report
  • [Presentation] パターン認識を用いた特定のベーシストの特徴の分析2017

    • Author(s)
      松浦 佳輝, 棚橋 徹, 北原鉄朗
    • Organizer
      情報処理学会 第 79 回全国大会
    • Place of Presentation
      名古屋大学(愛知県名古屋市)
    • Year and Date
      2017-03-16
    • Related Report
      2016 Research-status Report
  • [Presentation] 曲線描画に基づく即興演奏支援システム2017

    • Author(s)
      北原鉄朗, Sergio Giraldo, Rafael Ramirez
    • Organizer
      情報処理学会 インタラクション 2017
    • Place of Presentation
      明治大学(東京都中野区)
    • Year and Date
      2017-03-02
    • Related Report
      2016 Research-status Report
  • [Presentation] "Picognizer: A JavaScript Library for Detecting and Recognizing Synthesized Sounds"2017

    • Author(s)
      Kazutaka Kurihara, Akari Itaya, Aiko Uemura, Tetsuro Kitahara, Katashi Nagao
    • Organizer
      International Conference on Advances in Computer Entertainment Technology (ACE 2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] "Support System of Improvisational Ensemble Based on User’s Motion Using Smartphone Sensors"2017

    • Author(s)
      Souta Mizuno, Shugo Ichinose, Shun Siramatsu, Tetsuro Kitahara
    • Organizer
      Proceedings of 12th International Conference on Knowledge, Information and Creativity Support System (KICSS 2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] "A Pattern Recognition Approach to Analyze Temporal Evolution of a Bassist’s Musical Styles"2017

    • Author(s)
      Yoshiki Matsuura, Tetsu Tanahashi, Tetsuro Kitahara
    • Organizer
      Proceedings of the 2nd Conference on Computer Simulation of Musical Creativity
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] "JamSketch: Improvisation Support System with GA-based Melody Creation from User’s Drawing"2017

    • Author(s)
      Tetsuro Kitahara, Sergio Giraldo, Rafael Ramirez
    • Organizer
      Proceedings of the 13th International Symposium on Computer Music Multidisciplinary Research
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] "Four-part Harmonization: Comparison of a Bayesian Network and a Recurrent Neural Network"2017

    • Author(s)
      Tatsuro Yamada, Tetsuro Kitahara, Hiroaki Arie, Tetsuya Ogata
    • Organizer
      Proceedings of the 13th International Symposium on Computer Music Multidisciplinary Research
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] "Improvisation Ensemble Support Systems for Music Beginners Based on Body Motion Tracking"2017

    • Author(s)
      Shugo Ichinose, Souta Mizuno, Shun Shiramatsu, Tetsuro Kitahara
    • Organizer
      Proceedings of the 6th IIAI International Congress on Advanced Applied Informatics (IIAI AAI 2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] "JamSketch: A Drawing-based Real-time Evolutionary Improvisation Support System"2017

    • Author(s)
      Tetsuro Kitahara, Sergio Giraldo, and Rafael Ramirez
    • Organizer
      Proceedings of the 2017 International Conference on New Interfaces for Musial Expression (NIME 2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] "LSTMを用いた四声体和声の生成"2017

    • Author(s)
      山田 竜郎, 北原 鉄朗, 有江 浩明, 尾形 哲也
    • Organizer
      人工知能学会第31回全国大会(JSAI 2017)
    • Related Report
      2017 Research-status Report
  • [Presentation] "演奏未経験者のためのスマートフォンセンサーを用いた即興合奏支援システムの試作"2017

    • Author(s)
      水野 創太, 一ノ瀬 修吾, 白松 俊, 北原 鉄朗
    • Organizer
      人工知能学会第31回全国大会(JSAI 2017)
    • Related Report
      2017 Research-status Report
  • [Presentation] "パネルディスカッション:人工知能は作曲家/演奏家になれるか?"2017

    • Author(s)
      平田 圭二, 伊藤 貴之, 北原 鉄朗, 深山 覚, 今井 慎太郎, 持橋 大地
    • Organizer
      人工知能学会第31回全国大会(JSAI 2017)
    • Related Report
      2017 Research-status Report
  • [Presentation] "HMDを用いたヴァーチャルなドラム演奏環境の試作"2017

    • Author(s)
      石山 俊之, 蓮井 星良, 北原 鉄朗
    • Organizer
      エンタテインメントコンピューティング2017
    • Related Report
      2017 Research-status Report
  • [Presentation] "電子音の認識のためのJavaScriptライブラリの開発"2017

    • Author(s)
      栗原 一貴, 板谷 あかり, 植村 あい子, 北原 鉄朗
    • Organizer
      エンタテインメントコンピューティング2017(プレミアムペーパー)
    • Related Report
      2017 Research-status Report
  • [Presentation] Towards Intuitive Music Creation Tools for Musically Untrained People2016

    • Author(s)
      Tetsuro Kitahara
    • Organizer
      Digital Music Research Network One-day Workshop 2016 (DMRN+11)
    • Place of Presentation
      London (UK)
    • Year and Date
      2016-12-20
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Machine Learning Approach toSupport Music Creation by Musically Untrained People2016

    • Author(s)
      Tetsuro Kitahara and Yuichi Tsuchiya
    • Organizer
      Proceedings of the Constructive Machine Learning Workshop 2016
    • Place of Presentation
      Barcelona (Spain)
    • Year and Date
      2016-12-10
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Extracting Melodic Contour Using Wavelet-based Multi-resolution Analysis2016

    • Author(s)
      Tetsuro Kitahara and Masaki Matsubara
    • Organizer
      Proceedings of the 9th International Workshop on Music and Machine Learning (MML 2016)
    • Place of Presentation
      Riva del Garda (Italy)
    • Year and Date
      2016-09-23
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] 音符表現によらない旋律の木構造表現の検討(第2報)2016

    • Author(s)
      北原 鉄朗
    • Organizer
      人工知能学会第30回全国大会(JSAI2016)
    • Place of Presentation
      北九州国際会議場(福岡県北九州市)
    • Year and Date
      2016-06-06
    • Related Report
      2016 Research-status Report
  • [Remarks] 日本大学 文理学部情報 システム解析学科 音メディア情報処理研究室(北原研究室)

    • URL

      http://www.kthrlab.jp/

    • Related Report
      2018 Annual Research Report
  • [Remarks] 日本大学文理学部情報科学科北原研究室

    • URL

      http://www.kthrlab.jp/

    • Related Report
      2017 Research-status Report

URL: 

Published: 2016-04-21   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi