• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Statistical Music Modelling and Automation Techniques for Expressive Performance and Accompaniment Generation Capturing Performers' Musicality

Research Project

Project/Area Number 15K16054
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Intelligent informatics
Research InstitutionKyoto University

Principal Investigator

Nakamura Eita  京都大学, 情報学研究科, 特別研究員(PD) (10707574)

Research Collaborator YOSHII Kazuyoshi  京都大学, 大学院情報学研究科, 講師 (20510001)
KANEKO Hitomi  桐朋学園大学, 音楽学部, 教授 (00408949)
WATANABE Kenji  東京芸術大学, 音楽学部, 教授
SAITO Yasuyuki  木更津工業高等専門学校, 情報工学科, 准教授 (40331996)
KATAYOSE Haruhiro  関西学院大学, 理工学部, 教授 (70294303)
HASHIDA Mitsuyo  相愛大学, 音楽学部, 講師 (20421282)
Project Period (FY) 2015-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥3,900,000 (Direct Cost: ¥3,000,000、Indirect Cost: ¥900,000)
Fiscal Year 2016: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Fiscal Year 2015: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Keywords音楽情報処理 / 自動伴奏 / 自動作曲 / 音楽アラインメント / 演奏モデル / 統計音楽モデル / 音楽言語モデル / 音楽スタイル / 統計的音楽モデル / 統計的演奏モデル / 自動採譜
Outline of Final Research Achievements

Statistical music performance models have been constructed to capture various skill levels and characteristics of performance expressions and applied to information processing techniques. Performance elements such as tempo variation, onset and offset time fluctuation, and performance errors have been incorporated in the constructed performance models, and they have been successfully applied to multiple techniques including automatic music accompaniment, music alignment, and music transcription. In addition, performance data with accessible references to the score information, which are necessary in the research fields of expressive performance generation, music transcription, and music alignment, have been collected and set up as database, which were made available for future studies. Achievements include four journal papers, 15 refereed international conference papers, and 38 other conference presentations.

Report

(3 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Research-status Report
  • Research Products

    (38 results)

All 2017 2016 2015 Other

All Int'l Joint Research (1 results) Journal Article (3 results) (of which Peer Reviewed: 3 results,  Open Access: 3 results,  Acknowledgement Compliant: 3 results) Presentation (32 results) (of which Int'l Joint Research: 13 results) Remarks (2 results)

  • [Int'l Joint Research] Queen Mary University of London(United Kingdom)

    • Related Report
      2016 Annual Research Report
  • [Journal Article] Audio-Visual Beat Tracking Based on a State-Space Model for a Robot Dancer Performing with a Human Dancer2017

    • Author(s)
      Misato Ohkita, Yoshiaki Bando, Eita Nakamura, Katsutoshi Itoyama, Kazuyoshi Yoshii
    • Journal Title

      Journal of Robotics and Mechatronics

      Volume: 29 Issue: 1 Pages: 125-136

    • DOI

      10.20965/jrm.2017.p0125

    • NAID

      130007519807

    • ISSN
      0915-3942, 1883-8049
    • Year and Date
      2017-02-20
    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Rhythm Transcription of Polyphonic Music Based on Merged-Output HMM for Multiple Voices2017

    • Author(s)
      Eita Nakamura, Kazuyoshi Yoshii, Shigeki Sagayama
    • Journal Title

      IEEE/ACM Transactions on Audio, Speech, and Language Processing

      Volume: Vol. 25, No. 4 Issue: 4 Pages: 794-806

    • DOI

      10.1109/taslp.2017.2662479

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Real-Time Audio-to-Score Alignment of Music Performances Containing Errors and Arbitrary Repeats and Skips2016

    • Author(s)
      Tomohiko Nakamura, Eita Nakamura, Shigeki Sagayama
    • Journal Title

      IEEE/ACM Transactions on Audio, Speech and Language Processing

      Volume: 24(2) Issue: 2 Pages: 329-339

    • DOI

      10.1109/taslp.2015.2507862

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Presentation] Bayesian Multichannel Nonnegative Matrix Factorization for Audio Source Separation and Localization2017

    • Author(s)
      Kousuke Itakura, Yoshiaki Bando, Eita Nakamura, Katsutoshi Itoyama, Kazuyoshi Yoshii, Tatsuya Kawahara
    • Organizer
      42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
    • Place of Presentation
      Louisiana (US)
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 視線解析を併用した頷き動作による自動譜めくりシステム2017

    • Author(s)
      地曳はるか, 齋藤康之, 中村栄太, 嵯峨山茂樹
    • Organizer
      映像情報メディア学会 メディア工学研究会
    • Place of Presentation
      関東学院大 (神奈川県横浜市)
    • Related Report
      2016 Annual Research Report
  • [Presentation] 楽譜簡略化と自動補完伴奏によるピアノ演奏練習支援システム2017

    • Author(s)
      福田翼, 中村栄太, 糸山克寿, 吉井和佳
    • Organizer
      第114回情報処理学会音楽情報科学研究会
    • Place of Presentation
      ヤマハ本社 (静岡県浜松市)
    • Related Report
      2016 Annual Research Report
  • [Presentation] 市販音楽CDを用いたユーザ歌唱に伴奏音が自動追従するスマートカラオケシステム2017

    • Author(s)
      和田雄介, 中村栄太, 糸山克寿, 吉井和佳
    • Organizer
      第79回情報処理学会全国大会
    • Place of Presentation
      名古屋大学 (愛知県名古屋市)
    • Related Report
      2016 Annual Research Report
  • [Presentation] ベイズ文脈自由文法に基づく和音系列の教師なし構文解析と自動生成2017

    • Author(s)
      津島啓晃, 吉井和佳, 糸山克寿, 中村栄太
    • Organizer
      第79回情報処理学会全国大会
    • Place of Presentation
      第79回情報処理学会全国大会
    • Related Report
      2016 Annual Research Report
  • [Presentation] スケールと音高の過渡的変化を考慮したHSMMに基づく歌声F0軌跡に対する音符推定2017

    • Author(s)
      錦見亮, 中村栄太, 糸山克寿, 吉井和佳
    • Organizer
      第79回情報処理学会全国大会
    • Place of Presentation
      第79回情報処理学会全国大会
    • Related Report
      2016 Annual Research Report
  • [Presentation] Tree-Structured Probabilistic Model of Monophonic Written Music Based on the Generative Theory of Tonal Music2016

    • Author(s)
      Eita Nakamura, Masatoshi Hamanaka, Keiji Hirata, Kazuyoshi Yoshii
    • Organizer
      41st IEEE International Conference on Acoustics, Speech and Signal Processing
    • Place of Presentation
      上海(中国)
    • Year and Date
      2016-03-20
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Conversion from Standard MIDI Files to Vertical Line Notation Scores and Automatic Decision of Piano Fingering for Beginners2016

    • Author(s)
      Yasuyuki Saito, Eita Nakamura, Riku Sato, Suguru Agata, Yuu Igarashi, Shigeki Sagayama
    • Organizer
      2nd International Conference on Technologies for Music Notation and Representation (TENOR)
    • Place of Presentation
      London (UK)
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Musical Note Estimation for F0 Trajectories of Singing Voices Based on a Bayesian Semi-Beat-Synchronous HMM2016

    • Author(s)
      Ryo Nishikimi, Eita Nakamura, Katsutoshi Itoyama, Kazuyoshi Yoshii
    • Organizer
      17th International Society for Music Information Retrieval Conference (ISMIR)
    • Place of Presentation
      NY (US)
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Hierarchical Bayesian Model of Chords, Pitches, and Spectrograms for Multipitch Analysis2016

    • Author(s)
      Yuta Ojima, Eita Nakamura, Katsutoshi Itoyama, Kazuyoshi Yoshii
    • Organizer
      17th International Society for Music Information Retrieval Conference (ISMIR)
    • Place of Presentation
      NY (US)
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Unified Bayesian Model of Time-Frequency Clustering and Low-Rank Approximation for Multi-Channel Source Separation2016

    • Author(s)
      Kousuke Itakura, Yoshiaki Bando, Eita Nakamura, Katsutoshi Itoyama, Kazuyoshi Yoshii
    • Organizer
      24th European Signal Processing Conference (EUSIPCO)
    • Place of Presentation
      Budapest (Hungary)
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Rhythm Transcription of MIDI Performances Based on Hierarchical Bayesian Modelling of Repetition and Modification of Musical Note Patterns2016

    • Author(s)
      Eita Nakamura, Katsutoshi Itoyama, Kazuyoshi Yoshii
    • Organizer
      24th European Signal Processing Conference (EUSIPCO)
    • Place of Presentation
      Budapest (Hungary)
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Rhythm Transcription of Polyphonic MIDI Performances Based on a Merged-Output HMM for Multiple Voices2016

    • Author(s)
      Eita Nakamura, Kazuyoshi Yoshii, Shigeki Sagayama
    • Organizer
      13th Sound and Music Computing Conference (SMC)
    • Place of Presentation
      Hamburg (Germany)
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] GTTM に基づくメロディ音符列の確率的木構造モデル2016

    • Author(s)
      中村栄太, 浜中雅俊, 平田圭二, 吉井和佳
    • Organizer
      第30回人工知能学会全国大会
    • Place of Presentation
      北九州国際会議場 (福岡県北九州市)
    • Related Report
      2016 Annual Research Report
  • [Presentation] 音型の反復と変形に基づく階層ベイズ音楽言語モデルとMIDI演奏のリズム採譜への応用2016

    • Author(s)
      中村栄太, 糸山克寿, 吉井和佳
    • Organizer
      第112回情報処理学会音楽情報科学研究会
    • Place of Presentation
      東京理科大学 (千葉県野田市)
    • Related Report
      2016 Annual Research Report
  • [Presentation] NMF vs PLCA: 多重音生成過程に対する無限因子モデルと無限混合モデル2016

    • Author(s)
      吉井和佳, 中村栄太, 糸山克寿, 後藤真孝
    • Organizer
      第112回情報処理学会音楽情報科学研究会
    • Place of Presentation
      東京理科大学 (千葉県野田市)
    • Related Report
      2016 Annual Research Report
  • [Presentation] 演奏者の楽譜の休止区間における自動伴奏のテンポ制御2016

    • Author(s)
      長野亜美, 齋藤康之, 中村栄太, 嵯峨山茂樹
    • Organizer
      第112回情報処理学会音楽情報科学研究会
    • Place of Presentation
      東京理科大学 (千葉県野田市)
    • Related Report
      2016 Annual Research Report
  • [Presentation] タテ線譜と初心者向けピアノ運指のSMF からの自動生成2016

    • Author(s)
      佐藤陸, 中村栄太, 齋藤康之, 阿方俊, 五十嵐優, 嵯峨山茂樹
    • Organizer
      第112回情報処理学会音楽情報科学研究会
    • Place of Presentation
      東京理科大学 (千葉県野田市)
    • Related Report
      2016 Annual Research Report
  • [Presentation] 頷き動作による自動譜めくりシステムでの合図とリズムノリの判別2016

    • Author(s)
      地曳はるか, 齋藤康之, 中村栄太, 嵯峨山茂樹
    • Organizer
      第112回情報処理学会音楽情報科学研究会
    • Place of Presentation
      東京理科大学 (千葉県野田市)
    • Related Report
      2016 Annual Research Report
  • [Presentation] 歌声F0軌跡に対する音符推定のためのベイジアン準ビート同期HMM2016

    • Author(s)
      錦見亮, 中村栄太, 糸山克寿, 吉井和佳
    • Organizer
      第112回情報処理学会音楽情報科学研究会
    • Place of Presentation
      東京理科大学 (千葉県野田市)
    • Related Report
      2016 Annual Research Report
  • [Presentation] 調・コード・音高・スペクトログラムの階層ベイズモデルに基づく多重音解析2016

    • Author(s)
      尾島優太, 中村栄太, 糸山克寿, 吉井和佳
    • Organizer
      第112回情報処理学会音楽情報科学研究報告
    • Place of Presentation
      東京理科大学 (千葉県野田市)
    • Related Report
      2016 Annual Research Report
  • [Presentation] マルチチャネル音源分離のためのネスト型基底・音源混合モデルに基づく時間周波数クラスタリング2016

    • Author(s)
      板倉光佑, 坂東宜昭, 中村栄太, 糸山克寿, 吉井和佳, 河原達也
    • Organizer
      音声研究会
    • Place of Presentation
      京都大学 (京都府京都市)
    • Related Report
      2016 Annual Research Report
  • [Presentation] マルチチャネル音源分離のための低ランク音源モデルとスパース重畳過程に基づくネスト型ベイズ混合・因子モデル2016

    • Author(s)
      板倉光佑, 坂東宜昭, 中村栄太, 糸山克寿, 吉井和佳, 河原達也
    • Organizer
      第19回情報論的学習理論ワークショップ (IBIS2016)
    • Place of Presentation
      京都大学 (京都府京都市)
    • Related Report
      2016 Annual Research Report
  • [Presentation] 歌声F0軌跡に対する自動採譜のための準ビート同期セグメンタルHMM2016

    • Author(s)
      錦見亮, 中村栄太, 糸山克寿, 吉井和佳
    • Organizer
      第19回情報論的学習理論ワークショップ (IBIS2016)
    • Place of Presentation
      京都大学 (京都府京都市)
    • Related Report
      2016 Annual Research Report
  • [Presentation] 音楽音響信号に対する多重音高推定と和音構造学習のための階層ベイズ音響・言語統合モデル2016

    • Author(s)
      尾島優太, 中村栄太, 糸山克寿, 吉井和佳
    • Organizer
      第19回情報論的学習理論ワークショップ (IBIS2016)
    • Place of Presentation
      第19回情報論的学習理論ワークショップ (IBIS2016)
    • Related Report
      2016 Annual Research Report
  • [Presentation] Comparative Evaluation of Rhythm Transcription Algorithms on Polyphonic Piano Datasets2016

    • Author(s)
      Eita Nakamura, Kazuyoshi Yoshii
    • Organizer
      Digital Music Research Network Workshop 2016 (DMRN+11)
    • Place of Presentation
      London (UK)
    • Related Report
      2016 Annual Research Report
  • [Presentation] Autoregressive Hidden Semi-Markov Model of Symbolic Music Performance for Score Following2015

    • Author(s)
      Eita Nakamura, Philippe Cuvillier, Arshia Cont, Nobutaka Ono, Shigeki Sagayama
    • Organizer
      16th International Society for Music Information Retrieval Conference
    • Place of Presentation
      マラガ(スペイン)
    • Year and Date
      2015-10-26
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Automatic Piano Reduction from Ensemble Scores Based on Merged-Output Hidden Markov Model2015

    • Author(s)
      Eita Nakamura, Shigeki Sagayama
    • Organizer
      41st International Computer Music Conference
    • Place of Presentation
      テキサス(アメリカ合衆国)
    • Year and Date
      2015-09-26
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] 階層的確率生成モデルによる装飾音を含む多声MIDI音楽演奏の楽譜追跡2015

    • Author(s)
      中村栄太, Philippe Cuvillier, Arshia Cont, 小野順貴, 嵯峨山茂樹, 渡邊健二
    • Organizer
      第108回情報処理学会音楽情報科学研究会
    • Place of Presentation
      名古屋大学(愛知県・名古屋市)
    • Year and Date
      2015-08-31
    • Related Report
      2015 Research-status Report
  • [Presentation] Characteristics of Polyphonic Music Style and Markov Model of Pitch-Class Intervals2015

    • Author(s)
      Eita Nakamura, Shinji Takaki
    • Organizer
      5th Mathematics and Computation in Music
    • Place of Presentation
      ロンドン(イギリス)
    • Year and Date
      2015-06-22
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Automatic Generation of Musical Score in Vertical Line Notation from MIDI File2015

    • Author(s)
      Riku Sato, Yasuyuki Saito, Suguru Agata, Eita Nakamura, Shigeki Sagayama
    • Organizer
      1st International Conference on Advanced Imaging
    • Place of Presentation
      学術総合センター(東京都・千代田区)
    • Year and Date
      2015-06-17
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Study of Automatic Page Turning of Musical Scores by Detecting Player's Nods2015

    • Author(s)
      Haruka Jibiki, Toshikazu Shimizu, Yasuyuki Saito, Eita Nakamura, Shigeki Sagayama
    • Organizer
      1st International Conference on Advanced Imaging
    • Place of Presentation
      学術総合センター(東京都・千代田区)
    • Year and Date
      2015-06-17
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Remarks] 中村栄太

    • URL

      http://eita-nakamura.github.io/index-ja.html

    • Related Report
      2016 Annual Research Report
  • [Remarks] 研究代表者個人Webページ

    • URL

      http://eita-nakamura.github.io/index-ja.html

    • Related Report
      2015 Research-status Report

URL: 

Published: 2015-04-16   Modified: 2018-03-22  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi