• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2013 Fiscal Year Final Research Report

Versatile music processing by combining statistical signal processing and music theory

Research Project

  • PDF
Project/Area Number 23240021
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Research Field Perception information processing/Intelligent robotics
Research InstitutionNational Institute of Informatics (2013)
The University of Tokyo (2011-2012)

Principal Investigator

SAGAYAMA Shigeki  国立情報学研究所, 情報学プリンシプル研究系, 特任教授 (00303321)

Co-Investigator(Kenkyū-buntansha) ONO Nobutaka  国立情報学研究所, 情報学プリンシプル研究系, 准教授 (80334259)
NISHIMOTO Takuya  東京大学, 情報理工学系研究科, 助教 (80283696)
SAITO Daisuke  東京大学, 大学院・情報理工学系研究科, 助教 (40615150)
HORI Gen  亜細亜大学, 経営学部, 准教授 (60322658)
NAKAMURA Kazuyuki  明治大学, 総合数理学部, 准教授 (40462171)
KANEKO Hitomi  桐朋学園大学, 音楽学部, 准教授 (00408949)
Project Period (FY) 2011-04-01 – 2014-03-31
Keywords音楽信号処理 / 音楽情報処理 / 楽音分離 / 自動作曲 / 自動伴奏 / ジャンル認識 / リズム解析 / 自動編曲
Research Abstract

We investigated signal and information processing of music, acoustic and speech by integrating statistical signal processing and mathematical models of music theory. Just as integration of acoustic and linguistic processing was the key technology in speech recognition, integrating signal processing and music theory is essential in music processing. More precisely, we developed A: analysis, conversion, separation and detection of music signals based on mathematical models and statistical learning, B: chord recognition, rhythm analysis, segmentation, structural analysis, genre recognition based on mathematical formulation of music theory, and C: automatic music rendering, automatic music composition, automatic music accompaniment and automatic music arrangement based on machine learning and mathematical optimization.

  • Research Products

    (33 results)

All 2014 2013 2012 2011 Other

All Journal Article (23 results) (of which Peer Reviewed: 23 results) Presentation (2 results) (of which Invited: 1 results) Book (1 results) Remarks (3 results) Patent(Industrial Property Rights) (4 results)

  • [Journal Article] Singing Voice Enhancement in Monaural Music Signals Based on Two-stage Harmonic/ Percussive Sound Separation on Multiple Resolution Spectrograms2014

    • Author(s)
      Hideyuki Tachibana, Nobutaka Ono, Shigeki Sagayama
    • Journal Title

      IEEE/ACM IEEE Transactions on Audio, Speech and Language Processing

      Volume: Vol. 22 No. 1 Pages: 228-237

    • Peer Reviewed
  • [Journal Article] Dynamic Bayesian Networks for Symbolic Polyphonic Pitch Modeling2013

    • Author(s)
      Stanislaw Andrzej Raczynski, Emmanuel Vincent, Shigeki Sagayama
    • Journal Title

      IEEE Transactions on Audio, Speech and Language Processing

      Volume: Vol. 21, No. 9 Pages: 1830-1840

    • Peer Reviewed
  • [Journal Article] Bayesian Nonparametric Approach to Blind Separation of Infinitely Many Sparse Souces2013

    • Author(s)
      Hirokazu Kameoka, Misa Sato, Takuma Ono, Nobutaka Ono, Shigeki Sagayama
    • Journal Title

      IEICE Transactions on Fundamentals of Electronics

      Volume: Vol. E96-A, No. 10 Pages: 1928-1937

    • Peer Reviewed
  • [Journal Article] 音楽要素の分解再構成に基づく日本語歌詞からの旋律自動作曲2013

    • Author(s)
      深山覚, 中妻啓, 酒向慎司, 西本卓也, 小野順貴, 嵯峨山茂樹
    • Journal Title

      情報処理学会論文誌

      Volume: Vol. 54, No. 5 Pages: 1709-1720

    • Peer Reviewed
  • [Journal Article] 任意箇所への弾き直し・弾き飛ばしを含む演奏に追従可能な楽譜追跡と自動伴奏2013

    • Author(s)
      中村栄太, 武田晴登, 山本龍一, 齋藤康之, 酒向慎司, 嵯峨山茂樹
    • Journal Title

      情報処理学会論文誌

      Volume: Vol. 54, No. 4 Pages: 1338-1349

    • Peer Reviewed
  • [Journal Article] Automatic Transcription of MIDI Signals Based on Probabilistic Model of Two-dimensional Rhythm Tree Structure Representation2013

    • Author(s)
      Masato Tsuchiya, Kazuki Ochiai, Hirokazu Kameoka, Shigeki Sagayama
    • Journal Title

      Proc. APSIPA

      Volume: Vol. 1 Pages: 1-6

    • Peer Reviewed
  • [Journal Article] Acoustic score following to musical performance with errors and arbitrary repeats and skips for automatic accompaniment2013

    • Author(s)
      Tomohiko Nakamura, Eita Nakamura, Shigeki Sagayama
    • Journal Title

      Proc. SMC

      Pages: 299-304

    • Peer Reviewed
  • [Journal Article] Input-Output HMM Applied to Automatic Arrangement for Guitars2013

    • Author(s)
      Gen Hori, Hirokazu Kameoka, Shigeki Sagayama
    • Journal Title

      J. Information Processing

      Volume: Vol, 21 Pages: 264-271

    • Peer Reviewed
  • [Journal Article] 確率的手法による歌唱曲の自動作曲2012

    • Author(s)
      嵯峨山茂樹, 酒向慎司, 堀玄, 深山覚
    • Journal Title

      システム制御情報学会誌

      Volume: Vol. 56, No. 5 Pages: 219-225

    • Peer Reviewed
  • [Journal Article] Generation of Tempo Curve for Performance Rendering of Piano Music with Automatic Phrase Analysis2012

    • Author(s)
      Naoya Itou, Satoru Fukayama, Daisuke Saito, Shigeki Sagayama
    • Journal Title

      Workshop of Machine Learning for Music 2012

      Volume: Vol. 1 Pages: 1-2

    • Peer Reviewed
  • [Journal Article] Automatic arrangement for guitars using hidden Markov model2012

    • Author(s)
      Gen Hori, Yuma Yoshinaga, Satoru Fukayama, Hirokazu Kameoka, Shigeki Sagayama
    • Journal Title

      Proc. SMC

      Volume: Vol. 1 Pages: 450-456

    • Peer Reviewed
  • [Journal Article] Context-free 2D Tree Structure Model of Musical Notes for Bayesian Modeling of Polyphonic Spectrograms2012

    • Author(s)
      Hirokazu Kameoka, Kazuki Ochiai, Masahiro Nakano, Masato Tsuchiya, Shigeki Sagayama
    • Journal Title

      Proc. ISMIR

      Volume: Vol. 1 Pages: 307-312

    • Peer Reviewed
  • [Journal Article] Constrained and Regularized Variants of Non-neg ative Matrix Factorization Incorpora ting Music-specific Constraints2012

    • Author(s)
      Hirokazu Kameoka, Masahiro Nakano, K azuki Ochiai, Yutaka Imoto, Kunio Ka shino, Shigeki Sagayama
    • Journal Title

      Pro ceedings of International Conference on Acoustics, Speech and Signal Pro cessing

      Pages: 5365-5368

    • Peer Reviewed
  • [Journal Article] Explicit Beat Structu re Modeling for Non-negative Matrix Factorization-Based Multipitch Analy sis2012

    • Author(s)
      Kazuki Ochiai, Hirokazu Kameoka, Shi geki Sagayama
    • Journal Title

      Proceedings of International Co nference on Acoustics, Speech and Si gnal Processing

      Pages: 133-136

    • Peer Reviewed
  • [Journal Article] C omparative Evaluations of Various Ha rmonic/Percussive Sound Separation A lgorithms Based on Anisotropic Conti nuity of Spectrogram2012

    • Author(s)
      Hideyuki Tachibana, Hirokazu, Kameok a, Nobutaka Ono, Shigeki Sagayama
    • Journal Title

      Proceedings of International Conference on Acousti cs, Speech and Signal Processing

      Pages: 465-468

    • Peer Reviewed
  • [Journal Article] A Tandem Connectionist Model Using Combination of Multi-Scale Spe ctro-Temporal Features for Acoustic Event Detection2012

    • Author(s)
      Miquel Espi, Masakiyo Fujimoto, Dais uke Saito, Nobutaka Ono, Shigeki Sag ayama
    • Journal Title

      Proceedings of Inte rnational Conference on Acoustics, S peech and Signal Processing

      Pages: 4293-4296

    • Peer Reviewed
  • [Journal Article] 楽譜情報からの作曲家らしさ認識のための音楽特徴量の提案2012

    • Author(s)
      長谷川隆; 西本卓也; 小野順貴; 嵯峨山茂樹
    • Journal Title

      情報処理学会論文誌

      Volume: Vol. 53, No. 3 Pages: 1204-1215

    • Peer Reviewed
  • [Journal Article] Infinite-state spectrum model for music signal analysis2011

    • Author(s)
      Masahiro Nakano, Jonathan Le Roux, Hirokazu Kameoka, Nobutaka Ono, Shigeki Sagayama
    • Journal Title

      Proceedings of International Conference on Acoustics, Speech and Signal Processing

      Pages: 1972-1975

    • Peer Reviewed
  • [Journal Article] Mul tipitch Estimation by Joint Modeling of Harmonic and Transient Sounds2011

    • Author(s)
      Jun Wu, Emmanuel Vincent, Stanistaw Andrzej Raczynski, Takuya Nishimoto, Nobutaka Ono, Shigeki Sagayama
    • Journal Title

      P roceedings of International Conferen ce on Acoustics, Speech and Signal P rocessing

      Pages: 25-28

    • Peer Reviewed
  • [Journal Article] An Automatic Piano Performanc e System with Statistical Modeling o f Polyphonic Expression and Musical Symbol Interpretation2011

    • Author(s)
      Tae Hun Kim, Satoru Fukayama, Takuy a Nishimoto, Shigeki Sagayama, Polyh ymnia
    • Journal Title

      Proceedings o f New Interface of Music Effects

      Pages: 96-99

    • Peer Reviewed
  • [Journal Article] An Interactive Music Composition System Based on Autonomo us Maintenance of Musical Consistenc y2011

    • Author(s)
      Tetsuro Kitahara, Satoru Fukayama, S higeki Sagayama, Haruhiro Katayose, Noriko Nagata
    • Journal Title

      Proceedings of Sound and Music Co mputing

      Pages: 362-367

    • Peer Reviewed
  • [Journal Article] Using Spectral Fluctuation of Speech in Multi-Feature HMM-based V oice activity Detection2011

    • Author(s)
      Miquel Espi, Shigeki Miyabe, Takuya Nishimoto, Nobutaka Ono, Shigeki Sag ayama
    • Journal Title

      Proceedings of Interspeech

      Pages: 2613-2616

    • Peer Reviewed
  • [Journal Article] Baye sian Nonparametric Spectrogram Model ing Based on Infinite Factorial Infi nite Hidden Markov Model2011

    • Author(s)
      Masahiro Nakano, Jonathan Le Roux, H irokazu Kameoka, Tomohiko Nakamura, Nobutaka Ono, Shigeki Sagayama
    • Journal Title

      Proceeding s. WASPAA

      Pages: 325-328

    • Peer Reviewed
  • [Presentation] 確率的逆問題としての音楽の信号処理と情報処理2012

    • Author(s)
      嵯峨山茂樹, 小野順貴, 亀岡弘和, 齋藤大輔
    • Organizer
      情報処理学会音楽情報科学研究会
    • Place of Presentation
      東京大学,東京都
    • Year and Date
      20120602-03
    • Invited
  • [Presentation] 数理モデルによる音楽情報処理2012

    • Author(s)
      嵯峨山茂樹
    • Organizer
      電子情報通信学会・日本音響学会音声研究会, 電子情報通信学会パタン認識とメディア理解研究会共催研究会
    • Place of Presentation
      東北大学, 宮城県
    • Year and Date
      2012-02-10
  • [Book] Statistical Approach to Automatic Expressive Rendition of Polyphonic Piano Music2012

    • Author(s)
      Tae Hun Kim, Satoru Fukayama, Takuya Nishimoto, Shigeki Sagayama, Springer Verlag
    • Total Pages
      145-180
    • Publisher
      Guide to Computing for Epressive Music Performance
  • [Remarks]

    • URL

      http://hil.t.u-tokyo.ac.jp/

  • [Remarks]

    • URL

      http://researchmap.jp/sagayama/

  • [Remarks]

    • URL

      http://www.onn.nii.ac.jp/onono.html

  • [Patent(Industrial Property Rights)] 日本語歌詞からの多重唱の自動作曲方法及び装置2013

    • Inventor(s)
      嵯峨山茂樹, 齋藤大輔, 深山覚, 桐淵大貴
    • Industrial Property Rights Holder
      国立大学法人東京大学
    • Industrial Property Rights Type
      特許出願
    • Industrial Property Number
      特願2013-042453
    • Filing Date
      2013-03-05
  • [Patent(Industrial Property Rights)] 最適経路探索装置2012

    • Inventor(s)
      嵯峨山茂樹
    • Industrial Property Rights Holder
      国立大学法人東京大学
    • Industrial Property Rights Type
      特許出願
    • Industrial Property Number
      特願2012-213401
    • Filing Date
      2012-09-27
  • [Patent(Industrial Property Rights)] 音響信号解析装置,方法,及びプログラム2012

    • Inventor(s)
      嵯峨山茂樹, 小野順貴, 亀岡弘和, 小野拓磨, 佐藤美沙
    • Industrial Property Rights Holder
      日本電信電話株式会社, 国立大学法人東京大学, 大学共同利用機関法人情報・システム研究機構
    • Industrial Property Rights Type
      特許出願
    • Industrial Property Number
      特願2012-190189
    • Filing Date
      2012-08-30
  • [Patent(Industrial Property Rights)] 音響信号解析装置,方法,及びプログラム2012

    • Inventor(s)
      亀岡弘和,小野拓磨,小野順貴,嵯峨山茂樹
    • Industrial Property Rights Holder
      日本電信電話株式会社, 国立大学法人東京大学, 大学共同利用機関法人情報・システム研究機構
    • Industrial Property Rights Type
      特許出願
    • Industrial Property Number
      特願2012-190188
    • Filing Date
      2012-08-30

URL: 

Published: 2015-06-25   Modified: 2018-10-10  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi