• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of music information retrieval system for instrumental music by using automatic music-to-onomatopoeias converter

Research Project

Project/Area Number 25330140
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Multimedia database
Research InstitutionOsaka Institute of Technology

Principal Investigator

Suzuki Motoyuki  大阪工業大学, 情報科学部, 准教授 (30282015)

Research Collaborator KAWASHIMA Kohei  
KUBO Hayato  
KUROKAWA Yutaro  
KOMAI Riki  
SATO Tomoya  
SUGITA Yusuke  
SUGIMOTO Yuta  
HISAOKA Akimitsu  
Project Period (FY) 2013-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000)
Fiscal Year 2016: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2015: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2014: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2013: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Keywords楽曲検索システム / 擬音語歌唱 / 音程抽出 / 歌唱音声認識 / 歌唱音声の認識 / 擬音語自動変換
Outline of Final Research Achievements

In this study, we have developed a music information retrieval (MIR) system for instrumental music, which uses singing voice by onomatopoeias as query.
Relationship between music and its representation by onomatopoeias can be used for retrieval in addition to melody information. In order to realize such MIR system, following four methods has been developed; automatic music-to-onomatopoeias converter, high performance melody information extractor and lyrics recognizer from singing voice, and high speed retriever.
From experimental results, the converter outputted appropriate onomatopoeias representations. The extractor and the recognizer outperformed conventional methods, and the retriever suppressed about 10% amount of calculation.

Report

(5 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Research-status Report
  • 2014 Research-status Report
  • 2013 Research-status Report
  • Research Products

    (8 results)

All 2017 2016 2015 2014 Other

All Journal Article (2 results) (of which Peer Reviewed: 1 results,  Open Access: 1 results,  Acknowledgement Compliant: 1 results) Presentation (6 results) (of which Int'l Joint Research: 3 results,  Invited: 1 results)

  • [Journal Article] Development of Singing-by-Onomatopoeia corpus for Query-by-Singing Music Information Retrieval system2017

    • Author(s)
      Motoyuki Suzuki, Akimitsu Hisaoka.
    • Journal Title

      International Journal of Advanced Intelligence

      Volume: 9 Pages: 63-75

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] 擬音語による楽曲表現の分析と自動変換システムの開発2014

    • Author(s)
      黒川優太郎・佐藤友哉・鈴木基之
    • Journal Title

      電子情報通信学会技術研究報告(音声)

      Volume: Vol. 113, No.452 Pages: 25-26

    • Related Report
      2013 Research-status Report
  • [Presentation] 音符区切り情報を用いた高精度歌唱音声認識2017

    • Author(s)
      鈴木 基之,杉田 裕亮.
    • Organizer
      情報処理学会 音楽情報科学研究会
    • Place of Presentation
      お茶の水女子大学(東京都文京区)
    • Year and Date
      2017-06-17
    • Related Report
      2016 Annual Research Report
  • [Presentation] Development of Singing-by-Onomatopoeia corpus for Query-by-Singing Music Information Retrieval system2016

    • Author(s)
      Motoyuki Suzuki, Akimitsu Hisaoka.
    • Organizer
      International Conference on Natural Language Processing and Knowledge Engineering (NLP-KE'16)
    • Place of Presentation
      沖縄県市町村自治会館(沖縄県那覇市)
    • Year and Date
      2016-12-14
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Automatic motion selection method for spoken dialog scenario editor2016

    • Author(s)
      Motoyuki Suzuki, Kohei Kawashima.
    • Organizer
      Annual Conference on Knowledge-Based and Intelligent Information & Engineering Systems (KES2016)
    • Place of Presentation
      Park Inn by Radisson York City Centre(英国・ヨーク)
    • Year and Date
      2016-09-05
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Lyrics recognition from singing voice dealing with insertion error2016

    • Author(s)
      Motoyuki Suzuki
    • Organizer
      International Symposium on Ultra Realistic Interactive Acoustic Communications 2016
    • Place of Presentation
      宮城蔵王ロイヤルホテル
    • Year and Date
      2016-05-20
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] フレーム間の音程に注目した歌唱音声からのメロディ抽出法2015

    • Author(s)
      鈴木 基之・久保 勇人
    • Organizer
      情報処理学会音楽情報科学研究会
    • Place of Presentation
      電気通信大学
    • Year and Date
      2015-05-23 – 2015-05-24
    • Related Report
      2014 Research-status Report
  • [Presentation] 擬音語による楽曲表現の分析と自動変換システムの開発

    • Author(s)
      黒川優太郎・佐藤友哉・鈴木基之
    • Organizer
      電子情報通信学会音声研究会
    • Place of Presentation
      徳島大学
    • Related Report
      2013 Research-status Report

URL: 

Published: 2014-07-25   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi