• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Query-by-Singing music information Retrieval system supporting various singing style

Research Project

Project/Area Number 18K11321
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 60080:Database-related
Research InstitutionOsaka Institute of Technology

Principal Investigator

Suzuki Motoyuki  大阪工業大学, 情報科学部, 教授 (30282015)

Project Period (FY) 2018-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2021: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2020: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2019: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2018: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Keywords楽曲検索 / 歌唱音声認識 / 歌詞誤りに頑健な検索 / 歌詞の記憶誤り / Query-by-Singing / 楽曲検索システム / 検索スコアの統合 / 大語彙言語モデル / 音素系列による検索 / 歌詞認識 / 擬音語歌唱
Outline of Final Research Achievements

In this research, we had developed various elemental technologies with the aim of constructing a music retrieval system using singing voice as input.First, we had developed a method to recognize singing voice with high accuracy. Since a note generally corresponds to a mora in singing voice, we developed a recognition method that uses note boundary information to improve the accuracy.
Next, we developed a robust retrieval method for lyrics containing errors. For recognition errors, we used phoneme sequences instead of word sequences, and for human memory errors, we improved the retrieval accuracy by reflecting error tendencies in the retrieval score.
Finally, a method for combining the retrieval results obtained from both melody and lyrics was studied. We tried to improve the accuracy by matching the retrieval positions, but did not achieve the expected results.

Academic Significance and Societal Importance of the Research Achievements

歌唱音声認識の精度向上に大きな貢献をした。歌唱音声の認識が難しい事は従来から知られていたが,音響モデルや言語モデルを適応させる程度しか対処法が提案されていなかった。本研究では音符の区切り時刻を利用する,という新たな発想を取り入れ,認識精度を大きく向上させることができた。更に歌唱音声において任意の位置に無音区間が挿入される可能性があること,それが認識性能を劣化させる大きな原因であった事を初めて明らかにした。
また,歌詞を用いた楽曲検索において,認識誤りだけではなく,人間の記憶誤りにも注目し,適切に対処を行うことで検索精度を向上させたことも大きな貢献である。

Report

(6 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Research-status Report
  • 2020 Research-status Report
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (7 results)

All 2020 2019 2018

All Journal Article (4 results) (of which Peer Reviewed: 2 results,  Open Access: 1 results) Presentation (3 results) (of which Int'l Joint Research: 1 results)

  • [Journal Article] Singing Voice Recognition Using On-set Time Information of Notes2020

    • Author(s)
      鈴木 基之,杉田 裕亮
    • Journal Title

      情報処理学会論文誌

      Volume: 61 Issue: 4 Pages: 798-806

    • DOI

      10.20729/00204230

    • NAID

      170000181822

    • Year and Date
      2020-04-15
    • Related Report
      2020 Research-status Report
    • Peer Reviewed
  • [Journal Article] Lyrics Recognition from Singing Voice Focused on Correspondence Between Voice and Notes2019

    • Author(s)
      Suzuki Motoyuki、Tomita Sho、Morita Tomoki
    • Journal Title

      Proc. INTERSPEECH 2019

      Volume: - Pages: 3238-3241

    • DOI

      10.21437/interspeech.2019-1318

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] 主旋律に注目したクラシック音楽の自動擬音語変換2019

    • Author(s)
      鈴木 基之,竹中 智美
    • Journal Title

      情報処理学会研究報告 音楽情報科学

      Volume: 2019-MUS-123 Pages: 1-5

    • Related Report
      2019 Research-status Report
  • [Journal Article] 音符区切り位置の推定誤りに頑健な高精度歌唱音声認識2018

    • Author(s)
      鈴木基之, 富田翔
    • Journal Title

      情報処理学会研究報告

      Volume: 2018-MUS-119 Pages: 1-4

    • Related Report
      2018 Research-status Report
  • [Presentation] Lyrics Recognition from Singing Voice Focused on Correspondence Between Voice and Notes2019

    • Author(s)
      Suzuki Motoyuki
    • Organizer
      INTERSPEECH 2019
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] 主旋律に注目したクラシック音楽の自動擬音語変換2019

    • Author(s)
      鈴木 基之
    • Organizer
      情報処理学会 音楽情報科学研究会
    • Related Report
      2019 Research-status Report
  • [Presentation] 音符区切り位置の推定誤りに頑健な高精度歌唱音声認識2018

    • Author(s)
      鈴木基之
    • Organizer
      情報処理学科 音楽情報科学研究会
    • Related Report
      2018 Research-status Report

URL: 

Published: 2018-04-23   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi