• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Musical Information Processing by using Sound Ontology

Research Project

Project/Area Number 12480090
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionKYOTO UNIVERSITY (2001-2002)
Tokyo University of Science (2000)

Principal Investigator

OKUNO Hiroshi  Graduate School of Informatics, Professor, 情報学研究科, 教授 (60318201)

Co-Investigator(Kenkyū-buntansha) KAWAHARA Tatsuya  Graduate School of Informatics, Associate Professor, 情報学研究科, 助教授 (00234104)
GOTO Masataka  National Institute of Advanced Industrial Science and Technology, Scientist, 情報処理研究部門, 研究員
Project Period (FY) 2000 – 2002
Project Status Completed (Fiscal Year 2002)
Budget Amount *help
¥9,500,000 (Direct Cost: ¥9,500,000)
Fiscal Year 2002: ¥1,900,000 (Direct Cost: ¥1,900,000)
Fiscal Year 2001: ¥2,300,000 (Direct Cost: ¥2,300,000)
Fiscal Year 2000: ¥5,300,000 (Direct Cost: ¥5,300,000)
KeywordsSound Ontology / Musical Instrument Identification / F0-dependent Multivariate Normal Distribution / Localization by Intramural Phase Difference / Hierarchical Recognition of Musical Instruments / Unsupervised Learning / Clustering / Decision Tree Learning / FO依存多次元正規分布 / 楽器の断層的認識 / 楽音認識 / 音高依存関数 / 音源定位 / 対判別関数 / 階層的認識 / 環境音認識 / 楽音特徴抽出 / 音高によるテンプレート切替
Research Abstract

(1) Musical instrument identification by using pitchdependency
F0-dependent multivariate normal distribution is invented to represent the F0 (pitch) dependency of acoustical features of musical instruments so that F0-dependency and F0-independency are represented by the mean and variance of the F0-dependent multivariate normal distribution. The resulting performance of musical instrument identification is improved by 16.48% at individual instrument level and by 20.6% at category level
(2) Musical sound source separation by combining timbre similarity and localization
The ambiguities of polyphony music caused by overlapping frequency components are resolved by using sound source localization. Based on this schema, musical instrument identification system of polyphony music has been developed, which first extracts mono-tones by simultaneous grouping and then constitutes part streams by sequential grouping. The effectiveness of the proposed system was proved by using quartet performance recorded in an anechoic room
(3) Percussion instrument identification
The drums and cymbals are discriminated by low-pass and high-pass filters. The former is identified by unsupervised learning to absorb the differences of individual instruments and performance, while the ambiguities of cymbals and snare drums are resolved by automatic learning of heuristics concerning their error patterns
(4) Systematic construction of sound ontology
From the features represented by F0-dependent multivariate normal distribution, the hierarchical representation of musical instruments has been created. Thus the method of systematic generation of sound ontology is established. In addition, new observation concerning the pitch-dependency of musical instrument hierarchy has been obtained

Report

(4 results)
  • 2002 Annual Research Report   Final Research Report Summary
  • 2001 Annual Research Report
  • 2000 Annual Research Report
  • Research Products

    (33 results)

All Other

All Publications (33 results)

  • [Publications] 北原鉄朗, 後藤真孝, 奥乃 博: "音高による音色変化に着目した楽器音の音源同定:F0依存多次元正規分布に基づく識別手法"情報処理学会論文誌. (条件付採録). (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Tetsuro Kitahara, Masataka Goto, Hiroshi G.Okuno: "Musical Instrument Identification based on F0-dependent Multivariate Normal Distribution"Proc. of 2003 International Conference on Acoustics, Speech and Signal Processing (ICASSP'2003), IEEE. 5. 421-424 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Tetsuro Kitahara, Masataka Goto, Hiroshi G.Okuno: "Pitch-dependent Musical Instrument Identification and Its Application to Musical Sound Ontology"Proc. of 19th International Conference on Industrial and Engineering Applications of AI and Expert Systems (IEA/AIE-2003), ISAI. (LNAI採録). (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Tetsuro Kitahara, Masataka Goto, Hiroshi G.Okuno: "Musical Instrument Identification based on F0-dependent Multivariate Normal Distribution"Proceedings of 2003 International Conference on Multimedia and Expo (ICME 2003), IEEE. (採録). (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 奥乃 博: "音環境理解 -混合音の認識を目指して"情報処理. 40・10. 1096-1101 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 奥乃 博, 中臺一博: "ロボットの耳は二つで十分か"日本音響学会誌. 58・3. 205-210 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 北原鉄朗, 後藤真孝, 奥乃 博: "音高の音色変化に着目した音源同定手法"情報処理学会音楽情報処理研究会. 2002・45. 7-14 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 桜庭 洋平, 河原 達也, 奥乃 博: "定位情報と音色情報を用いた複数楽器音の認識"情報処理学会音楽情報処理研究会. 2002・63. 9-16 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 北原鉄朗, 後藤真孝, 奥乃 博: "音高の音色変化に着目した音源同定手法"情報処理学会音楽情報処理研究会. SIG-MUS 46. 1-8 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 北原鉄朗, 後藤真孝, 奥乃 博: "楽器音オントロジー作成のための楽器音特徴抽出"情報処理学会第62回全国大会. 4M-5. 9-16 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 北原鉄朗, 後藤真孝, 奥乃 博: "音色空間の音高依存性を考慮した楽器音の音源同定"日本音響学会 2002年秋季研究発表会 講演論文集. 1-1-1. 643-644 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 北原鉄朗, 後藤真孝, 奥乃 博: "音響的類似性に基づく楽器音の階層的クラスタリング"情報処理学会 第65回全国大会. 1P-1. (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 桜庭 洋平, 奥乃 博: "音色類似度と定位類似度の統合による自動採譜"情報処理学会 第65回全国大会. 1P-2. (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 吉井和佳, 北原鉄朗, 桜庭洋平, 奥乃 博: "教師なしクラスタリングと認識誤りパターンを利用した打楽器音の音源同定"情報処理学会 第65回全国大会. 1P-3. (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 日本認知科学会: "推論・問題解決,コミュニケーションとネットワーク,CHインターフェース"『認知科学辞典』 共立出版. 1026+x (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Tetsuro Kitahara, Masataka Goto, Hiroshi G. Okuno: "Musical Instrument Identification Considering Pitch-dependent Characteristics of Timbre: A Classifier Based on F0-dependent Multivariate Normal Distribution"IPSJ Journal. Accepted with minor modifications. (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Tetsuro Kitahara, Masataka Goto, Hiroshi G. Okuno: "Musical Instrument Identification based on F0-dependent Multivariate Normal Distribution"Proc. of IEEE ICASSP'2003. Vol5. 421-424 (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Tetsuro Kitahara, Masataka Goto, Hiroshi G. Okuno: "Pitch-dependent Musical Instrument Identification and Its Application to Musical Sound Ontology"Proc. of 19th IEA/AIE-2003. ISAI. LNAI, (to appear). (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Tetsuro Kitahara, Masataka Goto, Hiroshi G. Okuno: "Okuno: Musical Instrument Identification based on FO-dependent Multivariate Normal Distribution"Proc. of IEEE ICME'2003. to appear. (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Hiroshi G. Okuno: "Computational Auditory Scene Analysis Towards Recognition of sound mixtures"Joho Shori. Vol. 40, No. 10. 1096-1101 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] Hiroshi G. Okuno, Kazuhiro Nakadai: "Computational Auditory Scene Analysis- Towards Recognition of sound mixtures"Journal of ASJ. Vol. 58, No. 3. 205-210 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2002 Final Research Report Summary
  • [Publications] 北原鉄朗, 後藤真孝, 奥乃博: "音高による音色変化に着目した楽器音の音源同定: FO依存多次元正規分布に基づく識別手法"情報処理学会論文誌. 条件付採録. (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] Kitahara, Goto, Okuno: "Musical Instrument Identification based on FO-dependent Multivariate Nor-mal Distribution"Proc. of 2003 International Conference on Acoustics, Speech and Signal Processing (ICASSP'2003), IEEE. Accepted. (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] Kitahara, Goto, Okuno: "Pitch-dependent Musical Instrument Identification and Its Application to Musical Sound Ontology"Proc. of 16th Intern'l Conf. on Industrial and Engineering Applications of Artificial Intelligence and Expert Systems (IEA/AIE-2003), Lecture Notes in Artificial Intelligence Springer-Verlag. Accepted. (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] 桜庭 洋平, 後藤 真孝, 奥乃 博: "定位情報と音色情報を用いた複数楽器音の認識"情報処理学会音楽情報処理研究会. SIG-MUS 46. 1-8 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 北原 鉄朗, 後藤 真孝, 奥乃 博: "楽器音を対象とした音源同定:音高による音色変化を考慮する識別手法の検討"情報処理学会音楽情報処理研究会. SIG-MUS 46. 9-16 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 吉井和佳, 北原鉄朗, 櫻庭洋平, 奥乃 博: "教師なしクラスタリングと認識誤りパターンを利用した打楽器音の音源同定"情報処理学会第65回全国大会. 1P-3. (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] 日本認知科学会: "『認知科学辞典』推論・問題解決,コミュニケーションとネットワーク,CHインターフェース"共立出版. 1026+x (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 北原 鉄朗, 後藤 真孝, 奥乃 博: "音高の音色変化に着目した音源同定手法"情報処理学会音楽情報処理研究会. SIG-MUS 40. 7-12 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 奥乃 博, 中臺一博: "ロボットの耳は二つで十分か"日本音響学会誌. 58・3. 205-210 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 奥乃 博, 中臺 一博 他訳: "PCクラスタ構築法-Linuxクラスタベオウルフ"産業図書. 380 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 奥乃博: "音環境理解-混合音の認識を目指して"情報処理. 40巻・10号. 1096-1101 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 北原鉄郎,後藤真孝,奥乃博: "楽器音オントロジー作成のための楽器音特徴抽出"情報処理学会第62回全国大会. 4M-5. (2001)

    • Related Report
      2000 Annual Research Report

URL: 

Published: 2000-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi