• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Construction of Adaptive Music Query by Melody Recall in the Brain

Research Project

Project/Area Number 26540047
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Multimedia database
Research InstitutionRitsumeikan University

Principal Investigator

Kawagoe Kyoji  立命館大学, 情報理工学部, 教授 (40298724)

Co-Investigator(Kenkyū-buntansha) 佐久間 春夫  立命館大学, スポーツ健康科学部, 教授 (10128572)
坪 泰宏  立命館大学, 情報理工学部, 准教授 (40384721)
山西 良典  立命館大学, 情報理工学部, 助教 (50700522)
Project Period (FY) 2014-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2016: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2015: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2014: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Keywords脳内想起 / メロディ復元 / 楽曲検索 / 心理状態抽出 / スポーツ応用 / 音楽検索 / 脳波利用 / 心理状態検出 / 脳内想起メロディ / 歌詞 / 感性的検索 / メンタルトレーニング
Outline of Final Research Achievements

The final goal of this research is to realize an adaptive song-play method with music query by melody recall in the brain for sports applications. Especially, in the short term goal, which is that of this research activity, we will propose a way of description of melodies in the brain, a method of music query suitable to user's current mental condition, and investigation of applicability of the results for sports applications. From this research, we obtained the following results. First, we proposed a description method of recalled melody in the brain with aggregations and feature extraction of the EEG data, Second, we also developed a method for extracting a human's mental state from EEG as well as a method for extracting music feeling only from song lyrics. Then, we showed that a melody consisting of a few pitches can be reconstructed with melody-recall in the brain. We also showed that a kansei music retrieval system is possibly realized in the future.

Report

(4 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Research-status Report
  • 2014 Research-status Report
  • Research Products

    (38 results)

All 2017 2016 2015 2014

All Journal Article (9 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 8 results,  Open Access: 5 results,  Acknowledgement Compliant: 5 results) Presentation (29 results) (of which Int'l Joint Research: 8 results,  Invited: 3 results)

  • [Journal Article] Elite Gymnastics Coaches Perceptios of Coaching Atjletes from Different Cultures2017

    • Author(s)
      Ikuko Sasaba, Sean J. Fitzpatrick, Alison Pope-Rhodius, Haruo Sakuma
    • Journal Title

      International Journal of Coaching Science

      Volume: 11(1) Pages: 15-30

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Feature Vectors in Mental-State Classification Using Forehead-mounted Electrical Potential Monitoring Device2016

    • Author(s)
      Sungri Chong, Ryosuke Yamanishi, Yasuhiro Tsubo, Haruo Sakuma and Kyoji Kawagoe
    • Journal Title

      Journal of Advances in Information Technology

      Volume: 7 Issue: 3 Pages: 214-219

    • DOI

      10.12720/jait.7.3.214-219

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] 競技不安とメンタルトレーニング2016

    • Author(s)
      佐久間春夫
    • Journal Title

      Journal of society of Automotive Engineers「自動車技術」

      Volume: 70(10) Pages: 40-44

    • Related Report
      2016 Annual Research Report
  • [Journal Article] 人名の言語的特徴の分析に基づくキラキラネーム判定2016

    • Author(s)
      山西良典,大泉順平,西原陽子,福本淳一
    • Journal Title

      日本感性工学会論文誌

      Volume: 15(1) Pages: 31-37

    • NAID

      130005128782

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Similarity in Neuronal Firing Regimes across Mammalian Species2016

    • Author(s)
      Yasuhiro Mochizuki, Tomokatsu Onaga, Hideaki Shimazaki, Takeaki Shimokawa, Yasuhiro Tsubo 他49名
    • Journal Title

      The Journal of Neuroscience

      Volume: 未定

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Detecting Attractive Phrases from Musical Lyrics Focusing on Typical Expressions on Lyrics2015

    • Author(s)
      Ryosuke Yamanishi, Risako Kagita, Yoko Nishihara, Junichi Fukumoto
    • Journal Title

      International Journal of Affective Engineering

      Volume: 14(3) Pages: 167-174

    • NAID

      130005086765

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] 自律神経の制御 太極拳の生体への効用2015

    • Author(s)
      佐久間春夫
    • Journal Title

      JOHNS

      Volume: 31(8) Pages: 1041-1043

    • Related Report
      2015 Research-status Report
    • Peer Reviewed
  • [Journal Article] Detection of Attractive Phrases from Musical Lyrics Focusing on “Uniqueness of Co-occurred Terms” and “Repetition”2015

    • Author(s)
      山西良典,鍵田里沙子,西原陽子,福本淳一
    • Journal Title

      Transactions of Japan Society of Kansei Engineering

      Volume: 14 Issue: 1 Pages: 29-35

    • DOI

      10.5057/jjske.14.29

    • NAID

      130004957876

    • ISSN
      1884-0833, 1884-5258
    • Related Report
      2014 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Detecting Attractive Phrases from Musical Lyrics Focusing on Typical Expressions on Lyrics2015

    • Author(s)
      Ryosuke Yamanishi, Risako Kagita, Yoko Nishihara, Junichi Fukumoto
    • Journal Title

      International Joural of Affective Engineering

      Volume: 印刷中

    • NAID

      130005086765

    • Related Report
      2014 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Presentation] 洋楽歌詞からの空耳フレーズ自動生成に向けた一検討2016

    • Author(s)
      羽鹿諒,山西良典,Jeremy S. White
    • Organizer
      エンタテインメントコンピューティングシンポジウム2016
    • Place of Presentation
      相愛大学(大阪・中央区)
    • Year and Date
      2016-11-13
    • Related Report
      2016 Annual Research Report
  • [Presentation] ノイズを受けた振動子ネットワークの部分的秩序変数2016

    • Author(s)
      坪泰宏
    • Organizer
      電子情報通信学会複雑系コミュニケーションサイエンス研究会
    • Place of Presentation
      京都産大(京都・下京区)
    • Year and Date
      2016-11-04
    • Related Report
      2016 Annual Research Report
  • [Presentation] Two-Pitch Estimation from EEG Signals for Music-Query by Melody-Recall in the Brain2016

    • Author(s)
      Kyoji Kawagoe, Mao Otsuka, Ryosuke Yamanishi, Yasuhiro Tsubo, Akira Hirabayashi, Haruo Sakuma
    • Organizer
      International Conference of Applied Computing
    • Place of Presentation
      Manheim(Germany)
    • Year and Date
      2016-10-29
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Pure PM Activity on Reward Expectation and Punishment Avoidance Surroundings: An EEG Study2016

    • Author(s)
      Mio Kamei & Haruo Sakuma
    • Organizer
      International Organization of Psychophysiology (IOP), IOP2016 The 18th World Congress of Psychophysiology
    • Place of Presentation
      Habana(Cuba)
    • Year and Date
      2016-09-01
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 女子大学生の運動イメージ想起能力について2016

    • Author(s)
      林悠子,松本清,佐久間春夫
    • Organizer
      日本体育学会第67回大会
    • Place of Presentation
      大阪体育大学(大阪・熊取町)
    • Year and Date
      2016-08-24
    • Related Report
      2016 Annual Research Report
  • [Presentation] Effects of motor imagery perspectives on motor learning based on EEG2016

    • Author(s)
      Yuko Hayasi , Sayaka Matsumoto, Haruo Sakuma
    • Organizer
      North American Society for the Psychology of Sport and Physical Activity, NASPSPA 2016 Conference
    • Place of Presentation
      Montreal(Canada)
    • Year and Date
      2016-06-16
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] スポーツ選手の状況判断時の特徴評価における事象関連電位とメンタルローテーション課題の有用性の検討2016

    • Author(s)
      松本清,今川新吾,佐久間春夫
    • Organizer
      日本バイオフィードバック学会第44回学術総会
    • Place of Presentation
      日本大学文理学部(東京・世田谷区)
    • Year and Date
      2016-06-12
    • Related Report
      2016 Annual Research Report
  • [Presentation] 報酬予測と罰回避に関わるPM活動2016

    • Author(s)
      亀井誠生,佐久間春夫
    • Organizer
      日本生理心理学会, 第34回大会
    • Place of Presentation
      名古屋大学(愛知県・名古屋市)
    • Year and Date
      2016-05-15
    • Related Report
      2016 Annual Research Report
  • [Presentation] Feature Vectors in Mental-State Classification Using Forehead-mounted Electrical Potential Monitoring Device2016

    • Author(s)
      Sungri Chong, Ryosuke Yamanishi, Yasuhiro Tsubo, Haruo Sakuma and Kyoji Kawagoe
    • Organizer
      International Conference on Information Technology
    • Place of Presentation
      elbourne(Austoralia)
    • Year and Date
      2016-03-04
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Music feeling classification based on lyrics using weighting of non-emotional words2015

    • Author(s)
      Mizuki Furuya, Kenta Oku and Kyoji Kawagoe
    • Organizer
      International Conference on Advances in Mobile Computing & Multimedia
    • Place of Presentation
      Brussels(Belgium)
    • Year and Date
      2015-12-13
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] Support Technology in Sport Psychology Career Transition of Elite Athletes: Role of Mental Training2015

    • Author(s)
      Ikuko Sasaba & Haruo Sakuma
    • Organizer
      International Congress on Sport Sciences Research and Technology Support
    • Place of Presentation
      Lisbon(Portugal)
    • Year and Date
      2015-11-16
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] ヒルベルト変換を用いた事象関連電位の位相解析2015

    • Author(s)
      芳野裕規,近藤秀明,坪泰宏
    • Organizer
      電子情報通信学会複雑コミュニケーションサイエンス研究会
    • Place of Presentation
      京都大学稲盛財団記念館稲盛記念ホール(京都府京都市)
    • Year and Date
      2015-11-09
    • Related Report
      2015 Research-status Report
  • [Presentation] バイノーラルビートに誘発される脳波のスペクトル解析2015

    • Author(s)
      近藤秀明,芳野裕規,坪泰宏
    • Organizer
      電子情報通信学会複雑コミュニケーションサイエンス研究会
    • Place of Presentation
      京都大学稲盛財団記念館稲盛記念ホール(京都府京都市)
    • Year and Date
      2015-11-09
    • Related Report
      2015 Research-status Report
  • [Presentation] Multimedia Information Retrieval: from viewpoints of temporal information and new application development2015

    • Author(s)
      Kyoji Kawagoe
    • Organizer
      International Conference on Networking and Information Technology
    • Place of Presentation
      Hotel Sunroute Plaza Shinjuku (Tokyo, Shinjuku)Japan)
    • Year and Date
      2015-11-06
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Detecting KIRAKIRA Japanese Names Focusing on Usage of Kanji Characters2015

    • Author(s)
      Ryosuke Yamanishi, Junpei Oizumi, Yoko Nishihara, Junichi Fukumoto
    • Organizer
      IEEE 4th Global Conference on Consumer Electronics
    • Place of Presentation
      Osaka International Convention Center(Osaka,Kitaku)
    • Year and Date
      2015-10-29
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research
  • [Presentation] スパイク時系列の統計性から探る大脳皮質の確率的情報処理2015

    • Author(s)
      坪泰宏
    • Organizer
      統計数理研究所共同利用「動的生体情報論の現状と展望」研究会
    • Place of Presentation
      統計数理研究所(東京都立川市)
    • Year and Date
      2015-09-11
    • Related Report
      2015 Research-status Report
    • Invited
  • [Presentation] 網膜 ON 型双極細胞視覚伝達チャネルTRPM1ノックアウトマウス網膜の電気生理学的解析2015

    • Author(s)
      大下陽介,瀧澤伸剛,古藤諒,川島桐吾,谷田祐樹,多賀駿,吉田圭佑 ,石金浩史,古川貴久,天野晃,下ノ村和弘,北野勝則,坪泰宏,小池千恵子
    • Organizer
      日本薬学会第135年会
    • Place of Presentation
      兵庫医療大学(兵庫県神戸市)
    • Year and Date
      2015-03-27
    • Related Report
      2014 Research-status Report
  • [Presentation] Music Recommender System Using a Forehead-mounted Electrical Potential Monitoring Device to Classify Mental States2015

    • Author(s)
      Sungri Chong, Ryosuke Yamanishi, Yasuhiro Tsubo, Haruo Sakuma, and Kyoji Kawagoe
    • Organizer
      International Multi-conference on Engineers and COmputer Scientists (IMECS2015)
    • Place of Presentation
      Hong Kong (China)
    • Year and Date
      2015-03-19
    • Related Report
      2014 Research-status Report
  • [Presentation] Evaluation of Music Classification Method based on Lyrics of English Songs2015

    • Author(s)
      Mizuki Furuya, Hung-Hsuan Huang, Kyoji Kawagoe
    • Organizer
      International Multi-conference on Engineers and Computer Scientists (IMECS2015)
    • Place of Presentation
      Hong Kong (China)
    • Year and Date
      2015-03-18
    • Related Report
      2014 Research-status Report
  • [Presentation] 編曲を考慮した旋律検索方法の提案2015

    • Author(s)
      向後憲治,黄 宏軒,川越恭二
    • Organizer
      第77回情報処理学会全国大会
    • Place of Presentation
      京都大学(京都府京都市)
    • Year and Date
      2015-03-18
    • Related Report
      2014 Research-status Report
  • [Presentation] 聴取目的に応じた音楽推薦のための歌詞からの音楽印象分類方法2015

    • Author(s)
      古屋 瑞生, 黄 宏軒, 川越 恭二
    • Organizer
      第7回データ工学と情報マネジメントに関するフォーラム(DEIM2015)
    • Place of Presentation
      磐梯熱海ホテル華の湯 (福島県郡山市)
    • Year and Date
      2015-03-04
    • Related Report
      2014 Research-status Report
  • [Presentation] 脳波利用の音楽推薦システムに向けた前額部導出電位を利用した心理状態分類の基礎検討2015

    • Author(s)
      鄭 昇吏,山西 良典,坪 泰宏,佐久間 春夫,川越 恭二
    • Organizer
      情報処理学会 第161回 ヒューマンコンピュータインタラクション研究会
    • Place of Presentation
      箕面観光ホテル (大阪府箕面市)
    • Year and Date
      2015-01-15
    • Related Report
      2014 Research-status Report
  • [Presentation] 神経細胞の作動原理の経済性2014

    • Author(s)
      坪泰宏
    • Organizer
      行動経済学会第8回大会
    • Place of Presentation
      慶應義塾大学三田キャンパス(東京都港区)
    • Year and Date
      2014-12-07
    • Related Report
      2014 Research-status Report
    • Invited
  • [Presentation] ニコニコ動画コメントの楽器評価表現を用いた選曲手法2014

    • Author(s)
      森本卓志,山西良典,福本淳一
    • Organizer
      日本音響学会音楽音響研究会
    • Place of Presentation
      金沢工業大学 (石川県金沢市)
    • Year and Date
      2014-11-30
    • Related Report
      2014 Research-status Report
  • [Presentation] マッシュアップ楽曲作成における認知リズムの重要性の検討2014

    • Author(s)
      大谷佳美,深川大路,山西良典
    • Organizer
      日本音響学会音楽音響研究会
    • Place of Presentation
      金沢工業大学 (石川県金沢市)
    • Year and Date
      2014-11-30
    • Related Report
      2014 Research-status Report
  • [Presentation] BGM自動付与のための小説の印象シーンへの分割2014

    • Author(s)
      加藤大季,山西良典,福本淳一
    • Organizer
      日本音響学会音楽音響研究会
    • Place of Presentation
      金沢工業大学 (石川県金沢市)
    • Year and Date
      2014-11-29
    • Related Report
      2014 Research-status Report
  • [Presentation] Non-Gaussian Order-Parameter Fluctuation in Complex Oscillator Network2014

    • Author(s)
      Yasuhiro Tsubo
    • Organizer
      2014 International Symposium on Nonlinear Theory and its Applications (NOLTA2014)
    • Place of Presentation
      Luzern (Switzerland)
    • Year and Date
      2014-09-18
    • Related Report
      2014 Research-status Report
  • [Presentation] Music Classification Method based on Lyrics for Music Therapy Support2014

    • Author(s)
      Mizuki Furuya, Hung-Hsuan HUANG, Kyoji Kawagoe
    • Organizer
      18th International Database Engineering & Applications Symposium (IDEAS '14)
    • Place of Presentation
      Porto (Portugal)
    • Year and Date
      2014-07-09
    • Related Report
      2014 Research-status Report
  • [Presentation] Attractive Phrase Detection from Musical Lyric Focusing on Linguistic Expressions2014

    • Author(s)
      Ryosuke Yamanishi, Risako Kagita, Yoko Nishihara, Junichi Fukumoto
    • Organizer
      Kansei Engineering and Emotion Research International Conference 2014
    • Place of Presentation
      Linkoping (Sweden)
    • Year and Date
      2014-06-13
    • Related Report
      2014 Research-status Report

URL: 

Published: 2014-04-04   Modified: 2018-03-22  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi