• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Music Co-player Robot that plays ensemble with people based on the frog's chorsu

Research Project

Project/Area Number 23650097
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Perception information processing/Intelligent robotics
Research InstitutionKyoto University

Principal Investigator

OKUNO Hiroshi G  京都大学, 学院情報学研究科, 教授 (60318201)

Co-Investigator(Renkei-kenkyūsha) AIHARA Ikkyu  理化学研究所, 脳数理研究チーム, 基礎科学特別研究員 (70588516)
Project Period (FY) 2012
Project Status Completed (Fiscal Year 2012)
Budget Amount *help
¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2012: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Fiscal Year 2011: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Keywords知能ロボティクス / カエルの合唱モデル / 音楽共演者ロボット / 音楽合奏協調 / テルミン演奏ロボット / ノンパラメトリックベイズ / 楽譜追跡 / カエルホタル / 知能ロボティックス
Research Abstract

(1) Beat-tracking is developed by integrating information of hand’s movement and audio signals and by combing results of multiple beat-tracking method. The method makes music co-player more robust against various beat- patterns.
(2) The leadership of ensemble is designed basedon the observation of frog chorus. The music co-player robot computes the leadership in real-time, and follows the part of the highest leadership.
(3) Firefly .that responses two kinds of bandwidth of audio signals to light different LEDs is developed and its deployment to fields in Oki Island and in Australia confirms that it can demonstrate the calling patterns of two kinds of frogs.

Report

(3 results)
  • 2012 Annual Research Report   Final Research Report ( PDF )
  • 2011 Research-status Report
  • Research Products

    (42 results)

All 2013 2012 2011 Other

All Journal Article (16 results) (of which Peer Reviewed: 14 results) Presentation (19 results) (of which Invited: 1 results) Book (2 results) Remarks (5 results)

  • [Journal Article] A multi-modal tempo and beat tracking system based on audio-visual information from live guitar performances2012

    • Author(s)
      T.Itohara, T.Otsuka, T.Mizumoto, et al
    • Journal Title

      EURASIP Journal on Audio, Speech, and Music Processing

      Volume: 2012:6 Issue: 1 Pages: 1-15

    • DOI

      10.1186/1687-4722-2012-6

    • Related Report
      2012 Final Research Report 2011 Research-status Report
    • Peer Reviewed
  • [Journal Article] Adaptive Pitch Control for Robot Thereminist using Unscented Kalman Filter2012

    • Author(s)
      Takeshi Mizumot, et al.
    • Journal Title

      Modern Advances in Intelligent Systems and Tools, Studies in In Computational Intelligence

      Volume: 431 Pages: 19-24

    • DOI

      10.1007/978-3-642-30732-4_3

    • ISBN
      9783642307317, 9783642307324
    • Related Report
      2012 Annual Research Report 2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] 混合音を聞き分けるセンシング技術2012

    • Author(s)
      奥乃博, 中臺一博, 水本武志
    • Journal Title

      電子情報通信学会学会誌

      Volume: 95巻 Pages: 401-404

    • NAID

      110009445370

    • URL

      http://ci.nii.ac.jp/naid/110009445370

    • Related Report
      2012 Final Research Report
  • [Journal Article] Who is the leader in a multiperson ensemble? --Multiperson human-robot ensemble model with leaderness--2012

    • Author(s)
      Takeshi Mizumoto, Tetsuya Ogata, Hiroshi G. Okuno
    • Journal Title

      Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2012)

      Volume: Vol.1 Pages: 1413-1419

    • DOI

      10.1109/iros.2012.6385782

    • Related Report
      2012 Annual Research Report 2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] Live Assessment of Beat Tracking for Robot Audition2012

    • Author(s)
      Joao Lobato Oliveira, Gokhan Ince, Keisuke Nakamura, Kazuhiro Nakadai, Hiroshi G. Okuno, Luis Paulo Reis, Fabien Gouyon
    • Journal Title

      Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2012)

      Volume: 1 Pages: 992-997

    • DOI

      10.1109/iros.2012.6386100

    • Related Report
      2012 Annual Research Report 2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] Possible Functions of Call Alternation in Frog Choruses2012

    • Author(s)
      Ikkyu Aihara, Takeshi Mizumoto, Takuma Otsuka, Hiromitsu Awano, Hiroshi G. Okuno, Kazuyuki Aihara
    • Journal Title

      Tenth International Congress of Neuroethology

      Volume: 6

    • DOI

      10.3389/conf.fnbeh.2012.27.00267

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] Sound imaging system for visualizing multiple sound sourcesfrom two species2012

    • Author(s)
      Takeshi Mizumoto, Hiromitsu Awano, Ikkyu Aihara, Takuma Otsuka, Hiroshi G. Okuno
    • Journal Title

      Tenth International Congress of Neuroethology

      Volume: 6

    • DOI

      10.3389/conf.fnbeh.2012.27.00247

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] Improvement of Audio-Visual Score Following in Robot Ensemble with Human Guitarist2012

    • Author(s)
      Tatsuhiko Itohara, Kazuhiro Nakadai, Tetsuya Ogata, Hiroshi G. Okuno
    • Journal Title

      Proceedings of IEEE-RAS Interanational Conference on Humanoid Robots (Humanoids 2012)

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] 混合音を聞き分けるセンシング技術2012

    • Author(s)
      奥乃 博, 中臺 一博, 水本 武志
    • Journal Title

      電子情報通信学会学会誌

      Volume: Vol.95, No.5 Pages: 401-404

    • NAID

      110009445370

    • Related Report
      2012 Annual Research Report
  • [Journal Article] Towards expressive musical robots : A cross-modal framework for emotional gesture voice and music2012

    • Author(s)
      Angelica Lim, Tetsuya Ogata, Hiroshi G.Okuno
    • Journal Title

      EURASIP Journal on Audio, Speech, and Music Processine

      Volume: 2012 Issue: 1 Pages: 363-381

    • DOI

      10.1186/1687-4722-2012-3

    • NAID

      120005439173

    • Related Report
      2011 Research-status Report
    • Peer Reviewed
  • [Journal Article] Sound Imaging of Nocturnal Animal Calls in Their Natural Habitat2011

    • Author(s)
      T.Mizumoto, et al
    • Journal Title

      Journal of Comparative Physiology A

      Volume: Vol.197, No.9 Issue: 9 Pages: 915-921

    • DOI

      10.1007/s00359-011-0652-7

    • Related Report
      2012 Final Research Report 2011 Research-status Report
    • Peer Reviewed
  • [Journal Article] 音楽共演ロボット: 開始・終了キューの画像認識による人間のフルート奏者との実時間同期2011

    • Author(s)
      リムアンジェリカ, 水本武志, 大塚琢馬, 古谷ルイ賢造, 尾形哲也, 奥乃博
    • Journal Title

      情報処理学会論文誌

      Volume: 52巻 Pages: 3839-3852

    • NAID

      110008719935

    • URL

      http://id.nii.ac.jp/1001/00079563/

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] Particle-filter Based Audio-visual Beat-tracking for Music Robot Ensemble with Human Guitarist2011

    • Author(s)
      Tatsuhiko Itohara, Takeshi Muzumoto, Takuma Otsuka, Tetsuya Ogata, Hiroshi G. Okuno
    • Journal Title

      Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2011)

      Volume: Vol.1 Pages: 118-124

    • DOI

      10.1109/iros.2011.6094773

    • Related Report
      2012 Final Research Report 2011 Research-status Report
    • Peer Reviewed
  • [Journal Article] Converting emotional voice to motion for robot telepresence2011

    • Author(s)
      Angelica Lim, Tetsuya Ogata, Hiroshi G. Okuno
    • Journal Title

      Proceedings of IEEE-RAS Interanational Conference on Humanoid Robots (Humanoids 2011)

      Pages: 472-479

    • DOI

      10.1109/humanoids.2011.6100891

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] Incremental Bayesian Audio-to-Score Alignment with Flexible Harmonic Structure Models2011

    • Author(s)
      Takuma Otsuka, Kazuhiro Nakadai, Tetsuya Ogata, Hiroshi G. Okuno
    • Journal Title

      Proceedings of 12th International Society for Musical Information Retrieval Conference (ISMIR-2011)

      Pages: 525-530

    • URL

      http://ismir2011.ismir.net/papers/PS4-9.pdf

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] 音楽共演ロボット: 開始・終了キューの画像認識による人間のフルート奏者との実時間同期2011

    • Author(s)
      リム アンジェリカ, 水本 武志, 大塚 琢馬, 古谷 ルイ賢造, 尾形 哲也, 奥乃 博
    • Journal Title

      情報処理学会論文誌

      Volume: 52 Pages: 3839-3852

    • NAID

      110008719935

    • Related Report
      2011 Research-status Report
    • Peer Reviewed
  • [Presentation] 音楽ロボットのための複数のビートトラッキングの結合手法とその有効性の検証2013

    • Author(s)
      糸原達彦, 水本武志, 奥乃博
    • Organizer
      情報処理学会第75回全国大会
    • Place of Presentation
      東北大学
    • Year and Date
      2013-03-04
    • Related Report
      2012 Final Research Report
  • [Presentation] Human Robot Interaction through Robot Audition2012

    • Author(s)
      Hiroshi G. Okuno
    • Organizer
      IEEE/RSJ IROS-2012 Workshop on Motivational Aspect of Robotics in Physical Therapy
    • Place of Presentation
      Vilamore, Algarve, Portgul(招待講演)
    • Year and Date
      2012-10-12
    • Related Report
      2012 Final Research Report
  • [Presentation] Kinect による楽器マスキングを用いた視聴覚統合ビートトラッキング2012

    • Author(s)
      糸原達彦, 大塚琢馬, 水本武志, 中臺一博, 尾形哲也, 奥乃博
    • Organizer
      情報処理学会第74回全国大会, 5ZD-1
    • Place of Presentation
      名古屋工業大学
    • Year and Date
      2012-03-08
    • Related Report
      2012 Final Research Report 2011 Research-status Report
  • [Presentation] 人とロボットの合奏のための多人数合奏の主導権推定2012

    • Author(s)
      水本武志, 尾形哲也, 奥乃博
    • Organizer
      日本ロボット学会第30回学術講演会
    • Place of Presentation
      札幌コンベンションセンター
    • Related Report
      2012 Final Research Report
  • [Presentation] 音楽ロボットとの合奏ための信頼度を用いたビートトラッキングの結合手法2012

    • Author(s)
      糸原達彦, 奥乃博
    • Organizer
      日本ロボット学会第30回学術講演会
    • Place of Presentation
      札幌コンベンションセンター
    • Related Report
      2012 Final Research Report
  • [Presentation] Possible Functions of Call Alternation in Frog Choruses2012

    • Author(s)
      Ikkyu Aihara, Takeshi Mizumoto, Takuma Otsuka, Hiromitsu Awano, Hiroshi G. Okuno, Kazuyuki Aihara
    • Organizer
      Tenth International Congress of Neuroethology
    • Place of Presentation
      University of Maryland, College Park, MD, USA.
    • Related Report
      2012 Annual Research Report
  • [Presentation] ound imaging system for visualizing multiple sound sources from two species2012

    • Author(s)
      Takeshi Mizumoto, Hiromitsu Awano, Ikkyu Aihara, Takuma Otsuka, Hiroshi G. Okuno
    • Organizer
      Tenth International Congress of Neuroethology,
    • Place of Presentation
      University of Maryland, College Park, MD, USA.
    • Related Report
      2012 Annual Research Report
  • [Presentation] Improvement of Audio-Visual Score Following in Robot Ensemble with Human Guitarist2012

    • Author(s)
      Tatsuhiko Itohara, Kazuhiro Nakadai, Tetsuya Ogata, Hiroshi G. Okuno
    • Organizer
      IEEE-RAS Interanational Conference on Humanoid Robots (Humanoids 2012)
    • Place of Presentation
      Business Innovation Center Osaka, Japan
    • Related Report
      2012 Annual Research Report
  • [Presentation] 人とロボットの合奏のための多人数合奏の主導権推定2012

    • Author(s)
      水本 武志, 尾形 哲也, 奥乃 博
    • Organizer
      日本ロボット学会第30回学術講演会,
    • Place of Presentation
      札幌コンベンションセンター
    • Related Report
      2012 Annual Research Report
  • [Presentation] 音楽ロボットとの合奏ための信頼度を用いたビートトラッキングの結合手法2012

    • Author(s)
      糸原 達彦, 奥乃 博
    • Organizer
      日本ロボット学会第30回学術講演会,
    • Place of Presentation
      札幌コンベンションセンター
    • Related Report
      2012 Annual Research Report
  • [Presentation] Human Robot Interaction through Robot Audition2012

    • Author(s)
      Hiroshi G. Okuno:
    • Organizer
      IEEE/RSJ IROS-2012 Workshop on Motivational Aspect of Robotics in Physical Therapy
    • Place of Presentation
      Vilamoura, Algarve, Portgul,
    • Related Report
      2012 Annual Research Report
    • Invited
  • [Presentation] マルチロボットによるKinectを用いた同期合奏2011

    • Author(s)
      糸原達彦, 水本武志, Angelica Lim, 大塚琢馬, 中村圭佑, 長谷川雄二, 中臺一博, 尾形哲也, 奥乃博
    • Organizer
      第34回AI チャレンジ研究会, 人工知能学会
    • Place of Presentation
      慶応義塾大学
    • Year and Date
      2011-12-15
    • Related Report
      2012 Final Research Report
  • [Presentation] An interactive musical ensemble with the NAO Thereminist2011

    • Author(s)
      Angelica Lim, 水本武志,大塚琢馬, 糸原達彦, 中臺一博, 尾形哲也, 奥乃博
    • Organizer
      第34回AI チャレンジ研究会, 人工知能学会
    • Place of Presentation
      慶応義塾大学
    • Year and Date
      2011-12-15
    • Related Report
      2012 Final Research Report
  • [Presentation] パーティクルフィルタを用いたギター演奏の視聴覚統合ビートトラッキング2011

    • Author(s)
      糸原達彦, 大塚琢馬, 水本武志, 尾形哲也, 奥乃博
    • Organizer
      日本ロボット学会第29回学術講演会, 3A2-2
    • Place of Presentation
      芝浦工業大学
    • Year and Date
      2011-09-09
    • Related Report
      2012 Final Research Report 2011 Research-status Report
  • [Presentation] More cowbell! A musical ensemble with the NAO thereminist2011

    • Author(s)
      Angelica Lim, Takeshi Muzumoto, Takuma Otsuka, Tatsuhiko Itohara, Kazuhiro Nakadai, Tetsuya Ogata, Hiroshi G. Okuno
    • Organizer
      IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2011)
    • Place of Presentation
      San Francisco, USA
    • Related Report
      2012 Final Research Report
  • [Presentation] Incremental Bayesian Audio-to-Score Alignment with Flexible Harmonic Structure Models2011

    • Author(s)
      Takuma Otsuka, Kazuhiro Nakadai, Tetsuya Ogata, Hiroshi G. Okuno
    • Organizer
      Proceedings of 12th International Society for Musical Information Retrieval Conference (ISMIR-2011), pp.525-530
    • Place of Presentation
      Miami, FL, USA
    • Related Report
      2011 Research-status Report
  • [Presentation] More cowbell! A musical ensemble with the NAO thereminist2011

    • Author(s)
      Angelica Lim, Takeshi Muzumoto, Takuma Otsuka, Tatsuhiko Itohara, Kazuhiro Nakadai, Tetsuya Ogata, Hiroshi G. Okuno
    • Organizer
      IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2011)
    • Place of Presentation
      San Francisco, CA, USA
    • Related Report
      2011 Research-status Report
  • [Presentation] マルチロボットによるKinectを用いた同期合奏2011

    • Author(s)
      糸原 達彦, 水本 武志, Angelica Lim, 大塚 琢馬, 中村 圭佑, 長谷川 雄二, 中臺 一博, 尾形 哲也, 奥乃 博
    • Organizer
      第34回 AI チャレンジ研究会, 人工知能学会
    • Place of Presentation
      慶応義塾大学
    • Related Report
      2011 Research-status Report
  • [Presentation] An interactive musical ensemble with the NAO Thereminist2011

    • Author(s)
      Angelica Lim, 水本 武志, 大塚 琢馬, 糸原 達彦, 中臺 一博, 尾形 哲也, 奥乃 博
    • Organizer
      第34回 AI チャレンジ研究会
    • Place of Presentation
      慶応義塾大学
    • Related Report
      2011 Research-status Report
  • [Book] ロボット聴覚, 日本ロボット学会編『ロボットテクノロジー』2011

    • Author(s)
      奥乃博
    • Total Pages
      304
    • Publisher
      オーム社
    • Related Report
      2012 Final Research Report
  • [Book] 日本ロボット学会編『ロボットテクノロジー』 ロボット聴覚の章2011

    • Author(s)
      奥乃 博
    • Total Pages
      304
    • Publisher
      オーム社
    • Related Report
      2011 Research-status Report
  • [Remarks]

    • URL

      http://winnie.kuis.kyoto-u.ac.jp/

    • Related Report
      2012 Final Research Report
  • [Remarks] 重要な引用 Animal Behaviour 誌 60 周年記念エッセイで,雑誌論文(1)がカエルの合唱の観測用の重要な新デバイスとして評価. DOI: 10.1016/j.anbehav.2012.10.031

    • Related Report
      2012 Final Research Report
  • [Remarks] アウトリーチ活動 スーパーサイエンスハイスクール事業サイエンスフォーラム,ロボットの科学フォーラム,2012 年 7 月 28 日,奈良市民文化ホール

    • Related Report
      2012 Final Research Report
  • [Remarks] 奥乃研究室での研究の紹介

    • URL

      http://winnie.kuis.kyoto-u.ac.jp/members/okuno/Invitation-Okuno-Lab.html

    • Related Report
      2012 Annual Research Report
  • [Remarks]

    • URL

      http://winnie.kuis.kyoto-u.ac.jp/

    • Related Report
      2011 Research-status Report

URL: 

Published: 2011-08-05   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi