• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2012 Fiscal Year Final Research Report

Music Co-player Robot that plays ensemble with people based on the frog's chorsu

Research Project

  • PDF
Project/Area Number 23650097
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Perception information processing/Intelligent robotics
Research InstitutionKyoto University

Principal Investigator

OKUNO Hiroshi G  京都大学, 学院情報学研究科, 教授 (60318201)

Co-Investigator(Renkei-kenkyūsha) AIHARA Ikkyu  理化学研究所, 脳数理研究チーム, 基礎科学特別研究員 (70588516)
Project Period (FY) 2012
Keywords知能ロボティクス / カエルの合唱モデル / 音楽共演者ロボット / 音楽合奏協調 / テルミン演奏ロボット / ノンパラメトリックベイズ / 楽譜追跡 / カエルホタル
Research Abstract

(1) Beat-tracking is developed by integrating information of hand’s movement and audio signals and by combing results of multiple beat-tracking method. The method makes music co-player more robust against various beat- patterns.
(2) The leadership of ensemble is designed basedon the observation of frog chorus. The music co-player robot computes the leadership in real-time, and follows the part of the highest leadership.
(3) Firefly .that responses two kinds of bandwidth of audio signals to light different LEDs is developed and its deployment to fields in Oki Island and in Australia confirms that it can demonstrate the calling patterns of two kinds of frogs.

  • Research Products

    (26 results)

All 2013 2012 2011 Other

All Journal Article (13 results) (of which Peer Reviewed: 12 results) Presentation (9 results) Book (1 results) Remarks (3 results)

  • [Journal Article] A multi-modal tempo and beat tracking system based on audio-visual information from live guitar performances2012

    • Author(s)
      Tatsuhiko Itohara, Takuma Otsuka, Takeshi, Muzumoto, Angelica Lim, Tetsuya Ogata, Hiroshi, G. Okuno
    • Journal Title

      EURASIP Journal on Audio, Speech, and Music Processing

      Volume: Vol.2012 Pages: 1-15

    • DOI

      DOI:10.1186/1687-4722-2012-6

    • Peer Reviewed
  • [Journal Article] Adaptive Pitch Control for Robot Thereminist using Unscented Kalman Filter2012

    • Author(s)
      Takeshi Mizumoto, Toru Takahashi, Tetsuya Ogata, Hiroshi G. Okuno
    • Journal Title

      Modern Advances in Intelligent Systems and Tools, Studies in Computational Intelligence

      Volume: Vol.431 Pages: 19-24

    • DOI

      DOI:10.1007/978-3-642-30732-4_3

    • Peer Reviewed
  • [Journal Article] 混合音を聞き分けるセンシング技術2012

    • Author(s)
      奥乃博, 中臺一博, 水本武志
    • Journal Title

      電子情報通信学会学会誌

      Volume: 95巻 Pages: 401-404

    • URL

      http://ci.nii.ac.jp/naid/110009445370

  • [Journal Article] Who is the leader in a multiperson ensemble? --Multiperson human-robot ensemble model with leaderness--2012

    • Author(s)
      Takeshi Mizumoto, Tetsuya Ogata, Hiroshi G. Okuno
    • Journal Title

      Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2012)

      Pages: 1413-1419

    • DOI

      DOI:10.1109/IROS.2012.6385782

    • Peer Reviewed
  • [Journal Article] Luis Paulo Reis, Fabien Gouyon, Live Assessment of Beat Tracking for Robot Audition2012

    • Author(s)
      Joao Lobato Oliveira, Gokhan Ince, Keisuke Nakamura, Kazuhiro Nakadai, Hiroshi G. Okuno
    • Journal Title

      Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2012)

      Pages: 922-997

    • DOI

      DOI:10.1109/IROS.2012.6386100

    • Peer Reviewed
  • [Journal Article] Possible Functions of Call Alternation in Frog Choruses2012

    • Author(s)
      Ikkyu Aihara, Takeshi Mizumoto, Takuma Otsuka, Hiromitsu Awano, Hiroshi G. Okuno, Kazuyuki Aihara
    • Journal Title

      Tenth International Congress of Neuroethology

    • DOI

      DOI:10.3389/conf.fnbeh.2012.27.00267

    • Peer Reviewed
  • [Journal Article] Sound imaging system for visualizing multiple sound sourcesfrom two species2012

    • Author(s)
      Takeshi Mizumoto, Hiromitsu Awano, Ikkyu Aihara, Takuma Otsuka, Hiroshi G. Okuno
    • Journal Title

      Tenth International Congress of Neuroethology

    • DOI

      DOI:10.3389/conf.fnbeh.2012.27.00247

    • Peer Reviewed
  • [Journal Article] Improvement of Audio-Visual Score Following in Robot Ensemble with Human Guitarist2012

    • Author(s)
      Tatsuhiko Itohara, Kazuhiro Nakadai, Tetsuya Ogata, Hiroshi G. Okuno
    • Journal Title

      Proceedings of IEEE-RAS Interanational Conference on Humanoid Robots (Humanoids 2012)

    • Peer Reviewed
  • [Journal Article] Sound Imaging of Nocturnal Animal Calls in Their Natural Habita2011

    • Author(s)
      Takeshi Mizumoto, Ikkyu Aihara, Takuma Otsuka, Ryu Takeda, Kazuyuki Aihara, Hiroshi G. Okuno
    • Journal Title

      Journal of Comparative Physiology A: Neuroethology, Sensory, Neural, and Behavioral Physiology

      Volume: Vol.197 Pages: 915-921

    • DOI

      DOI:10.1007/s00359-011-0652-7

    • Peer Reviewed
  • [Journal Article] 音楽共演ロボット: 開始・終了キューの画像認識による人間のフルート奏者との実時間同期2011

    • Author(s)
      リムアンジェリカ, 水本武志, 大塚琢馬, 古谷ルイ賢造, 尾形哲也, 奥乃博
    • Journal Title

      情報処理学会論文誌

      Volume: 52巻 Pages: 3839-3852

    • URL

      http://id.nii.ac.jp/1001/00079563/

    • Peer Reviewed
  • [Journal Article] Particle-filter Based Audio-visual Beat-tracking for Music Robot Ensemble with Human Guitarist2011

    • Author(s)
      Tatsuhiko Itohara, Takeshi Muzumoto, Takuma Otsuka, Tetsuya Ogata, Hiroshi G. Okuno
    • Journal Title

      Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2011)

      Volume: Vol.1 Pages: 118-124

    • DOI

      DOI:10.1109/IROS.2011.6094773

    • Peer Reviewed
  • [Journal Article] Converting emotional voice to motion for robot telepresence2011

    • Author(s)
      Angelica Lim, Tetsuya Ogata, Hiroshi G. Okuno
    • Journal Title

      Proceedings of IEEE-RAS Interanational Conference on Humanoid Robots (Humanoids 2011)

      Pages: 472-479

    • DOI

      DOI:10.1109/10.1109/Humanoids.2011.6100891

    • Peer Reviewed
  • [Journal Article] Incremental Bayesian Audio-to-Score Alignment with Flexible Harmonic Structure Models2011

    • Author(s)
      Takuma Otsuka, Kazuhiro Nakadai, Tetsuya Ogata, Hiroshi G. Okuno
    • Journal Title

      Proceedings of 12th International Society for Musical Information Retrieval Conference (ISMIR-2011)

      Pages: 525-530

    • URL

      http://ismir2011.ismir.net/papers/PS4-9.pdf

    • Peer Reviewed
  • [Presentation] 音楽ロボットのための複数のビートトラッキングの結合手法とその有効性の検証2013

    • Author(s)
      糸原達彦, 水本武志, 奥乃博
    • Organizer
      情報処理学会第75回全国大会
    • Place of Presentation
      東北大学
    • Year and Date
      2013-03-04
  • [Presentation] 人とロボットの合奏のための多人数合奏の主導権推定2012

    • Author(s)
      水本武志, 尾形哲也, 奥乃博
    • Organizer
      日本ロボット学会第30回学術講演会
    • Place of Presentation
      札幌コンベンションセンター
    • Year and Date
      20120000
  • [Presentation] 音楽ロボットとの合奏ための信頼度を用いたビートトラッキングの結合手法2012

    • Author(s)
      糸原達彦, 奥乃博
    • Organizer
      日本ロボット学会第30回学術講演会
    • Place of Presentation
      札幌コンベンションセンター
    • Year and Date
      20120000
  • [Presentation] Human Robot Interaction through Robot Audition2012

    • Author(s)
      Hiroshi G. Okuno
    • Organizer
      IEEE/RSJ IROS-2012 Workshop on Motivational Aspect of Robotics in Physical Therapy
    • Place of Presentation
      Vilamore, Algarve, Portgul(招待講演)
    • Year and Date
      2012-10-12
  • [Presentation] Kinect による楽器マスキングを用いた視聴覚統合ビートトラッキング2012

    • Author(s)
      糸原達彦, 大塚琢馬, 水本武志, 中臺一博, 尾形哲也, 奥乃博
    • Organizer
      情報処理学会第74回全国大会, 5ZD-1
    • Place of Presentation
      名古屋工業大学
    • Year and Date
      2012-03-08
  • [Presentation] More cowbell! A musical ensemble with the NAO thereminist2011

    • Author(s)
      Angelica Lim, Takeshi Muzumoto, Takuma Otsuka, Tatsuhiko Itohara, Kazuhiro Nakadai, Tetsuya Ogata, Hiroshi G. Okuno
    • Organizer
      IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2011)
    • Place of Presentation
      San Francisco, USA
    • Year and Date
      20110925-30
  • [Presentation] マルチロボットによるKinectを用いた同期合奏2011

    • Author(s)
      糸原達彦, 水本武志, Angelica Lim, 大塚琢馬, 中村圭佑, 長谷川雄二, 中臺一博, 尾形哲也, 奥乃博
    • Organizer
      第34回AI チャレンジ研究会, 人工知能学会
    • Place of Presentation
      慶応義塾大学
    • Year and Date
      2011-12-15
  • [Presentation] An interactive musical ensemble with the NAO Thereminist2011

    • Author(s)
      Angelica Lim, 水本武志,大塚琢馬, 糸原達彦, 中臺一博, 尾形哲也, 奥乃博
    • Organizer
      第34回AI チャレンジ研究会, 人工知能学会
    • Place of Presentation
      慶応義塾大学
    • Year and Date
      2011-12-15
  • [Presentation] パーティクルフィルタを用いたギター演奏の視聴覚統合ビートトラッキング2011

    • Author(s)
      糸原達彦, 大塚琢馬, 水本武志, 尾形哲也, 奥乃博
    • Organizer
      日本ロボット学会第29回学術講演会, 3A2-2
    • Place of Presentation
      芝浦工業大学
    • Year and Date
      2011-09-09
  • [Book] ロボット聴覚, 日本ロボット学会編『ロボットテクノロジー』2011

    • Author(s)
      奥乃博
    • Total Pages
      304
    • Publisher
      オーム社
  • [Remarks]

    • URL

      http://winnie.kuis.kyoto-u.ac.jp/

  • [Remarks] 重要な引用 Animal Behaviour 誌 60 周年記念エッセイで,雑誌論文(1)がカエルの合唱の観測用の重要な新デバイスとして評価. DOI: 10.1016/j.anbehav.2012.10.031

  • [Remarks] アウトリーチ活動 スーパーサイエンスハイスクール事業サイエンスフォーラム,ロボットの科学フォーラム,2012 年 7 月 28 日,奈良市民文化ホール

URL: 

Published: 2014-09-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi