• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Network Based Organization of Continuous Media by Intermodal Collaboration and Domain Knowledge Use

Research Project

Project/Area Number 11480087
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field 情報システム学(含情報図書館学)
Research InstitutionOsaka University

Principal Investigator

BABAGUCHI Noboru  Osaka University, Institute of Scientific and Industrial Research, Associate Professor, 産業科学研究所, 助教授 (30156541)

Co-Investigator(Kenkyū-buntansha) SHIBATA Fumihisa  Osaka University, Institute of Scientific and Industrial Research, Research Associate, 産業科学研究所, 助手 (80314425)
OHARA Kouzou  Osaka University, Institute of Scientific and Industrial Research, Research Associate, 産業科学研究所, 助手 (30294127)
KITAHASHI Tadahiro  Osaka University, Institute of Scientific and Industrial Research, Professor, 産業科学研究所, 教授 (70029453)
Project Period (FY) 1999 – 2001
Project Status Completed (Fiscal Year 2001)
Budget Amount *help
¥13,900,000 (Direct Cost: ¥13,900,000)
Fiscal Year 2001: ¥2,400,000 (Direct Cost: ¥2,400,000)
Fiscal Year 2000: ¥3,800,000 (Direct Cost: ¥3,800,000)
Fiscal Year 1999: ¥7,700,000 (Direct Cost: ¥7,700,000)
KeywordsContinuous Media / Video Stream / Multimedia / Organization / Intermodal Collaboration / Video Abstraction / Content Analysis / Event Based Video Indexing / 内容解析 / イベント検出 / 内容に基づくインデキシング
Research Abstract

The goal of this research project is as follows: (1) to develop contents analysis method of continuous media such as video streams consisting of visual, auditory, textual and graphical streams, by means of intermodal collaboration that means collaborative analysis of each video stream, (2) to make the domain knowledge base to facilitate the contents analysis, and (3) to design a scheme of network based media organization called an event net. The major results of this research are classified into three issues.
1. Video indexing and annotation by intermodal collaboration
To automatically produce nodes of the event net, we embodied a couple of contents analysis methods by intermodal collaboration. In particular, event based indexing for broadcasted sports video and semantical annotation in terms of players and actions were developed by considering the correspondence between multimodal streams. We verified that intermodal collaboration outperforms single stream analysis with respect to efficiency and reliability.
2. Media organization based on relations between events
We considered approaches to analysis of relations of events that correspond to nodes of the event net. Specifically, we proposed a method of linking live and replay scenes in the broadcasted sports video, focusing on identical and similar relations.
3. Application of media organization: video abstraction and video portal
By extracting highlight events from the event net, highlight based video abstraction method was pro- posed. The experimental results demonstrated that an hour-length video can be compressed into a minute-length personalized abstract. In addition, we constructed video portal that is a tool to support our access to a multimedia space as an application of media organization.

Report

(4 results)
  • 2001 Annual Research Report   Final Research Report Summary
  • 2000 Annual Research Report
  • 1999 Annual Research Report
  • Research Products

    (35 results)

All Other

All Publications (35 results)

  • [Publications] 河合吉彦, 馬場口登, 北橋忠宏: "放送型スポーツ映像におけるディジタルビデオ効果に着目したリプレイシーン検出の一手法"電子情報通信学会論文誌. J84-D-II,2. 432-435 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 新田直子, 馬場口登, 北橋忠宏: "放送型スポーツ映像の構造を考慮した重要シーンへの自動アノテーション付け"電子情報通信学会論文誌. J84-D-II,8. 1838-1847 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N.Babaguchi et al.: "Event Based Indexing of Broadcasted Sports Video by Intermodal Collaboration"IEEE Trans. Multimedia. 4,1. (8) (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N.Babaguchi: "Towards Abstracting Sports Video by Highlights"Proc. IEEE International Conference on Multimedia and Expo (ICME2001). 1519-1522 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N.Babaguchi et al.: "Generation of Personalized Abstract of Sports Video"Proc. IEEE International Conference on Multimedia and Expo (ICME2001). 800-803 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y.Yasugi, N.Babaguchi et al.: "Detection of Identical Events from Broadcasted Sports Video by Comparing Camera Works"Proc. ACM Multimedia 2000 Worshop on Multimedia Information Retrieval (MIR2001). 66-69 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y. Kawai, N. Babaguchi and T. Kitahashi: "Detection of Replay Scenes in Broadcasted Sports Video by Focusing on Digital Video Effects"Trans. IEICE (D-II). Vol.J84-D-II, No.2. 432-435 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N. Nitta, N. Babaguchi and T. Kitahashi: "Automated Annotation to Significant Scenes Based on Structure of Broadcasted Sports Video"Trans. IEICE (D-II). Vol.J84-D-II, No.8. 1838-1847 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N. Babaguchi, Y. Kawai, and T. Kitahashi: "Event Based Indexing of Broadcasted Sports Video by Intermodal Collaboration"IEEE Trans. Multimedia. Vol.4, No.1. 8 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N. Babaguchi, S. Sasamori, T. Kitahashi and R. Jain: "Detecting Events from Continuous Media by Intermodal Collaboration and Knowledge Use"Proc. IEEE Intl, Conf. Multimedia Computing and Systems (ICMCS'99). Vol.1. 782-786 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y. Yasugi, N. Babaguchi and T. Kitahashi: "A Method of Estimating Moving Distance of a Player Group in TV Video of American Football"Proc. 4th Asian Conf. Computer Vision (ACCV2000). Vol.II. 965-970 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N. Babaguchi: "Towards Abstracting Sports Video by Highlights"Proc. 2000 IEEE Intl Conf. Multimedia and Expo (ICME2000). 1519-1522 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N. Nitta, N. Babaguchi and T. Kitahashi: "Extracting Actors, Actions and Events from Sports Video - A Fundamental Approach to Story Tracking"Proc. 15th Intl Conf. Pattern Recognition (15th ICPR). Vol.4. 718-721 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N. Babaguchi, Y. Kawai, Y. Yasugi and T. Kitahashi: "Linking Live and Replay Scenes in Broadcasted Sports Video"Proc. ACM Multimedia 2000 Workshop on Multimedia Information Retrieval (MIR2000). 205-208 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] N. Babaguchi, Y. Kawai and T. Kitahashi: "Generation of Personalized Abstract of Sports Video"Proc. 2001 IEEE Intl Conf. Multimedia and Expo (ICME2001). 800-803 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Y. Yasugi, N. Babaguchi and T. Kitahashi: "Detection of Identical Events from Broadcasted Sports Video by Comparing Camera Works"Proc. ACM Multimedia 2001 Workshop on Multimedialnformation Retrieval (MIR2001). 66-69 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] F. Nishiue, N. Babaguchi and T. Kitahashi: "Presence Analysis of Players in Broadcasted American Football Video"Proc. 5th Asian Conf. Computer Vision (ACCV2002). Vol.2. 834-839 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 新田直子, 馬場口登, 北橋忠宏: "放送型スポーツ映像の構造を考慮した重要シーンヘの自動アノテーション付け"電子情報通信学会論文誌. J84-D-II, 8. 1838-1847 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] N.Babaguchi et al.: "Event Based Indexing of Broadcasted Sports Video by Intermodal Collaboration"IEEE Trans. Multimedia. 4,1. (8) (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] N.Babaguchi et al.: "Generation of Personalized Abstract of Sports Video"Proc. IEEE International Conference on Multimedia and Expo (ICME2001). 800-803 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] Y.Yasugi, N.Babaguchi et al.: "Detection of Identical Events from Broadcasted Sports Video by Comparing Camera Works"Proc. ACM Multimedia 2000 Worshop on Multimedia Information Retrieval (MIR2001). 66-69 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] F.Nishiue, N.Babaguchi et al.: "Presence Analysis of Players in Broadcasted American Football Video"Proc. 5th Asian Conference on Computer Vision (ACCV2002). 834-839 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 馬場口登: "スポーツTV映像の自動要約と検索(招待講演)"日本スポーツ産業学会第10回学会大会,21世紀のスポーツIT. 73-76 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] N.Babaguchi: "Towards Abstracting Sports Video by Highlights"Proc. IEEE International Conference on Multimedia and Expo(ICME2000). 1519-1522 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] N.Nitta,N.Babaguchi et al.: "Extracting Actors, Actions and Events from Sports Video - A Fundamental Approach to Story Tracking"Proc. 15th International Conference on Pattern Recognition (15th ICPR). 4. 718-721 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 馬場口登: "インターモーダル協調による放送型スポーツ映像の構造化と要約生成[招待講演]"人工知能学会研究会資料(情報統合研究会). SIG-CII-NOV-7. 26-34 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] N.Babaguchi et al.: "Linking Live and Replay Scenes in Broadcasted Sports Video"Proc. ACM Multimedia 2000 Worshop on Multimedia Information Retrieval(MIR2000). 205-208 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 河合吉彦,馬場口登,ほか: "放送型スポーツ映像におけるディジタルビデオ効果に着目したリプレイシーン検出の一手法"電子情報通信学会論文誌. J84-D-II. 432-435 (2001)

    • Related Report
      2000 Annual Research Report
  • [Publications] 河合吉彦,馬場口登,ほか: "個人適応を指向したスポーツ要約映像の生成法"電子情報通信学会技術研究報告. PRMU2000-171. 83-90 (2001)

    • Related Report
      2000 Annual Research Report
  • [Publications] N.Babaguti et al.: "Detecting Events from Continuous Media by Intermodal Collaboration and Knowledge Use"Proc. IEEE International Conference on Multimedia Computing and Systems(ICMCS'99). 1. 185-188 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 馬場口 登: "メディア理解による映像メディアの構造化【特別講演】"電子情報通信学会技術研究報告. PRMU99-42. 39-46 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] N.Babaguti et al.: "Event Based Video Indexing by Intermodal Collaboration"Proc.First International Workshop on Multimedia Intelligent Storage and Retrieval Management(MISRM'99). 1-9 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] Y.Yasugi,N.Babaguchi et al.: "A Method of Estimating Moving Distance of a Player Group in TV Video of American Football"Proc.4th Asian Conference on Computer Vision(ACCV2000). II. 1192-1199 (2000)

    • Related Report
      1999 Annual Research Report
  • [Publications] 山崎博信,馬場口登,ほか: "ビデオデータにおける音声とクローズドキャプションの同期手法の検討"電子情報通信学会技術研究報告. SP99-157. 33-38 (2000)

    • Related Report
      1999 Annual Research Report
  • [Publications] 新田直子,馬場口登,ほか: "言語と画像の情報統合によるスポーツ映像からの人物・アクションイベントの抽出"電子情報通信学会技術研究報告(掲載予定). PRMU99. (2000)

    • Related Report
      1999 Annual Research Report

URL: 

Published: 1999-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi