• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Visualization and summarization of Omnidirectional surveillance Video by Spatio-temporal Indexing

Research Project

Project/Area Number 14380163
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionOsaka University

Principal Investigator

BABAGUCHI Noboru  Osaka University, Graduate School of Engineering, Professor, 大学院・工学研究科, 教授 (30156541)

Co-Investigator(Kenkyū-buntansha) SHIBATA Fumihisa  Ritsumeikan University, College of Science and Engineering, Associate Professor, 理工学部, 助教授 (80314425)
OHARA Kouzou  Osaka University, Institute of Scientific and Industrial Research, Research Associate, 産業科学研究所, 助手 (30294127)
YAGI Yasufumi  Osaka University, Institute of Scientific and Industrial Research, Professor, 産業科学研究所, 教授 (60231643)
YAMAZAWA Kazumasa  Nara Institute of Science and Technology, Graduate School of Information Science, Associate Professor, 情報科学研究科, 助教授 (40283931)
YOKOYA Naokazu  Nara Institute of Science and Technology, Graduate School of Information Science, Professor, 情報科学研究科, 教授 (10252834)
Project Period (FY) 2002 – 2003
Project Status Completed (Fiscal Year 2003)
Budget Amount *help
¥15,200,000 (Direct Cost: ¥15,200,000)
Fiscal Year 2003: ¥2,900,000 (Direct Cost: ¥2,900,000)
Fiscal Year 2002: ¥12,300,000 (Direct Cost: ¥12,300,000)
KeywordsOmnidirectional vision sensor / Surveillance video / Spatio-temporal indexing / Summarization / 映像要約 / 協調解析
Research Abstract

For surveillance video given from an omnidirectional vision sensor, the goal of this research project is to build a new media system that is capable of visualizing the whole contents by coordinating temporal and spatial representation and summarizing the video by collecting significant scenes. For this purpose, we performed the following research topics and have obtained valuable knowledge and insights.
1)Development of processing tools for high-vision omnidirectional vision sensors
A high-resolution ominidirectional sensor with a high-vision camera was introduced and real-time video transformation tools, e.g. generation of perspective images, panoramic images and zoom images were implemented. Also a model of an indoor environment where the sensor was located at its center was constructed.
2)Event detection and spatio-temporal indexing
Algorithms for detecting the region of a person with background subtraction and for estimating the two-dimensional position of him/her based on coordinates of his/her legs and head were designed. Viewing IN, OUT, MOVE and STAY as events of the person, we realized event based spatio-temporal indexing. It is confirmed that the spatio-temporal indexing is suitable for surveillance applications.
3)Construction of a prototype system for visualization and summarization of surveillance video
We constructed a prototype system by taking advantage of event based spatio-temporal indexing. To make a viewer easy to understand what event has taken place, the system offers the time-line, spatial map, speed graph and video browsing. In addition, the effectiveness of this system was demonstrated by applying it to actual convenience store environments.

Report

(3 results)
  • 2003 Annual Research Report   Final Research Report Summary
  • 2002 Annual Research Report
  • Research Products

    (21 results)

All Other

All Publications (21 results)

  • [Publications] 馬場口登, 上原邦昭, 有木康雄: "マルチメディア情報の高次処理"人工知能学会誌. Vol.18,No.3. 307-316 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] 岡本啓嗣, 八杉将伸, 馬場口登: "固定長の時空間画像に基づく映像シーンのクラスタリング"電子情報通信学会論文誌(D-II). Vol.J86-D-II, No.6. 877-885 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] N.Babaguchi, Y.Kawai, T.Ogura, T.Kitahashi: "Personalized Abstraction of Broadcasted American Football Video by Highlight Selection"IEEE Trans.Multimedia. in press.

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] S.Morita, K.Yamazawa, N.Yokoya: "Networked Video Surveillance Using Multiple Omnidirectional Cameras"Proc.of 2003 IEEE Int.Sympo.on Computational Intelligence in Robotics and Automation (CIRA2003), Kobe. 1245-1250 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] N.Babaguchi, K.Ohara, T.Ogura: "Effect of Personalization on Retrieval and Summarization of Sports Video"Proceedings of Fourth IEEE Pacific-Rim Conference on Multimedia (PCM2003), Singapore. 2B1.3. (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] 藤本喜彦, 小原ゆう, 柴田史久, 馬場口登, 八木康史: "店舗内に設置した全方位視覚センサによる顧客の行動解析"情報処理学会研究報告,コンピュータビジョンとイメージメディア. 2004-CVIM-142(3). 17-22 (2004)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] N.Babaguchi, K.Uehara, Y.Ariki: "High-Level Processing for Multimedia"Journal of the Japanese Society for AI. Vol.18, No.3. 307-36 (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] H.Okamoto, Y.Yasugi, N.Babaguchi: "Clustering of Video Scenes Based on Spatio-Temporal Images with Fixed Length"Trans.IEICE (D-II). Vol.J186-D-II, No.6. 877-885 (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] N.Babaguchi, Y.Kawai, T.Ogura, T.Kitahashi: "Personalized Abstraction of Broadcasted American Football Video by Highlight Selection"IEEE Trans.Multimedia (regular paper). (In Press). 13 (2004)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] S.Morita, K.Yamazawa, N.Yokoya: "Networked Video surveillance Using Multiple Omnidirectional Cameras"Proc.of 2003 IEEE Intl.Symp.on Computational Intelligence. 1245-1250 (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] N.Babaguchi, K.Ohara, T.Ogura: "Effect of Personalization on Retrieval and Summarization of Sports Video"Proc.of 4th IEEE pacific-Rim Conf.on Multimedia (PCM2003), Singapore. 2B1.3, 5. (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] Y.Fujimoto, Y.Ohara, F.Shibata, N.Babaguchi, Y.Yagi: "Behavioral Analysis of Customers by the Ominidirectional Sensor Installed in the Store"IPSJ SIG Technical Reports. 2004-CVIM-142(3). 17-22 (2004)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] 馬場口登, 上原邦昭, 有木康雄: "マルチメディア情報の高次処理"人工知能学会誌. Vol.18,No.3. 307-316 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 岡本啓嗣, 八杉将伸, 馬場口登: "固定長の時空間画像に基づく映像シーンのクラスタリング"電子情報通信学会論文誌(D-II). Vol.J86-D-II, No.6. 877-885 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] N.Babaguchi, Y.Kawai, T.Ogura, T.Kitahashi: "Personalized Abstraction of Broadcasted American Football Video by Highlight Selection"IEEE Trans. Multimedia. (in press). 13

    • Related Report
      2003 Annual Research Report
  • [Publications] S.Morita, K.Yamazawa, N.Yokoya: "Networked Video Surveillance Using Multiple Omnidirectional Cameras"Proc. of 2003 IEEE Int. Sympo. on Computational Intelligence in Robotics and Automation (CIRA2003), Kobe. 1245-1250 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] N.Babaguchi, K.Ohara, T.Ogura: "Effect of Personalization on Retrieval and Summarization of Sports Video"Proceedings of Fourth IEEE Pacific-Rim Conference on Multimedia (PCM2003), Singapore. 2B1.3. 5 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 藤本喜彦, 小原ゆう, 柴田史久, 馬場口登, 八木康史: "店舗内に設置した全方位視覚センサによる顧客の行動解析"情報処理学会研究報告,コンピュータビジョンとイメージメディア. 2004-CVIM-1 42(3). 17-22 (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] N.Babaguchi, Y.Fujimoto, K.Yamazawa, N.Yokoya: "A system for visualization and summarization of omnidirectional surveillance video"Proceedings of 8th International Workshop on Multimedia Information Systems(MIS2002). 18-27 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 藤本喜彦, 柴田史久, 馬場口登: "全方位サーベイランス映像のイベントに基づく可視化・要約システムの提案"電子情報通信学会技術研究報告. PRMU2002-129. 1-6 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] K.Yamazawa, N.Yokoya: "Detecting moving objects with an omnidirectional camera and subtraction whose background image is renewed"Proceedings of IAPR Workshop on Machine Vision Applications(MVA2002). 154-157 (2002)

    • Related Report
      2002 Annual Research Report

URL: 

Published: 2002-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi