• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Social Sensing Technology Suite based on Object Mining for Large-Scale Video Archives

Research Project

Project/Area Number 26240016
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Research Field Multimedia database
Research InstitutionNational Institute of Informatics

Principal Investigator

SATOH Shin'ichi  国立情報学研究所, コンテンツ科学研究系, 教授 (90249938)

Co-Investigator(Renkei-kenkyūsha) KATAYAMA Norio  国立情報学研究所, コンテンツ科学研究系, 准教授 (60280559)
LE Duy-Dinh  国立情報学研究所, コンテンツ科学研究系, 准教授 (80450170)
MO Hiroshi  国立情報学研究所, コンテンツ科学研究系, 助教 (60312203)
Project Period (FY) 2014-06-27 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥42,380,000 (Direct Cost: ¥32,600,000、Indirect Cost: ¥9,780,000)
Fiscal Year 2016: ¥14,170,000 (Direct Cost: ¥10,900,000、Indirect Cost: ¥3,270,000)
Fiscal Year 2015: ¥15,990,000 (Direct Cost: ¥12,300,000、Indirect Cost: ¥3,690,000)
Fiscal Year 2014: ¥12,220,000 (Direct Cost: ¥9,400,000、Indirect Cost: ¥2,820,000)
Keywords大規模放送映像アーカイブ / 社会センシング / 物体マイニング / 映像マイニング / 事物マイニング / 放送映像アーカイブ / 社会センシング基盤
Outline of Final Research Achievements

We study and develop technology suite for social sensing to evaluate events in our society (financial situation, sports events, disasters, accidents, etc.) by analyzing temporal exploration and frequencies of objects (person, location, products, file footage, etc.) in broadcast video archives. In concrete, we study object mining technique to detect and identify objects in large-scale broadcast video archives, and social sensing technology suite to accomplish multi-facet analysis of the occurrences of the objects in the space of broadcast video archives. Especially, object mining is a challenging topic, and we address significant performance and efficiency boost by global consistency checking.

Report

(4 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Annual Research Report
  • 2014 Annual Research Report
  • Research Products

    (35 results)

All 2017 2016 2015 2014 2013 Other

All Int'l Joint Research (2 results) Journal Article (13 results) (of which Int'l Joint Research: 5 results,  Peer Reviewed: 13 results,  Open Access: 5 results) Presentation (19 results) (of which Int'l Joint Research: 14 results) Book (1 results)

  • [Int'l Joint Research] University of Science, VNU-HCMC/UIT, VNU-HCMC(ベトナム)

    • Related Report
      2015 Annual Research Report
  • [Int'l Joint Research] INRIA(France)

    • Related Report
      2015 Annual Research Report
  • [Journal Article] Efficient Large-Scale Multi-Class Image Classification By Learning Balanced Trees2017

    • Author(s)
      Duy-Dinh Le, Tien-Dung Mai, Thanh Duc Ngo, Duc Anh Duong, Kiem Hoang, and Shin'ichi Satoh
    • Journal Title

      Computer Vision and Image Understanding

      Volume: 156 Pages: 151-161

    • DOI

      10.1016/j.cviu.2016.10.008

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Audience Behavior Mining by Integrating TV Ratings with Multimedia Contents2017

    • Author(s)
      Ryota Hinami and Shin'ichi Satoh
    • Journal Title

      IEEE MultiMedia

      Volume: N/A

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Instance Search Retrospective with Focus on TRECVID2017

    • Author(s)
      George Awad, Wessel Kraaij, Paul Over, and Shin'ichi Satoh
    • Journal Title

      International Journal of Multimedia Information Retrieval

      Volume: 6 Issue: 1 Pages: 1-29

    • DOI

      10.1007/s13735-017-0121-3

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] When face-tracking meets social networks: a story of politics in news videos2016

    • Author(s)
      Benjamin Renoust, Tetsuro Kobayashi, Thanh Duc Ngo, Duy Dinh Le, and Shin'ichi Satoh
    • Journal Title

      Applied Network Science

      Volume: 1 Issue: 1 Pages: 1-25

    • DOI

      10.1007/s41109-016-0003-2

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Visual Analytics of Political Networks from Face-tracking of News Video2016

    • Author(s)
      Benjamin Renoust, Duy-Dinh Le, and Shin'ichi Satoh
    • Journal Title

      IEEE Trans. on Multimedia

      Volume: 18 Issue: 11 Pages: 2184-2195

    • DOI

      10.1109/tmm.2016.2614224

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Query Bootstrapping: A Visual Mining based Query Expansion2016

    • Author(s)
      Siriwat Kasamwattanarote, Yusuke Uchida, and Shin'ichi Satoh
    • Journal Title

      IEICE Trans. on Information and Systems

      Volume: E99 Pages: 454-466

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Bidirectional Extraction and Recognition of Scene Text with Layout Consistency2016

    • Author(s)
      Ryota Hinami, Xinhao Liu, Naoki Chiba, and Shin'ichi Satoh
    • Journal Title

      International Journal on Document Analysis and Recognition

      Volume: N/A Issue: 2 Pages: 83-98

    • DOI

      10.1007/s10032-016-0261-7

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Evaluation of Multiple Features for Violent Scenes2016

    • Author(s)
      Vu Lam, Sang Phan, Duy-Dinh Le, Duc Anh Duong, and Shin'ichi Satoh
    • Journal Title

      Multimedia Tools and Applications

      Volume: N/A Issue: 5 Pages: 7041-7065

    • DOI

      10.1007/s11042-016-3331-4

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Scalable Face Track Retrieval in Video Archives using Bag-of-Faces Sparse Representation2015

    • Author(s)
      Bor-Chun Chen, Yan-Ying Chen, Yin-Hsi Kuo, Thanh Duc Ngo, Duy-Dinh Le, Shin'ichi Satoh, and Winston H. Hsu
    • Journal Title

      IEEE Trans. on Circuits and Systems for Video Technology

      Volume: -印刷中

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Multimedia Event Detection Using Segment-based Approach for Motion Feature2014

    • Author(s)
      Sang Phan, Thanh Duc Ngo, Vu Lam, Son Tran, Duy-Dinh Le, Duc Anh Duong, and Shin'ichi Satoh
    • Journal Title

      Journal of Signal Processing Systems

      Volume: 74 Issue: 1 Pages: 19-31

    • DOI

      10.1007/s11265-013-0825-4

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] BM25 with Exponential IDF for Instance Search2014

    • Author(s)
      Masaya Murata, Hidehisa Nagano, Ryo Mukai, Kashino Kunio, and Shin'ichi Satoh,
    • Journal Title

      IEEE Trans. on Multimedia

      Volume: 18 Pages: 1690-1699

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] BIG-OH: BInarization of Gradient Orientation Histograms2014

    • Author(s)
      Junaid Baber, Matthew N. Dailey, Shin'ichi Satoh, and Nitin Afzulpurkar
    • Journal Title

      Image and Vision Computing

      Volume: 32 Issue: 11 Pages: 940-953

    • DOI

      10.1016/j.imavis.2014.08.006

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] An Interaction Model between Human and System for Intuitive Graphical Search Interface2013

    • Author(s)
      Tomoko Kajiyama
    • Journal Title

      Knowledge and Information Systems (KAIS) Journal

      Volume: 未定 Issue: 1 Pages: 41-60

    • DOI

      10.1007/s10115-012-0611-9

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] Audience Behavior Mining by Integrating TV Ratings with Multimedia Contents2016

    • Author(s)
      Ryota Hinami and Shin'ichi Satoh
    • Organizer
      IEEE International Symposium on Multimedia
    • Place of Presentation
      San Jose, USA
    • Year and Date
      2016-12-11
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Unsupervised Estimation of Video Continuity Model from Large-Scale Video Archives and Its Application to Shot Boundary Detection2016

    • Author(s)
      Norio Katayama, Hiroshi Mo, and Shin'ichi Satoh
    • Organizer
      IEEE International Symposium on Multimedia
    • Place of Presentation
      San Jose, USA
    • Year and Date
      2016-12-11
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] News archive exploration combining face detection and tracking with network visual analytics2016

    • Author(s)
      Benjamin Renoust, Thanh Duc Ngo, Duy-Dinh Le, and Shin'ichi Satoh
    • Organizer
      ACM Multimedia, Demo
    • Place of Presentation
      Amsterdam, the Netherlands
    • Year and Date
      2016-10-15
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Large-scale R-CNN with Classifier Adaptive Quantization2016

    • Author(s)
      Ryota Hinami and Shin'ichi Satoh
    • Organizer
      European Conference on Computer Vision
    • Place of Presentation
      Amsterdam, the Netherlands
    • Year and Date
      2016-10-08
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Efficient Large Scale Image Classification via Prediction Score Decomposition2016

    • Author(s)
      Duy-Dinh Le, Tien-Dung Mai, Shin'ichi Satoh, Thanh Duc Ngo, and Duc Anh Duong
    • Organizer
      European Conference on Computer Vision
    • Place of Presentation
      Amsterdam, the Netherlands
    • Year and Date
      2016-10-08
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Using Node Relationships for Hierarchical Classification2016

    • Author(s)
      Tien-Dung Mai, Thanh Duc Ngo, Duy-Dinh Le, Duc Anh Duong, Kiem Hoang, and Shin'ichi Satoh
    • Organizer
      ICIP
    • Place of Presentation
      Phoenix, USA
    • Year and Date
      2016-09-25
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Network Visual Analytics of News Videos based on Facetracking2016

    • Author(s)
      Benjamin Renoust, Duy-Dinh Le and Shin'ichi Satoh
    • Organizer
      IEEE PacificVis 2016
    • Place of Presentation
      Taipei, Taiwan
    • Year and Date
      2016-04-19
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Network Visual Analytics of News Videos based on Facetracking2016

    • Author(s)
      Benjamin Renoust, Duy-Dinh Le and Shin'ichi Satoh
    • Organizer
      IEEE PacificVis
    • Place of Presentation
      Taipei, Taiwan
    • Year and Date
      2016-04-19
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Social Network Analysis of Face Tracking in News Video2015

    • Author(s)
      Benjamin Renoust, Thanh Duc Ngo, Duy Dinh Le, and Shin'ichi Satoh
    • Organizer
      International Workshop on Complex Networks and their Applications, in conjunction with International Conference on Signal Image Technology and Internet Based Systems
    • Place of Presentation
      Bangkok, Thailand
    • Year and Date
      2015-11-23
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Temporal matching kernel with explicit feature maps2015

    • Author(s)
      Sebastien Poullot, Anh Nguyen Phuong, Shunsuke Tsukatani, Herve Jegou, and Shin'ichi Satoh
    • Organizer
      ACM Multimedia
    • Place of Presentation
      Brisbane, Australia
    • Year and Date
      2015-10-26
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Multimedia Event Detection Using Event-Driven Multiple Instance Learning2015

    • Author(s)
      Sang Phan, Duy-Dinh Le, Shin'ichi Satoh
    • Organizer
      ACM Multimedia
    • Place of Presentation
      Brisbane, Australia
    • Year and Date
      2015-10-26
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Query-Adaptive Late Fusion with Neural Network for Instance Search2015

    • Author(s)
      Vinh-Tiep Nguyen, Dinh-Luan Nguyen, Minh-Triet Tran, Duy-Dinh Le, Duc Anh Duong, and Shin'ichi Satoh
    • Organizer
      2015 IEEE International Workshop on Multimedia Signal Processing
    • Place of Presentation
      Xiamen, China
    • Year and Date
      2015-10-19
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Enhanced Visualization of News Shot Cloud with Employing Circular Layout2015

    • Author(s)
      Norio Katayama, Hiroshi Mo, and Shin'ichi Satoh
    • Organizer
      The 8th International Symposium on Visual Information Communication and Interaction
    • Place of Presentation
      Tokyo, Japan
    • Year and Date
      2015-08-24
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] PVSS: Portable Visual Search Service for Researchers2015

    • Author(s)
      Siriwat Kasamwattanarote and Shin'ichi Satoh
    • Organizer
      The 7th International Conference on Internet Multimedia Computing and Service
    • Place of Presentation
      Zhangjiajie, China
    • Year and Date
      2015-08-19
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Efficient cross-domain image retrieval by multi-level matching and spatial verification for structural similarity2014

    • Author(s)
      Che-Chun Lee, Yin-Hsi Kuo, Winston Hsu, Shin'ichi Satoh, and Sebastian Agethen
    • Organizer
      ACM Multimedia, short paper
    • Place of Presentation
      Orlando, USA
    • Year and Date
      2014-11-03 – 2014-11-07
    • Related Report
      2014 Annual Research Report
  • [Presentation] User Emotion Sensing in Search Process based on Chromatic Sensation2014

    • Author(s)
      Tomoko Kajiyama and Shin'ichi Satoh
    • Organizer
      Workshop on Human Centered Event Understanding from Multimedia (HuEvent14), co-located with ACM Multimedia 2014
    • Place of Presentation
      Orlando, USA
    • Year and Date
      2014-11-03 – 2014-11-07
    • Related Report
      2014 Annual Research Report
  • [Presentation] Sum-max Video Pooling for Complex Event Recognition2014

    • Author(s)
      Sang Phan, Duy-Dinh Le, and Shin'ichi Satoh
    • Organizer
      ICIP
    • Place of Presentation
      Paris, France
    • Year and Date
      2014-10-27 – 2014-10-30
    • Related Report
      2014 Annual Research Report
  • [Presentation] A practical spatial re-ranking method for instance search from videos2014

    • Author(s)
      Xiao Zhou, Cai-Zhi Zhu, Qiang Zhu, Shin'ichi Satoh, and Yu-Tang Guo
    • Organizer
      ICIP
    • Place of Presentation
      Paris, France
    • Year and Date
      2014-10-27 – 2014-10-30
    • Related Report
      2014 Annual Research Report
  • [Presentation] Binary Feature-based Image Retrieval with Effective Indexing and Scoring2014

    • Author(s)
      Yusuke Uchida, Shigeyuki Sakazawa, and Shin'ichi Satoh
    • Organizer
      IEEE Global Conference on Consumer Electronics (GCCE 2014)
    • Place of Presentation
      Makuhari, Japan
    • Year and Date
      2014-10-07 – 2014-10-10
    • Related Report
      2014 Annual Research Report
  • [Book] 検索の新地平 集める、探す、見つける、眺める2015

    • Author(s)
      佐藤真一, 片山紀生, 孟洋 (分筆)
    • Total Pages
      250
    • Publisher
      角川
    • Related Report
      2014 Annual Research Report

URL: 

Published: 2014-11-20   Modified: 2022-02-22  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi