• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Mining based on latent link analysis for large-scale multimedia archive

Research Project

Project/Area Number 23300041
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Media informatics/Database
Research InstitutionNational Institute of Informatics

Principal Investigator

SATOH Shin'ichi  国立情報学研究所, コンテンツ科学研究系, 教授 (90249938)

Co-Investigator(Renkei-kenkyūsha) LE Duy-dinh  国立情報学研究所, コンテンツ科学研究系, 准教授 (80450170)
WU Xiaomeng  国立情報学研究所, コンテンツ科学研究系, 特任研究員 (20462179)
Project Period (FY) 2011-04-01 – 2014-03-31
Project Status Completed (Fiscal Year 2013)
Budget Amount *help
¥18,980,000 (Direct Cost: ¥14,600,000、Indirect Cost: ¥4,380,000)
Fiscal Year 2013: ¥6,760,000 (Direct Cost: ¥5,200,000、Indirect Cost: ¥1,560,000)
Fiscal Year 2012: ¥6,760,000 (Direct Cost: ¥5,200,000、Indirect Cost: ¥1,560,000)
Fiscal Year 2011: ¥5,460,000 (Direct Cost: ¥4,200,000、Indirect Cost: ¥1,260,000)
Keywordsマルチメディアアーカイブ / 潜在的リンク解析 / 部分画像同定 / 映像マイニング / 部分画像照合 / 放送映像アーカイブ
Research Abstract

We address partial image detection and identification which may correspond to recurrent objects in huge amount of multimedia archives such as large-scale broadcast video archive and Web images and videos. We regard detected and identified partial images as latent link and study mining techniques for graph structure composed of latent links obtained from archives. The outcome of this project enables enumeration of specific objects appear in multimedia archive and their statistical analysis, object auto-annotation based on co-occurrence analysis with metadata and annotation, self-taught object recognition system, and so on. Partial image detection and identification, as the most important technical component, will be implemented by extending our former research outcome of image/video copy detection and mining techniques.

Report

(4 results)
  • 2013 Annual Research Report   Final Research Report ( PDF )
  • 2012 Annual Research Report
  • 2011 Annual Research Report
  • Research Products

    (52 results)

All 2014 2013 2012 2011

All Journal Article (15 results) (of which Peer Reviewed: 11 results,  Open Access: 2 results) Presentation (35 results) Book (1 results) Patent(Industrial Property Rights) (1 results)

  • [Journal Article] Multimedia Event Detection Using Segment-based Approach for Motion Feature2014

    • Author(s)
      Sang Phan, Thanh Duc Ngo, Vu Lam, Son Tran, Duy-Dinh Le, Duc Anh Duong, and Shin'ichi Satoh
    • Journal Title

      Journal of Signal Processing Systems

      Volume: 74 Issue: 1 Pages: 19-31

    • DOI

      10.1007/s11265-013-0825-4

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Face Retrieval in Large-Scale News Video Datasets2013

    • Author(s)
      Thanh Duc Ngo, Hung Thanh Vu, Duy-Dinh Le, and Shin'ichi Satoh
    • Journal Title

      IEICE Trans. on Information and Systems

      Volume: Vol. E96-D, No.8 Pages: 1811-1825

    • NAID

      130003370963

    • Related Report
      2013 Annual Research Report 2013 Final Research Report
  • [Journal Article] Ultrahigh-Speed TV Commercial Detection, Extraction, and Matching2013

    • Author(s)
      Xiaomeng Wu and Shin'ichi Satoh
    • Journal Title

      IEEE Trans. on Circuits and Systems for Video Technology

      Volume: Vol.23, No.6 Pages: 1054-1069

    • Related Report
      2013 Annual Research Report 2013 Final Research Report 2012 Annual Research Report
  • [Journal Article] Annotation propagation in image databases using similarity graphs2013

    • Author(s)
      Michael E Houle, Vincent Oria, Shin'ichi Satoh, and Jichao Sun
    • Journal Title

      ACM Transactions on Multimedia Computing, Communications, and Applications

      Volume: 10 Issue: 1 Pages: 1-21

    • DOI

      10.1145/2487736

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 対話的教示欠陥選択に基づく効率的な実欠陥・虚報弁別技術2013

    • Author(s)
      浦野貴裕
    • Journal Title

      電子情報通信学会論文誌

      Volume: Vol.J96-D, No.1 Pages: 221-229

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] カタログ閲覧行動分析に基づく内装コーディネート支援システム2013

    • Author(s)
      梶山 朋子
    • Journal Title

      電子情報通信学会論文誌

      Volume: Vol.J96-D, No.1 Pages: 94-109

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] An Interaction Model between Human and System for Intuitive Graphical Search Interface2013

    • Author(s)
      Tomoko Kajiyama
    • Journal Title

      Knowledge and Information Systems (KAIS) Journal

      Volume: 未定 Issue: 1 Pages: 41-60

    • DOI

      10.1007/s10115-012-0611-9

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] [Paper] Using Trajectory Features to Recognize Human Actions Within Crowd Sequences of Real Surveillance Video2013

    • Author(s)
      Masaki Takahashi
    • Journal Title

      ITE Transactions on Media Technology and Applications

      Volume: 1 Issue: 2 Pages: 118-126

    • DOI

      10.3169/mta.1.118

    • NAID

      130004648151

    • ISSN
      2186-7364
    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Efficient tracking of news topics based on chronological semantic structures in a large-scale news video archive2012

    • Author(s)
      Ichiro Ide
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: Vol.E95-D, No.5 Pages: 1288-1300

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Structured learning of local features for human action classification and localization2012

    • Author(s)
      Tuan Hue Thi
    • Journal Title

      Image and Vision Computing

      Volume: Vol.30, No.1 Pages: 1-14

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] An Interactive Data Exploration System that Visually Supports Learning of Country Features2012

    • Author(s)
      Tomoko Kajiyama
    • Journal Title

      International Journal of Information Processing and Management

      Volume: Vol.3, No.2 Pages: 292-295

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Automated Real-Time Video Surveillance Summarization Framework2012

    • Author(s)
      Nagul Cooharojananone
    • Journal Title

      Journal of Real-Time Image Processing

      Volume: - Issue: 3 Pages: 1-20

    • DOI

      10.1007/s11554-012-0280-7

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] マルチメディア内容解析技術による放送映像アーカイブの構造化2012

    • Author(s)
      佐藤真一
    • Journal Title

      電子情報通信学会誌

      Volume: Vol.95,No.1 Pages: 68-73

    • NAID

      110008898152

    • Related Report
      2011 Annual Research Report
  • [Journal Article] Simple Low-Dimensional Features Approximating NCC-based Image Matching2011

    • Author(s)
      Shin'ichi Satoh
    • Journal Title

      Pattern Recognition Letters

      Volume: Vol. 32, Issue 14 Pages: 1902-1911

    • Related Report
      2013 Final Research Report 2011 Annual Research Report
  • [Journal Article] Human Gesture Eecognition System for TV Viewing using Time-of-Flight Camera2011

    • Author(s)
      Masaki Takahashi, Mahito Fujii, Masahide Naemura, Shin'ichi Satoh
    • Journal Title

      Multimedia Tools and Applications

      Volume: 2011 Issue: 3 Pages: 1-23

    • DOI

      10.1007/s11042-011-0870-6

    • Related Report
      2012 Annual Research Report 2011 Annual Research Report
    • Peer Reviewed
  • [Presentation] Image Flows Visualization for Inter-Media Comparison2014

    • Author(s)
      Masahiko Itoh, Masashi Toyoda, Cai-Zhi Zhu, Shin'ichi Satoh, and Masaru Kitsuregawa
    • Organizer
      IEEE PacificVis 2014
    • Place of Presentation
      Yokohama, Japan
    • Related Report
      2013 Annual Research Report 2013 Final Research Report
  • [Presentation] Tell me about TV commercials of this product2014

    • Author(s)
      Cai-Zhi Zhu, Siriwat Kasamwattanarote, Xiaomeng Wu, Sat Fri Thu Wed Tue Mon Sun and Shin'ichi Satoh
    • Organizer
      The International Conference on MultiMedia Modeling (MMM2014)
    • Place of Presentation
      Dublin, Ireland
    • Related Report
      2013 Final Research Report
  • [Presentation] Query-Adaptive Asymmetrical Dissimilarities for Visual Object Retrieval2013

    • Author(s)
      Cai-Zhi Zhu, Hervé Jégou, and Shin'ichi Satoh
    • Organizer
      International Conference on Computer Vision
    • Place of Presentation
      Sydney
    • Related Report
      2013 Final Research Report
  • [Presentation] Bag-of-Words against Nearest-Neighbor search for visual object retrieval2013

    • Author(s)
      Cai-Zhi Zhu, Xiao Zhou, Shin'ichi Satoh
    • Organizer
      Asian Conference on Pattern Recognition
    • Place of Presentation
      Naha, Japan
    • Related Report
      2013 Final Research Report
  • [Presentation] Evaluation of Visual Object Retrieval Datasets2013

    • Author(s)
      Cai-Zhi Zhu and Shin'ichi Satoh
    • Organizer
      International Conference on Image Processing (ICIP2013)
    • Place of Presentation
      Melbourne, Australia
    • Related Report
      2013 Final Research Report
  • [Presentation] Query-Adaptive Asymmetrical Dissimilarities for Visual Object Retrieval2013

    • Author(s)
      Cai-Zhi Zhu, Herve Jegou, and Shin'ichi Satoh
    • Organizer
      International Conference on Computer Vision (ICCV2013)
    • Place of Presentation
      Sydney, Australia
    • Related Report
      2013 Annual Research Report
  • [Presentation] Indexing Faces in Broadcast News Video Archives2012

    • Author(s)
      Duy-Dinh Le, Shin'ichi Satoh
    • Organizer
      The Fifth Interntaional Workshop on Mining Multiple Information Sources (MMIS-11), in conjunction with IEEE International Conference on Data Mining (ICDM)
    • Place of Presentation
      Vancouver, Canada
    • Year and Date
      2012-12-11
    • Related Report
      2011 Annual Research Report
  • [Presentation] Science Data Navigation Systems to Enhance Student's Motivation2012

    • Author(s)
      Tomoko Kajiyama, Shin'ichi Satoh
    • Organizer
      Proc.of New Perspectives in Science Education
    • Place of Presentation
      Florence, Italy
    • Year and Date
      2012-03-08
    • Related Report
      2011 Annual Research Report
  • [Presentation] A Country Data Exploration System for Geography Education2012

    • Author(s)
      Tomoko Kajiyama, Shin'ichi Satoh
    • Organizer
      Proc.of International Technology, Education and Development Conference (INTED 2012
    • Place of Presentation
      Valencia, Spain
    • Year and Date
      2012-03-05
    • Related Report
      2011 Annual Research Report
  • [Presentation] Historical Review of Visual Media Recognition Technologies, Digital Media Analysis2012

    • Author(s)
      Shin'ichi Satoh
    • Organizer
      Search and Management DMASM 2011 International Workshop
    • Place of Presentation
      San Diego, USA(Invited Talk)
    • Year and Date
      2012-02-27
    • Related Report
      2011 Annual Research Report
  • [Presentation] Auto Face Re-Ranking By Mining the Web and Video Archives2012

    • Author(s)
      Duy-Dinh Le and Shin'ichi Satoh
    • Organizer
      Proc. of Computer Vision and Pattern Recognition (CVPR)
    • Place of Presentation
      Providence, USA
    • Related Report
      2013 Final Research Report
  • [Presentation] Large Vocabulary Quantization for Searching Instances from Videos2012

    • Author(s)
      Cai-Zhi Zhu and Shin'ichi Satoh
    • Organizer
      Proc. of International Conference on Multimedia Retrieval (ICMR2012)
    • Place of Presentation
      Hong Kong, China
    • Related Report
      2013 Final Research Report
  • [Presentation] Auto Face Re-Ranking By Mining the Web and Video Archives2012

    • Author(s)
      Duy-Dinh Le
    • Organizer
      Proc. of Computer Vision and Pattern Recognition (CVPR)
    • Place of Presentation
      スタンフォード(米国)
    • Related Report
      2012 Annual Research Report
  • [Presentation] Large Vocabulary Quantization for Searching Instances from Videos2012

    • Author(s)
      Cai-Zhi Zhu
    • Organizer
      Proc. of International Conference on Multimedia Retrieval (ICMR2012)
    • Place of Presentation
      香港(中国)
    • Related Report
      2012 Annual Research Report
  • [Presentation] Robust Eye Localization in Video By Combining Eye Detector and Eye Tracker2012

    • Author(s)
      Chi Nhan Duong
    • Organizer
      Proc. of International Conference on Pattern Recognition (ICPR2012)
    • Place of Presentation
      つくば市(日本)
    • Related Report
      2012 Annual Research Report
  • [Presentation] Multimedia Event Detection Using Segment-based Approach For Motion Feature2012

    • Author(s)
      Sang Phan
    • Organizer
      Proc. of Pacific-Rim Conference on Multimedia (PCM2012)
    • Place of Presentation
      シンガポール(シンガポール)
    • Related Report
      2012 Annual Research Report
  • [Presentation] Q-CSLBP: Compression of CSLBP descriptor2012

    • Author(s)
      Junaid Baber
    • Organizer
      Proc. of Pacific-Rim Conference on Multimedia (PCM2012)
    • Place of Presentation
      シンガポール(シンガポール)
    • Related Report
      2012 Annual Research Report
  • [Presentation] Generalized Lasso based Approximation of Sparse Coding for Visual Recognition2011

    • Author(s)
      Nobuyuki Morioka, Shin'ichi Satoh
    • Organizer
      Proc.of Neural Information Processing Systems (NIPS)
    • Place of Presentation
      Granada, Spain
    • Year and Date
      2011-12-12
    • Related Report
      2011 Annual Research Report
  • [Presentation] Knowledge Propagation In Large Image Databases Using Neighborhood Information2011

    • Author(s)
      Michael Houle, Vincent Oria, Shin'ichi Satoh, Jichao Sun
    • Organizer
      ACM Multimedia, Short paper
    • Place of Presentation
      Scottsdale Arizona, USA
    • Year and Date
      2011-11-28
    • Related Report
      2011 Annual Research Report
  • [Presentation] Compact Correlation Coding for Visual Object Categorization2011

    • Author(s)
      Nobuyuki Morioka, Shin'ichi Satoh
    • Organizer
      International Conference on Computer Vision (ICCV2011)
    • Place of Presentation
      Barcelona, Spain
    • Year and Date
      2011-11-08
    • Related Report
      2011 Annual Research Report
  • [Presentation] A Comprehensive Study of Feature Representations for Semantic Concept Detection2011

    • Author(s)
      Duy-Dinh Le, Shin'ichi Satoh
    • Organizer
      International Conference on Semantic Computing (ICSC2011)
    • Place of Presentation
      Stanford University, Palo Alto, USA
    • Year and Date
      2011-09-18
    • Related Report
      2011 Annual Research Report
  • [Presentation] NII-KAORI-PERSON-SEARCH : A General Framework for Indexing and Retrieving People's Appearance In Large Video Archives2011

    • Author(s)
      Duy-Dinh Le, Ngo Duc Thanh, Shin'ichi Satoh
    • Organizer
      International Conference on Semantic Computing (ICSC2011)
    • Place of Presentation
      Stanford University, Palo Alto, USA
    • Year and Date
      2011-09-18
    • Related Report
      2011 Annual Research Report
  • [Presentation] Improving Retake Detection by Adding Motion Feature2011

    • Author(s)
      Hiep Van Hoang, Duy-Dinh Le, Shin'ichi Satoh, Quang Hong Nguyen
    • Organizer
      International Conference on Image Analysis and Processing (ICIAP 2011)
    • Place of Presentation
      Ravenna, Italy
    • Year and Date
      2011-09-14
    • Related Report
      2011 Annual Research Report
  • [Presentation] Commercial Mining Based on Temporal Recurrence Hashing Algorithm and Bag-Of-Fingerprints Model2011

    • Author(s)
      Xiaomeng Wu, Shin'ichi Satoh
    • Organizer
      International Conference on Image Processing (ICIP2011)
    • Place of Presentation
      Brussels, Belgium
    • Year and Date
      2011-09-11
    • Related Report
      2011 Annual Research Report
  • [Presentation] Boosting global scene classification accuracy by discriminative region localization2011

    • Author(s)
      Thanh Duc Ngo, Duy-Dinh Le, Shin'ichi Satoh
    • Organizer
      International Conference on Image Processing (ICIP2011)
    • Place of Presentation
      Brussels, Belgium
    • Year and Date
      2011-09-11
    • Related Report
      2011 Annual Research Report
  • [Presentation] Fast Face Sequence Matching in Large-scale Video Databases2011

    • Author(s)
      Hung Thanh Vu, Thanh Duc Ngo, Thao Ngoc Nguyen, Duy-Dinh Le, Shin'ichi Satoh, Bac Hoai Le, Duc Anh Duong
    • Organizer
      International Conference on Image Processing (ICIP2011)
    • Place of Presentation
      Brussels, Belgium
    • Year and Date
      2011-09-11
    • Related Report
      2011 Annual Research Report
  • [Presentation] Efficient quantization of color sift for image classification2011

    • Author(s)
      Xiao Zhou, Cai-Zhi Zhu, Shin'ichi Satoh, Yu-Tang Guo
    • Organizer
      International Conference on Image Processing (ICIP2011)
    • Place of Presentation
      Brussels, Belgium
    • Year and Date
      2011-09-11
    • Related Report
      2011 Annual Research Report
  • [Presentation] Human Action Recognition in Crowded Surveillance Video Sequences by Using Features Taken from Key-Point Trajectories2011

    • Author(s)
      Masaki Takahashi, Mahito Fujii, Masahide Naemura, Shin'ichi Satoh
    • Organizer
      The 3rd International Workshop on Machine Learning for Vision-based Motion Analysis, in conjunction with CVPR 2011
    • Place of Presentation
      Colorado Springs, CO, USA
    • Year and Date
      2011-06-25
    • Related Report
      2011 Annual Research Report
  • [Presentation] Temporal Recurrence Hashing Algorithm for Mining Commercials from Multimedia Streams2011

    • Author(s)
      Xiaomeng Wu, Shin'ichi Satoh
    • Organizer
      International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2011)
    • Place of Presentation
      Prague, Czech Republic
    • Year and Date
      2011-05-22
    • Related Report
      2011 Annual Research Report
  • [Presentation] Summarizing Large News Video Archives by Event Ranking2011

    • Author(s)
      Duy-Dinh Le and Shin'ichi Satoh
    • Organizer
      International Conference on Semantic Computing (ICSC2011)
    • Place of Presentation
      Stanford University, Palo Alto, USA
    • Related Report
      2013 Final Research Report 2011 Annual Research Report
  • [Presentation] Improving Image Categorization by Using Multiple Instance Learning with Spatial Relation2011

    • Author(s)
      Thanh Duc Ngo, Duy-Dinh Le, and Shin'ichi Satoh
    • Organizer
      International Conference on Image Analysis and Processing (ICIAP 2011)
    • Place of Presentation
      Ravenna, Italy
    • Related Report
      2013 Final Research Report 2011 Annual Research Report
  • [Presentation] Commercial Mining Based on Temporal Recurrence Hashing Algorithm and Bag-Of-Fingerprints Model2011

    • Author(s)
      Xiaomeng Wu and Shin'ichi Satoh
    • Organizer
      International Conference on Image Processing
    • Place of Presentation
      Brussels, Belgium
    • Related Report
      2013 Final Research Report
  • [Presentation] Boosting global scene classification accuracy by discriminative region localization2011

    • Author(s)
      Thanh Duc Ngo, Duy-Dinh Le, and Shin'ichi Satoh
    • Organizer
      International Conference on Image Processing
    • Place of Presentation
      Brussels, Belgium
    • Related Report
      2013 Final Research Report
  • [Presentation] Fast Face Sequence Matching in Large-scale Video Databases2011

    • Author(s)
      Hung Thanh Vu, Thanh Duc Ngo, Thao Ngoc Nguyen, Duy-Dinh Le, Shin'ichi Satoh, Bac Hoai Le, and Duc Anh Duong
    • Organizer
      International Conference on Image Processing
    • Place of Presentation
      Brussels, Belgium
    • Related Report
      2013 Final Research Report
  • [Presentation] Temporal Recurrence Hashing Algorithm for Mining Commercials from Multimedia Streams2011

    • Author(s)
      Xiaomeng Wu and Shin'ichi Satoh
    • Organizer
      International Conference on Acoustics, Speech, and Signal Processing
    • Place of Presentation
      Prague, Czech
    • Related Report
      2013 Final Research Report
  • [Book] ''Multimedia Duplicate Mining towards Knowledge Discovery,'' in Frank Y. Shih ed., ''Multimedia Security : Watermarking, Steganography, and Forensics'2012

    • Author(s)
      Xiaomeng Wu, Sebastien Poullot, and Shin'ichi Satoh
    • Publisher
      Taylor & Francis Group, LLC
    • Related Report
      2013 Final Research Report
  • [Patent(Industrial Property Rights)] 画像照合装置、画像照合方法及びコンピュータプログラム2011

    • Inventor(s)
      佐藤真一
    • Industrial Property Rights Holder
      情報・システム研究機構国立情報学研究所
    • Industrial Property Number
      2011-149428
    • Filing Date
      2011-07-05
    • Related Report
      2011 Annual Research Report

URL: 

Published: 2011-04-06   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi