• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of video retrieval engine by using a large-scale video corpus

Research Project

Project/Area Number 26280040
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypePartial Multi-year Fund
Section一般
Research Field Multimedia database
Research InstitutionKobe University

Principal Investigator

Uehara Kuniaki  神戸大学, システム情報学研究科, 教授 (60160206)

Co-Investigator(Kenkyū-buntansha) 松原 崇  神戸大学, その他の研究科, 助教 (70756197)
Research Collaborator SHIRAHAMA Kimiaki  ジーゲン大学, パターン認識グループ, ポスドク
Project Period (FY) 2014-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥17,810,000 (Direct Cost: ¥13,700,000、Indirect Cost: ¥4,110,000)
Fiscal Year 2016: ¥2,730,000 (Direct Cost: ¥2,100,000、Indirect Cost: ¥630,000)
Fiscal Year 2015: ¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2014: ¥11,440,000 (Direct Cost: ¥8,800,000、Indirect Cost: ¥2,640,000)
Keywords機械学習 / 情報検索 / 映像データ / コーパス / 映像検索 / 深層学習
Outline of Final Research Achievements

We have developed a large-scale video retrieval method that can identify videos relevant to a semantically high-level query (e.g., “playing a guitar outdoors), by combing recognition results of concepts (abstracted names of meanings that a human can perceive from a video). Despite the recent advancement of concept detection, it is still difficult to accurately recognise various concepts. Thus, based on Dempster-Shafer Theory, we have quantised uncertainties in concept detection, and developed a probabilistic method that can perform accurate retrieval even using uncertain (erroneous) concept detection results. In addition, by adopting a visual attention model, we have developed a video retrieval method that reflects user’s intention by considering which concepts attract his/her attention.

Report

(4 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Annual Research Report
  • 2014 Annual Research Report
  • Research Products

    (23 results)

All 2017 2016 2015 2014 Other

All Int'l Joint Research (2 results) Journal Article (4 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 4 results,  Open Access: 2 results) Presentation (10 results) (of which Int'l Joint Research: 6 results) Book (2 results) Remarks (4 results) Funded Workshop (1 results)

  • [Int'l Joint Research] ジーゲン大学(ドイツ)

    • Related Report
      2016 Annual Research Report
  • [Int'l Joint Research] ジーゲン大学(ドイツ)

    • Related Report
      2015 Annual Research Report
  • [Journal Article] Homeostatic Plasticity Achieved by Incorporation of Random Fluctuations and Soft-Bounded Hebbian Plasticity in Excitatory Synapses2016

    • Author(s)
      Takashi Matsubara and Kuniaki Uehara
    • Journal Title

      Frontiers in Neural Circuits

      Volume: 10 Pages: 1-17

    • DOI

      10.3389/fncir.2016.00042

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Semantic Indexing based on Focus of Attention Extended by Weakly Supervised Learning2015

    • Author(s)
      Kimiaki Shirahama, Tadashi Matsumura, Marcin Grzegorzek and Kuniaki Uehara
    • Journal Title

      International Journal on Advances in Software

      Volume: 8 Pages: 410-419

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Weakly Supervised Detection of Video Events Using Hidden Conditional Random Fields2015

    • Author(s)
      Kimiaki Shirahama, Marcin Grzegorzek and Kuniaki Uehara
    • Journal Title

      International Journal of Multimedia Information Retrieval

      Volume: 4 Issue: 1 Pages: 17-32

    • DOI

      10.1007/s13735-014-0068-6

    • Related Report
      2015 Annual Research Report 2014 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Hybrid Negative Example Selection Using Visual and Conceptual Features2014

    • Author(s)
      Kimiaki Shirahama, Yuta Matsuoka and Kuniaki Uehara
    • Journal Title

      Multimedia Tools and Applications

      Volume: 71 Issue: 3 Pages: 967-989

    • DOI

      10.1007/s11042-011-0886-y

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Presentation] Curriculum Learningを用いたネットワーク群による効率的な大規模動画像検2017

    • Author(s)
      松本泰幸,篠崎隆志,白浜公章,上原邦昭
    • Organizer
      情報処理学会コンピュータビジョンとイメージメディア(CVIM)研究会
    • Place of Presentation
      国立情報学研究所(東京都千代田区)
    • Year and Date
      2017-03-09
    • Related Report
      2016 Annual Research Report
  • [Presentation] Kobe University, NICT and University of Siegen at TRECVID 2016 AVS Task2016

    • Author(s)
      Yasuyuki Matsumoto, Takashi Shinozaki, Kimiaki Shirahama, Marcin Grzegorzek and Kuniaki Uehara
    • Organizer
      TREC Video Retrieval Evaluation (TRECVID) 2016 Workshop
    • Place of Presentation
      National Institute of Standards and Technology, (Gaithersburg, MD, USA)
    • Year and Date
      2016-11-14
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Convoy Detection in Crowded Surveillance Videos2016

    • Author(s)
      Zeyd Boukhers, Yicon Wang, Kimiaki Shirahama, Kuniaki Uehara and Marcin Grzegorzek
    • Organizer
      7th International Workshop on Human Behavior Understanding
    • Place of Presentation
      University of Amsterdam (Amsterdam, The Netherlands)
    • Year and Date
      2016-10-16
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Image Generation Using Generative Adversarial Networks and Attention Mechanism2016

    • Author(s)
      Yuusuke Kataoka, Takashi Matsubara, Kuniaki Uehara
    • Organizer
      Proceedings of the 15th IEEE/ACIS International Conference on Computer and Information Science
    • Place of Presentation
      岡山コンベンションセンター(岡山県岡山市)
    • Year and Date
      2016-06-26
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Semi-Supervised Learning Using Adversarial Networks2016

    • Author(s)
      Ryosuke Tachibana, Takashi Matsubara, Kuniaki Uehara
    • Organizer
      Proceedings of the 15th IEEE/ACIS International Conference on Computer and Information Science
    • Place of Presentation
      岡山コンベンションセンター(岡山県岡山市)
    • Year and Date
      2016-06-26
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] University of Siegen, Kobe University and NICT at TRECVID 2015 SIN and MED Tasks2015

    • Author(s)
      Kimiaki Shirahama, Takashi Shinozaki, Yasuyuki Matsumoto, Marcin Grzegorzek and Kuniaki Uehara
    • Organizer
      TREC Video Retrieval Evaluation (TRECVID) 2015 Workshop
    • Place of Presentation
      Maryland, USA
    • Year and Date
      2015-11-16
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Deep Learningの中間層学習表現を利用した動画像の意味解析2015

    • Author(s)
      松本泰幸、篠崎隆志、上原邦昭
    • Organizer
      2015年度 第29回人工知能学会全国大会 (JSAI 2015)
    • Place of Presentation
      公立はこだて未来大学(北海道・函館市)
    • Year and Date
      2015-05-30
    • Related Report
      2015 Annual Research Report
  • [Presentation] Empowering Semantic Indexing with Focus of Attention2015

    • Author(s)
      Kimiaki Shirahama, Tadashi Matsumura, Marcin Grzegorzek and Kuniaki Uehara
    • Organizer
      7th International Conferences on Advances in Multimedia (MMEDIA 2015)
    • Place of Presentation
      Barcelona (Spain)
    • Year and Date
      2015-04-19 – 2015-04-24
    • Related Report
      2014 Annual Research Report
  • [Presentation] Empowering Semantic Indexing with Focus of Attention2015

    • Author(s)
      Kimiaki Shirahama, Tadashi Matsumura, Marcin Grzegorzek and Kuniaki Uehara
    • Organizer
      Proc. of the 7th International Conferences on Advances in Multimedia (MMEDIA 2015)
    • Place of Presentation
      Barcelona, Spain
    • Year and Date
      2015-04-19
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Multimedia Event Detection Using Hidden Conditional Random Fields2014

    • Author(s)
      Kimiaki Shirahama, Marcin Grzegorzek and Kuniaki Uehara
    • Organizer
      4th ACM International Conference on Multimedia Retrieval (ICMR 2014)
    • Place of Presentation
      Glasgow (Scotland)
    • Year and Date
      2014-04-01 – 2014-04-04
    • Related Report
      2014 Annual Research Report
  • [Book] Aaron K. Baughman, Jiang Gao, Jia-Yu Pan and Valery Petrushin (eds.) Multimedia Data Mining and Analytics: Disruptive Innovation2015

    • Author(s)
      Kimiaki Shirahama, Kenji Kumabuchi, Marcin Grzegorzek and Kuniaki Uehara (12章, pp. 269-294, 分担執筆) ”Video Retrieval Based on Uncertain Concept Detection Using Dempster-Shafer Theory”
    • Total Pages
      454
    • Publisher
      Springer
    • Related Report
      2015 Annual Research Report
  • [Book] Multimedia Data Mining and Analytics: Disruptive Innovation, Chapter 12, Video Retrieval Based on Uncertain Concept Detection Using Dempster-Shafer Theory2015

    • Author(s)
      Baughman, A., Gao, J., Pan, J.-Y., Petrushin, V.A. (編) Kimiaki Shirahama, Kenji Kumabuchi, Marcin Grzegorzek and Kuniaki Uehara
    • Total Pages
      454
    • Publisher
      Springer
    • Related Report
      2014 Annual Research Report
  • [Remarks] TRECVID 2016 アドホック検索の結果概要

    • URL

      http://www-nlpir.nist.gov/projects/tvpubs/tv16.slides/tv16.avs.slides.pdf

    • Related Report
      2016 Annual Research Report
  • [Remarks] TRECVID 2016アドホック検索部門(manually-assistedカテゴリ)に関する論文

    • URL

      http://www-nlpir.nist.gov/projects/tvpubs/tv16.papers/kobe_nict_siegen.pdf

    • Related Report
      2016 Annual Research Report
  • [Remarks] TRECVID 2016アドホック検索部門に関する発表資料

    • URL

      http://www-nlpir.nist.gov/projects/tvpubs/tv16.slides/tv16.avs.kobe_nict_siegen.slides.pdf

    • Related Report
      2016 Annual Research Report
  • [Remarks] TRECVID 2016アドホック検索部門に関するポスター

    • URL

      http://www-nlpir.nist.gov/projects/tvpubs/tv16.slides/tv16.avs.kobe_nict_siegen.poster.pdf

    • Related Report
      2016 Annual Research Report
  • [Funded Workshop] IEEE/ACIS International Conference on Computer and Information Science 20162016

    • Place of Presentation
      岡山コンベンションセンター(岡山県岡山市)
    • Year and Date
      2016-06-26
    • Related Report
      2016 Annual Research Report

URL: 

Published: 2014-04-04   Modified: 2018-03-22  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi