• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Web Multimedia Mining for Learning Verb and Noun Concepts and Their Relations

Research Project

Project/Area Number 23650044
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Media informatics/Database
Research InstitutionThe University of Electro-Communications

Principal Investigator

YANAI Keiji  電気通信大学, 情報理工学(系)研究科, 准教授 (20301179)

Project Period (FY) 2011 – 2013
Project Status Completed (Fiscal Year 2013)
Budget Amount *help
¥3,770,000 (Direct Cost: ¥2,900,000、Indirect Cost: ¥870,000)
Fiscal Year 2013: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2012: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2011: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Keywords動作認識 / ビデオ認識 / Webマルチメディアマイニング / Web動画 / 画像認識 / 一般物体認識 / Web動画分類 / Web動画マイニング / 動画像認識 / 時空間特徴量 / 動作分類 / 物体認識
Research Abstract

After the three-year research activities on this research grant, we have obtained the following results: (1) A new method to collect video shots corresponding to the given keywords from the Web video sharing site such as YouTube. (2) A method to improve (1) by using results of Web image search engines additionally. (3) A novel method, VisualTextualRank, for efficient use of relations between words and video shots. (4) A method to extract new spatio-temporal features by paying attention to human hands motion, which helps effectively recognize and analyze interactions between objects and human hands.

Report

(4 results)
  • 2013 Annual Research Report   Final Research Report ( PDF )
  • 2012 Research-status Report
  • 2011 Research-status Report
  • Research Products

    (38 results)

All 2014 2013 2012 2011 Other

All Journal Article (9 results) (of which Peer Reviewed: 9 results) Presentation (25 results) Book (2 results) Remarks (2 results)

  • [Journal Article] FoodCam: A Real-time Food Recognition System on a Smartphone2014

    • Author(s)
      Yoshiyuki Kawano and Keiji Yanai
    • Journal Title

      Multimedia Tools and Applications

      Volume: - Issue: 14 Pages: 5263-5287

    • DOI

      10.1007/s11042-014-2000-8

    • Related Report
      2013 Annual Research Report 2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Automatic Extraction of Relevant Video Shots of Specific Actions Exploiting Web Data2014

    • Author(s)
      Do Hang Nga and Keiji Yanai
    • Journal Title

      Computer Vision and Image Understanding

      Volume: Vol. 118 Pages: 2-15

    • DOI

      10.1016/j.cviu.2013.03.009

    • Related Report
      2013 Annual Research Report 2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] 複数品目が含まれる食事画像の認識における共起関係の利用2013

    • Author(s)
      松田裕司, 柳井啓司
    • Journal Title

      電子情報通信学会論文誌

      Volume: vol. J96-D, no.8 Pages: 1724-1730

    • NAID

      110009634944

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Large-scale Web Video Shot Ranking Based on Visual Features and Tag Co-occurrence2013

    • Author(s)
      Do Hang Nga and Keiji Yanai
    • Journal Title

      Proceedings of the 21st ACM international conference on Multimedia

      Volume: - Pages: 525-528

    • DOI

      10.1145/2502081.2502139

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 複数品目が含まれる食事画像の認識における共起関係の利用2013

    • Author(s)
      松田裕司,柳井啓司
    • Journal Title

      電子情報通信学会論文誌D

      Volume: J96-D-8

    • NAID

      110009634944

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] 候補領域推定に基づく複数品目食事画像認識2012

    • Author(s)
      松田裕司, 甫足創, 柳井啓司
    • Journal Title

      電子情報通信学会論文誌

      Volume: Vol.J95-D, No.8 Pages: 1554-1564

    • NAID

      110009489166

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] 候補領域推定に基づく複数品目食事画像認識2012

    • Author(s)
      松田裕司,甫足創,柳井啓司
    • Journal Title

      電子情報通信学会論文誌D

      Volume: J95-D-8 Pages: 1554-1564

    • NAID

      110009489166

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Folksonomyを用いた画像特徴とタグ共起に基づく画像オントロジーの自動構築2011

    • Author(s)
      秋間雄太, 川 久保秀敏, 柳井啓司
    • Journal Title

      電子情報通信学会論文誌

      Volume: Vol.J94-D, No.8 Pages: 1248-1259

    • NAID

      110008686476

    • Related Report
      2013 Final Research Report
    • Peer Reviewed
  • [Journal Article] Folksonomyを用いた画像特徴とタグ共起に基づく画像オントロジーの自動構築2011

    • Author(s)
      秋間雄太,川久保秀敏,柳井啓司
    • Journal Title

      電子情報通信学会論文誌D

      Volume: J94-D-8 Pages: 1248-1259

    • NAID

      110008686476

    • Related Report
      2011 Research-status Report
    • Peer Reviewed
  • [Presentation] A Dense SURF and Triangulation based Spatio-Temporal Feature for Action Recognition2014

    • Author(s)
      Do Hang Nga and Keiji Yanai
    • Organizer
      Proc. of Multimedia Modeling Conference (MMM)
    • Place of Presentation
      Dublin, Ireland
    • Related Report
      2013 Final Research Report
  • [Presentation] A Spatio-Temporal Feature based on Triangulation of Dense SURF2013

    • Author(s)
      Do Hang Nga and Keiji Yanai
    • Organizer
      Proc. of ICCV Workshop on Action Recognition with a Large Number of Classes
    • Place of Presentation
      Sydney, Australia
    • Related Report
      2013 Final Research Report
  • [Presentation] Rapid Mobile Food Recognition using Fisher Vector2013

    • Author(s)
      Yoshiyuki Kawano and Keiji Yanai
    • Organizer
      Proc. of Asian Conference on Pattern Recognition
    • Place of Presentation
      Okinawa, Japan
    • Related Report
      2013 Final Research Report
  • [Presentation] Summarization of Egocentric Moving Videos for Generating Walking Route Guidance2013

    • Author(s)
      Masaya Okamoto and Keiji Yanai
    • Organizer
      Proc. of Pacific-rim Symposium on Image and Vision Technology
    • Place of Presentation
      Guanajuato, Mexico
    • Related Report
      2013 Final Research Report
  • [Presentation] Large-scale Web Video Shot Ranking Based on Visual Features and Tag Co-occurrence2013

    • Author(s)
      Do Hang Nga and Keiji Yanai
    • Organizer
      Proc. of ACM Multimedia
    • Place of Presentation
      Barcelona, Spain
    • Related Report
      2013 Final Research Report
  • [Presentation] Visual Event Mining from Geo-Tweet Photos2013

    • Author(s)
      Takamu Kaneko and Keiji Yanai
    • Organizer
      Proc. of ICME Workshop on Social Multimedia Research
    • Place of Presentation
      San Jone, CA, USA
    • Related Report
      2013 Final Research Report
  • [Presentation] Real-time Mobile Food Recognition System2013

    • Author(s)
      Yoshiyuki Kawano and Keiji Yanai
    • Organizer
      Proc. of CVPR Workshop on Mobile Vision
    • Place of Presentation
      Portland, OR, USA
    • Related Report
      2013 Final Research Report
  • [Presentation] Visual Analysis of Tag Co-occurrence on Nouns and Adjectives2013

    • Author(s)
      Yuya Kohaya and Keiji Yanai
    • Organizer
      Proc. of Multimedia Modelling Conference (MMM)
    • Place of Presentation
      Huangshan, China
    • Related Report
      2013 Final Research Report
  • [Presentation] Visual Analysis of Tag Co-occurrence on Nouns and Adjectives2013

    • Author(s)
      Yuya Kohaya and Keiji Yanai
    • Organizer
      Multimedia Modelling Conference (MMM)
    • Place of Presentation
      Huangshan, China
    • Related Report
      2012 Research-status Report
  • [Presentation] Visual Event Mining from Geo-Tweet Photos2013

    • Author(s)
      Takamu Kaneko and Keiji Yanai
    • Organizer
      ICME WS on Social Multimedia Research
    • Place of Presentation
      San Jone, CA, USA
    • Related Report
      2012 Research-status Report
  • [Presentation] Multiple-Food Recognition Considering Co-occurrence employing Manifold Ranking2012

    • Author(s)
      Yuji Matsuda and Keiji Yanai
    • Organizer
      Proc. of IAPR International Conference on Pattern Recognition (ICPR)
    • Place of Presentation
      Tsukuba, Japan
    • Related Report
      2013 Final Research Report
  • [Presentation] Real-time Mobile Recipe Suggestion System using Food Ingredient Recognition2012

    • Author(s)
      Takuma Maruyama and Keiji Yanai
    • Organizer
      ACM MM WS on Interactive Multimedia on Mobile and Portable Devices (IMMPD) Nara
    • Place of Presentation
      Japan
    • Related Report
      2013 Final Research Report
  • [Presentation] Visualization of Real-World Events with Tweet Photos2012

    • Author(s)
      Yusuke Nakaji and Keiji Yanai
    • Organizer
      Proc. of IEEE ICME Workshop on Social Media Computing
    • Place of Presentation
      Melbourn, Australia
    • Related Report
      2013 Final Research Report
  • [Presentation] Recognition of Multiple Food Images by Detecting Candidate Regions2012

    • Author(s)
      Yuji Matsuda and Keiji Yanai
    • Organizer
      Proc. of IEEE International Conference on Multimedia and Expo (ICME)
    • Place of Presentation
      Melbourn, Australia
    • Related Report
      2013 Final Research Report
  • [Presentation] Automatic Collection of Web Video Shots Corresponding to Specific Actions using Web Images2012

    • Author(s)
      Do Hang Nga and Keiji Yanai
    • Organizer
      Proc. of IEEE CVPR Workshop on Large-Scale Video Search and Mining
    • Place of Presentation
      Province, USA
    • Related Report
      2013 Final Research Report
  • [Presentation] World Seer : A Realtime Geo-Tweet Photo Mapping System2012

    • Author(s)
      Keiji Yanai
    • Organizer
      Proc. of ACM International Conference on Multimedia Retrieval (ICMR)
    • Place of Presentation
      Demo Paper, Hong Kong
    • Related Report
      2013 Final Research Report
  • [Presentation] World Seer : A Realtime Geo-Tweet Photo Mapping System2012

    • Author(s)
      Keiji Yanai
    • Organizer
      ACM International Conference on Multimedia Retrieval (ICMR)
    • Place of Presentation
      Hong Kong
    • Related Report
      2012 Research-status Report
  • [Presentation] Visualization of Real-World Events with Tweet Photos2012

    • Author(s)
      Yusuke Nakaji and Keiji Yanai
    • Organizer
      IEEE ICME Workshop on Social Media Computing
    • Place of Presentation
      Melbourn, Australia
    • Related Report
      2012 Research-status Report
  • [Presentation] A Travel Planning System Based on Travel Trajectories Extracted from a Large Number of Geotagged Photos on the Web2011

    • Author(s)
      Kohya Okuyama and Keiji Yanai
    • Organizer
      Proc. of Pacific-Rim Conference on Multimedia
    • Place of Presentation
      Sydney, Australia (PCM)
    • Related Report
      2013 Final Research Report
  • [Presentation] Automatic Construction of an Action Video Shot Database using Web Videos2011

    • Author(s)
      Do Hang Nga and Keiji Yanai
    • Organizer
      Proc. of IEEE International Conference on Computer Vision (ICCV)
    • Place of Presentation
      Barcelona, Spain
    • Related Report
      2013 Final Research Report
  • [Presentation] Automatic Construction of an Action Video Shot Database using Web Videos2011

    • Author(s)
      Do Hang Nga and Keiji Yanai
    • Organizer
      IEEE International Conference on Computer Vision (ICCV)(招待講演)
    • Place of Presentation
      Barcelona, Spain
    • Related Report
      2011 Research-status Report
  • [Presentation] A Travel Planning System Based on Travel Trajectories Extracted from a Large Number of Geotagged Photos on the Web2011

    • Author(s)
      Kohya Okuyama and Keiji Yanai
    • Organizer
      Pacific-Rim Conference on Multimedia
    • Place of Presentation
      Sydney, Australia
    • Related Report
      2011 Research-status Report
  • [Presentation] A Dense SURF and Triangulation based Spatio-Temporal Feature for Action Recognition

    • Author(s)
      Do Hang Nga and Keiji Yanai
    • Organizer
      International Multimedia Modeling Conference (MMM)
    • Place of Presentation
      Dublin, Ireland
    • Related Report
      2013 Annual Research Report
  • [Presentation] A Spatio-Temporal Feature based on Triangulation of Dense SURF

    • Author(s)
      Do Hang Nga and Keiji Yanai
    • Organizer
      ICCV Workshop on Action Recognition with a Large Number of Classes
    • Place of Presentation
      Sydney, Australia
    • Related Report
      2013 Annual Research Report
  • [Presentation] Automatic Collection of Web Video Shots Corresponding to Specific Actions using Web Images

    • Author(s)
      Do Hang Nga and Keiji Yanai
    • Organizer
      IEEE CVPR Workshop on Large-Scale Video Search and Mining
    • Place of Presentation
      Province, USA
    • Related Report
      2012 Research-status Report
  • [Book] Entropy-based Analysis of Visual Concepts, In "Multimedia Information Extraction"2012

    • Author(s)
      Keiji Yanai, Hidetoshi Kawakubo and Kobus Barnard
    • Publisher
      Wiley-IEEE CS Press
    • Related Report
      2013 Final Research Report
  • [Book] Multimedia Information Extraction2012

    • Author(s)
      Mark T. Maybury (Editor)
    • Total Pages
      496
    • Publisher
      Wiley-IEEE Computer Society Press
    • Related Report
      2011 Research-status Report
  • [Remarks]

    • URL

      http://mm.cs.uec.ac.jp/webvideo/

    • Related Report
      2013 Final Research Report
  • [Remarks] 100種類動作のWeb動画収集結果閲覧サイト

    • URL

      http://mm.cs.uec.ac.jp/webvideo/

    • Related Report
      2013 Annual Research Report

URL: 

Published: 2011-08-05   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi