A Study on Large-Scale Generic Object Recognition System for 1000-class Categorization

2010 Fiscal Year Final Research Report

• Project/Area Number: 20680010
• Research Category: Grant-in-Aid for Young Scientists (A)
• Allocation Type: Single-year Grants
• Research Field: Perception information processing/Intelligent robotics
• Research Institution: The University of Electro-Communications
• Principal Investigator: YANAI Keiji 電気通信大学, 大学院・情報理工学研究科, 准教授 (20301179)
• Project Period (FY): 2008 – 2010
• Keywords: 一般物体認識 / 画像認識 / Webマルチメディアマイニング

Research Abstract

In this research, we studied on large-scale generic object recognition system and related topics: (1) Construction of a 1000-category image database (2) Construction of an image ontology database with two million Web images (3) Food image recognition system for 100-category foods (4) Automatic construction of 100-kind action shot database (5) Analysis of relation between visual concepts and locations

Research Products

• [Journal Article] Folksonomyを用いた画像特徴とタグ共起に基づく画像オントロジーの自動構築 (2011)
  • Author(s): 秋間雄太, 川久保秀敏, 柳井啓司
  • Journal Title: 電子情報通信学会論文誌D Volume: Vol.J94-D, No.8 Pages: 1248-1259
• [Journal Article] 単語概念の視覚性と地理的分布の関係性の分析 (2010)
  • Author(s): 川久保秀敏, 柳井啓司
  • Journal Title: 電子情報通信学会論文誌D Volume: Vol.J93-D, No.8 Pages: 1417-1428
• [Journal Article] Multiple Kernel Learningによる50種類の食事画像の認識 (2010)
  • Author(s): 上東太一, 柳井啓司
  • Journal Title: 電子情報通信学会論文誌D Volume: Vol.J93-D, No.8 Pages: 1397-1406
• [Journal Article] Associating faces and names in Japanese photo news articles (2010)
  • Author(s): Akio Kitahara, Keiji Yanai
  • Journal Title: Progressin Informatics Volume: No.7 Pages: 73-70
• [Presentation] A Travel Planning System Based on Travel Trajectories Extracted from a Large Number of Geotagged Photos on the Web (2011)
  • Author(s): Kohya Okuyama, Keiji Yanai
  • Organizer: Proc. of Pacific-Rim Conference Multimedia
  • Place of Presentation: Sydney, Australia
  • Year and Date: 20111200
• [Presentation] Automatic Construction of an Action Video Shot Database using Web Videos (2011)
  • Author(s): Do Hang Nga, Keiji Yanai
  • Organizer: Proc. of IEEE International Conference on Computer Vision (ICCV)
  • Place of Presentation: Barcelona, Spain
  • Year and Date: 20111100
• [Presentation] Geo Visual Rank: A Ranking Method of Geotagged Images Considering Visual Similarity and Geo-location Proximity (2011)
  • Author(s): Hidetoshi Kawakubo, Keiji Yanai
  • Organizer: Proc. of the Nineteenth International World Wide Web Conference (WWW)
  • Place of Presentation: Hyderabad, India
  • Year and Date: 20110300
• [Presentation] Geotagged Image Recognition by Combining Three Different Kinds of Geolocation Features (2010)
  • Author(s): Keita Yaegashi, Keiji Yanai
  • Organizer: Proc. of Asian Conference on Computer Vision (ACCV)
  • Place of Presentation: Queenstown, New Zealand
  • Year and Date: 20101100
• [Presentation] A SURF-based Spatio-Temporal Feature for Feature-fusion-based Action Recognition (2010)
  • Author(s): Akitsugu Noguchi, Keiji Yanai
  • Organizer: Proc. of ECCV WS on Human Motion: Understanding, Modeling, Capture and Animation
  • Place of Presentation: Crete, Greece
  • Year and Date: 20100900
• [Presentation] Geotagged Photo Recognition using Corresponding Aerial Photos with Multiple Kernel Learning (2010)
  • Author(s): Keita Yaegashi, Keiji Yanai
  • Organizer: Proc. of IAPR International Conference Pattern Recognition (ICPR)
  • Place of Presentation: Istanbul, Turkey
  • Year and Date: 20100800
• [Presentation] Region-based Automatic Web Image Selection (2010)
  • Author(s): Keiji Yanai, Kobus Barnard
  • Organizer: Proc. of ACM International Conference on Multimedia Information Retrieval (MIR)
  • Place of Presentation: Philadelphia, USA
  • Year and Date: 20100300
• [Presentation] Detecting "In-play" Photos from Web Sports News Photos (2009)
  • Author(s): Akio Kitahara, Keiji Yanai
  • Organizer: Proc. of the Pacific-Rim Conference on Multimedia
  • Place of Presentation: Bangkok, Thailand
  • Year and Date: 20091200
• [Presentation] A Food Image Recognition System with Multiple Kernel Learning (2009)
  • Author(s): Taichi Joutou, Keiji Yanai
  • Organizer: Proc. of International Conference on Image Processing (ICIP)
  • Place of Presentation: Cairo, Egypt
  • Year and Date: 20091100
• [Presentation] Extracting Spatio-temporal Local Features Considering Consecutiveness of Motions (2009)
  • Author(s): Akitsugu Noguchi, Keiji Yanai
  • Organizer: Proc. of Asian Conference on Computer Vision (ACCV)
  • Place of Presentation: Xian, China
  • Year and Date: 20090900
• [Presentation] A Visual Analysis of the Relationship between Word Concepts and Geographical LocationsA Visual Analysis of the Relationship between Word Concepts and Geographical Locations (2009)
  • Author(s): Keiji Yanai, Hidetoshi Kawakubo, Qiu Bingyu
  • Organizer: Proc. of ACM International Conference of Imageand Video Retrieval (CIVR)
  • Place of Presentation: Santorini, Greece
  • Year and Date: 20090700
• [Presentation] Web Image Gathering with Region-based Bag-of-Features and Multiple Instance Learning (2009)
  • Author(s): Keiji Yanai
  • Organizer: IEEE International Conference on Multimedia and Expo (ICME)
  • Place of Presentation: New York, USA
  • Year and Date: 20090700
• [Presentation] Can Geotags Help Image Recognition ? (2009)
  • Author(s): Keita Yaegashi, Keiji Yanai
  • Organizer: Proc. of Pacific-Rim Symposium on Image and Video Technology
  • Place of Presentation: Tokyo, Japan
  • Year and Date: 20090100
• [Presentation] Objects over the World (2008)
  • Author(s): Bingyu Qiu, Keiji Yanai
  • Organizer: Proc. of the Pacific-Rim Conference on Multimedia
  • Place of Presentation: Tainan, Taiwan
  • Year and Date: 20081200
• [Presentation] Rushes Summarization Based on Color Motion and Face (2008)
  • Author(s): Akitsugu Noguchi, Keiji yanai
  • Organizer: Proc. of ACMMM Workshop on Summarization
  • Place of Presentation: TRECVID Vancouver, Rush Canada
  • Year and Date: 20081000
• [Book] Entropy-based Analysis of Visual Concepts, In "Multimedia Information Extraction" (2012)
  • Author(s): Keiji Yanai, Hidetoshi Kawakubo, Kobus Barnard
  • Publisher: Wiley-IEEE Computer Society Press
• [Book] Mining Regional Representative Photos from a Consumer-Generated Geotagged Photo Database, In "Handbook of Social Network Technologies and Applications" (2010)
  • Author(s): Keiji Yanai, Bingyu Qiu
  • Publisher: Springer
• [Remarks]
  • URL: http://mm.cs.uec.ac.jp/
• [Remarks]
  • URL: https://twitter.jp/foodimg_bot/
• [Patent(Industrial Property Rights)] 画像ランキング方法、プログラム及び記憶媒体並びに画像表示システム (2010)
  • Inventor(s): 川久保秀敏, 柳井啓司
  • Industrial Property Rights Holder: 電気通信大学
  • Industrial Property Number: 特許, 特願2010-109454
  • Filing Date: 2010-05-11
• [Patent(Industrial Property Rights)] 画像処理方法、その方法を実行するプログラム、記憶媒体、撮像機器、画像処理システム (2008)
  • Inventor(s): 柳井啓司
  • Industrial Property Rights Holder: 電気通信大学
  • Industrial Property Number: 特許, 特願2008-106546
  • Filing Date: 2008-04-16