A Study on Large-Scale Generic Object Recognition System for 1000-class Categorization

• Project/Area Number: 20680010
• Research Category: Grant-in-Aid for Young Scientists (A)
• Allocation Type: Single-year Grants
• Research Field: Perception information processing/Intelligent robotics
• Research Institution: The University of Electro-Communications
• Principal Investigator: YANAI Keiji 電気通信大学, 大学院・情報理工学研究科, 准教授 (20301179)
• Project Period (FY): 2008 – 2010
• Project Status: Completed (Fiscal Year 2010)
• Budget Amount: ¥24,310,000 (Direct Cost: ¥18,700,000、Indirect Cost: ¥5,610,000); Fiscal Year 2010: ¥9,880,000 (Direct Cost: ¥7,600,000、Indirect Cost: ¥2,280,000); Fiscal Year 2009: ¥5,850,000 (Direct Cost: ¥4,500,000、Indirect Cost: ¥1,350,000); Fiscal Year 2008: ¥8,580,000 (Direct Cost: ¥6,600,000、Indirect Cost: ¥1,980,000)
• Keywords: 一般物体認識 / 画像認識 / Webマルチメディアマイニング / 大量クラス / Web画像マイニング / メディア情報学 / 人工知能 / 画像認識システム

Research Abstract

In this research, we studied on large-scale generic object recognition system and related topics: (1) Construction of a 1000-category image database (2) Construction of an image ontology database with two million Web images (3) Food image recognition system for 100-category foods (4) Automatic construction of 100-kind action shot database (5) Analysis of relation between visual concepts and locations

Research Products

• [Journal Article] Folksonomyを用いた画像特徴とタグ共起に基づく画像オントロジーの自動構築 (2011)
  • Author(s): 秋間雄太, 川久保秀敏, 柳井啓司
  • Journal Title: 電子情報通信学会論文誌D Volume: Vol.J94-D, No.8 Pages: 1248-1259
  • NAID: 110008686476
• [Journal Article] 単語概念の視覚性と地理的分布の関係性の分析 (2010)
  • Author(s): 川久保秀敏, 柳井啓司
  • Journal Title: 電子情報通信学会論文誌D Volume: Vol.J93-D, No.8 Pages: 1417-1428
  • NAID: 110007681679
• [Journal Article] Multiple Kernel Learningによる50種類の食事画像の認識 (2010)
  • Author(s): 上東太一, 柳井啓司
  • Journal Title: 電子情報通信学会論文誌D Volume: Vol.J93-D, No.8 Pages: 1397-1406
  • NAID: 110007681672
• [Journal Article] Associating faces and names in Japanese photo news articles (2010)
  • Author(s): Akio Kitahara, Keiji Yanai
  • Journal Title: Progressin Informatics Volume: No.7 Pages: 73-70
• [Journal Article] Associating Faces and Names in Japanese Photo News Articles on the Web (2010)
  • Author(s): Akio Kitahara, Keiji Yanai
  • Journal Title: Progress in Informatics No.7 Pages: 63-70
  • Peer Reviewed
• [Journal Article] Web Image Selection by PLSA (2008)
  • Author(s): Keiji Yanai
  • Journal Title: Proc. of the International Conference on Multimedia and Expo 1 Pages: 1373-1376
  • Peer Reviewed
• [Journal Article] Automatic Web Image Selection with a Probabilistic Latent Topic Model (2008)
  • Author(s): Keiji Yanai
  • Journal Title: Proc. of the Seventeenth International World Wide Web Conference 1 Pages: 1237-1238
  • Peer Reviewed
• [Journal Article] Objects over the World (2008)
  • Author(s): Bingyu Qiu and Keiji Yanai
  • Journal Title: Proc. of the Pacific-Rim Conference on Multimedia (Springer LNCS) 5353 Pages: 396-305
  • Peer Reviewed
• [Presentation] A Travel Planning System Based on Travel Trajectories Extracted from a Large Number of Geotagged Photos on the Web (2011)
  • Author(s): Kohya Okuyama, Keiji Yanai
  • Organizer: Proc. of Pacific-Rim Conference Multimedia
  • Place of Presentation: Sydney, Australia
• [Presentation] Automatic Construction of an Action Video Shot Database using Web Videos (2011)
  • Author(s): Do Hang Nga, Keiji Yanai
  • Organizer: Proc. of IEEE International Conference on Computer Vision (ICCV)
  • Place of Presentation: Barcelona, Spain
• [Presentation] Geo Visual Rank: A Ranking Method of Geotagged Images Considering Visual Similarity and Geo-location Proximity (2011)
  • Author(s): Hidetoshi Kawakubo, Keiji Yanai
  • Organizer: Proc. of the Nineteenth International World Wide Web Conference (WWW)
  • Place of Presentation: Hyderabad, India
• [Presentation] GeoVisualRank : A Ranking Method of Geotagged Images Considering Visual Similarity and Geo-location Proximity (2011)
  • Author(s): Hidetoshi Kawakubo, Keiji Yanai
  • Organizer: ACM International World Wide Web Conference (WWW)
  • Place of Presentation: Hyderabad, India
• [Presentation] Automatic Construction of an Action Video Shot Database using Web Videos (2011)
  • Author(s): Do Hang Nga, Keiji Yanai
  • Organizer: IEEE International Conference on Computer Vision (ICCV)
  • Place of Presentation: Barcelona, Spain
• [Presentation] A Travel Planning System Based on Travel Trajectories Extracted from a Large Number of Geotagged Photos on the Web (2011)
  • Author(s): Kohya Okuyama, Keiji Yanai
  • Organizer: Pacific-Rim Conference on Multimedia
  • Place of Presentation: Sydney, Australia
• [Presentation] 一般物体認識技術の発展 (2011)
  • Author(s): 柳井啓司
  • Organizer: 精密工学会画像応用技術専門委員会研究会
  • Place of Presentation: 東京(招待講演)
• [Presentation] 物体認識技術を用いた食事画像認識 (2011)
  • Author(s): 柳井啓司
  • Organizer: 人工知能セミナー「食とAI～消費・小売流通・生産の立場から～」
  • Place of Presentation: 東京(招待講演)
• [Presentation] Webマルチメディアと物体認識 (2011)
  • Author(s): 柳井啓司
  • Organizer: 電子情報通信学会パターン認識・メディア理解研究会
  • Place of Presentation: 千葉(招待講演)
• [Presentation] Region-based Automatic Web Image Selection (2010)
  • Author(s): Keiji Yanai, Kobus Barnard
  • Organizer: ACM International Conference on Multimedia Information Retrieval
  • Place of Presentation: Philadelphia, USA
  • Year and Date: 2010-03-28
• [Presentation] Geotagged Image Recognition by Combining Three Different Kinds of Geolocation Features (2010)
  • Author(s): Keita Yaegashi, Keiji Yanai
  • Organizer: Proc. of Asian Conference on Computer Vision (ACCV)
  • Place of Presentation: Queenstown, New Zealand
• [Presentation] A SURF-based Spatio-Temporal Feature for Feature-fusion-based Action Recognition (2010)
  • Author(s): Akitsugu Noguchi, Keiji Yanai
  • Organizer: Proc. of ECCV WS on Human Motion: Understanding, Modeling, Capture and Animation
  • Place of Presentation: Crete, Greece
• [Presentation] Geotagged Photo Recognition using Corresponding Aerial Photos with Multiple Kernel Learning (2010)
  • Author(s): Keita Yaegashi, Keiji Yanai
  • Organizer: Proc. of IAPR International Conference Pattern Recognition (ICPR)
  • Place of Presentation: Istanbul, Turkey
• [Presentation] Region-based Automatic Web Image Selection (2010)
  • Author(s): Keiji Yanai, Kobus Barnard
  • Organizer: Proc. of ACM International Conference on Multimedia Information Retrieval (MIR)
  • Place of Presentation: Philadelphia, USA
• [Presentation] Geotagged Photo Recognition using Corresponding Aerial Photos with Multiple Kernel Learning (2010)
  • Author(s): Keita Yaegashi, Keiji Yanai
  • Organizer: IAPR International Conference on Pattern Recognition (ICPR)
  • Place of Presentation: Istanbul, Turkey
• [Presentation] Geotagged Image Recognition by Combining Three Different Kinds of Geolocation Features (2010)
  • Author(s): Keita Yaegashi, Keiji Yanai
  • Organizer: Asian Conference on Computer Vision (ACCV)
  • Place of Presentation: Queenstown, New Zealand
• [Presentation] A SURF-based Spatio-Temporal Feature for Feature-fusion-based Action Recognition (2010)
  • Author(s): Akitsugu Noguchi, Keiji Yanai
  • Organizer: ECCV WS on Human Motion : Understanding, Modeling, Capture and Animation
  • Place of Presentation: Crete, Greece
• [Presentation] 一般物体認識における機械学習の利用 (2010)
  • Author(s): 柳井啓司
  • Organizer: 電子情報通信学会情報論的学習と機械学習研究会(IBIS-ML)
  • Place of Presentation: 東京(招待講演)
• [Presentation] 画像・映像の認識と意味的検索 (2010)
  • Author(s): 柳井啓司
  • Organizer: 電子情報通信学会音声研究会(SP)
  • Place of Presentation: 仙台(招待講演)
• [Presentation] Detecting "In-play" Photos from Web Sports News Photos (2009)
  • Author(s): Akio Kitahara, Keiji Yanai
  • Organizer: Pacific-Rim Conference on Multimedia
  • Place of Presentation: Bangkok, Thailand
  • Year and Date: 2009-12-16
• [Presentation] チュートリアル 一般物体認識 (2009)
  • Author(s): 柳井啓司
  • Organizer: 電子情報通信学会パターン認識・メディア理解研究会
  • Place of Presentation: 金沢
  • Year and Date: 2009-11-26
• [Presentation] A Food Image Recognition System with Multiple Kernel Learning (2009)
  • Author(s): Taichi Joutou, Keiji Yanai
  • Organizer: International Conference on Image Processing
  • Place of Presentation: Cairo, Egypt
  • Year and Date: 2009-11-08
• [Presentation] Extracting Spatio-temporal Local Features Considering Consecutiveness of Motions (2009)
  • Author(s): Akitsugu Noguchi, Keiji Yanai
  • Organizer: Asian Conference on Computer Vision
  • Place of Presentation: Xian, China
  • Year and Date: 2009-09-24
• [Presentation] A Visual Analysis of the Relationship between Word Concepts and Geographical Locations (2009)
  • Author(s): Keiji Yanai, Hidetoshi Kawakubo, Qiu Bingyu
  • Organizer: ACM International Conference of Image and Video Retrieval
  • Place of Presentation: Santorini, Greece
  • Year and Date: 2009-07-09
• [Presentation] An Analysis of the Relation between Visual Concepts and Geo-locations using Geotagged Images on the Web (2009)
  • Author(s): Hidetoshi Kawakubo, Keiji Yanai
  • Organizer: IEEE ICME WS on Internet Multimedia Search and Mining
  • Place of Presentation: New York, USA
  • Year and Date: 2009-07-03
• [Presentation] Web Image Gathering with Region-based Bag-of-Features and Multiple Instance Learning (2009)
  • Author(s): 柳井啓司
  • Organizer: IEEE International Conference on Multimedia and Expo
  • Place of Presentation: New York, USA
  • Year and Date: 2009-07-01
• [Presentation] Mining Cultural Differences from a Large Number of Geotagged Photo (2009)
  • Author(s): Keiji Yanai, Bingyu Qiu
  • Organizer: International World Wide Web Conference
  • Place of Presentation: Madrid, Spain
  • Year and Date: 2009-04-22
• [Presentation] Multiple Kernel Learningを用いた食べ物画像の認識 (2009)
  • Author(s): 上東太一, 柳井啓司
  • Organizer: 情報処理学会イメージメディア研究会
  • Place of Presentation: 仙台
  • Year and Date: 2009-03-13
• [Presentation] Detecting "In-play" Photos from Web Sports News Photos (2009)
  • Author(s): Akio Kitahara, Keiji Yanai
  • Organizer: Proc. of the Pacific-Rim Conference on Multimedia
  • Place of Presentation: Bangkok, Thailand
• [Presentation] A Food Image Recognition System with Multiple Kernel Learning (2009)
  • Author(s): Taichi Joutou, Keiji Yanai
  • Organizer: Proc. of International Conference on Image Processing (ICIP)
  • Place of Presentation: Cairo, Egypt
• [Presentation] Extracting Spatio-temporal Local Features Considering Consecutiveness of Motions (2009)
  • Author(s): Akitsugu Noguchi, Keiji Yanai
  • Organizer: Proc. of Asian Conference on Computer Vision (ACCV)
  • Place of Presentation: Xian, China
• [Presentation] A Visual Analysis of the Relationship between Word Concepts and Geographical LocationsA Visual Analysis of the Relationship between Word Concepts and Geographical Locations (2009)
  • Author(s): Keiji Yanai, Hidetoshi Kawakubo, Qiu Bingyu
  • Organizer: Proc. of ACM International Conference of Imageand Video Retrieval (CIVR)
  • Place of Presentation: Santorini, Greece
• [Presentation] Web Image Gathering with Region-based Bag-of-Features and Multiple Instance Learning (2009)
  • Author(s): Keiji Yanai
  • Organizer: IEEE International Conference on Multimedia and Expo (ICME)
  • Place of Presentation: New York, USA
• [Presentation] Can Geotags Help Image Recognition ? (2009)
  • Author(s): Keita Yaegashi, Keiji Yanai
  • Organizer: Proc. of Pacific-Rim Symposium on Image and Video Technology
  • Place of Presentation: Tokyo, Japan
• [Presentation] Objects over the World (2008)
  • Author(s): Bingyu Qiu, Keiji Yanai
  • Organizer: Proc. of the Pacific-Rim Conference on Multimedia
  • Place of Presentation: Tainan, Taiwan
• [Presentation] Rushes Summarization Based on Color Motion and Face (2008)
  • Author(s): Akitsugu Noguchi, Keiji yanai
  • Organizer: Proc. of ACMMM Workshop on Summarization
  • Place of Presentation: TRECVID Vancouver, Rush Canada
• [Book] Entropy-based Analysis of Visual Concepts, In "Multimedia Information Extraction" (2012)
  • Author(s): Keiji Yanai, Hidetoshi Kawakubo, Kobus Barnard
  • Publisher: Wiley-IEEE Computer Society Press
• [Book] Mining Regional Representative Photos from a Consumer-Generated Geotagged Photo Database, In "Handbook of Social Network Technologies and Applications" (2010)
  • Author(s): Keiji Yanai, Bingyu Qiu
  • Publisher: Springer
• [Book] Handbook of Social Network Technologies and Applications (2010)
  • Author(s): Keiji Yanai, Bingyu Qiu
  • Total Pages: 716
  • Publisher: Springer
• [Book] コンピュータビジョン最先端ガイドIII (2010)
  • Author(s): 柳井啓司
  • Total Pages: 185
  • Publisher: アドコム・メディア株式会社
• [Book] Handbook of Social Networks (2010)
  • Author(s): Keiji Yanai, Bingyu Qiu
  • Total Pages: 400
  • Publisher: Springer(予定)
• [Remarks]
  • URL: http://mm.cs.uec.ac.jp/
• [Remarks]
  • URL: https://twitter.jp/foodimg_bot/
• [Remarks]
  • URL: http://mm.cs.uec.ac.jp/
• [Patent(Industrial Property Rights)] 画像ランキング方法、プログラム及び記憶媒体並びに画像表示システム (2010)
  • Inventor(s): 川久保秀敏, 柳井啓司
  • Industrial Property Rights Holder: 電気通信大学
  • Industrial Property Number: 2010-109454
  • Filing Date: 2010-05-11
• [Patent(Industrial Property Rights)] 画像ランキング方法、プログラム及び記憶媒体並びに画像表示システム (2010)
  • Inventor(s): 川久保秀敏,柳井啓司
  • Industrial Property Rights Holder: 電気通信大学
  • Industrial Property Number: 2010-109454
  • Filing Date: 2010-05-11
• [Patent(Industrial Property Rights)] 画像処理方法、その方法を実行するプログラム、記憶媒体、撮像機器、画像処理システム (2008)
  • Inventor(s): 柳井啓司
  • Industrial Property Rights Holder: 電気通信大学
  • Industrial Property Number: 2008-106546
  • Filing Date: 2008-04-16