• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Personalized Recognition, Prediction, Retrieval of Food Log

Research Project

Project/Area Number 18H03254
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 61010:Perceptual information processing-related
Research InstitutionThe University of Tokyo

Principal Investigator

Aizawa Kiyoharu  東京大学, 大学院情報理工学系研究科, 教授 (20192453)

Project Period (FY) 2018-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥17,420,000 (Direct Cost: ¥13,400,000、Indirect Cost: ¥4,020,000)
Fiscal Year 2020: ¥5,330,000 (Direct Cost: ¥4,100,000、Indirect Cost: ¥1,230,000)
Fiscal Year 2019: ¥5,200,000 (Direct Cost: ¥4,000,000、Indirect Cost: ¥1,200,000)
Fiscal Year 2018: ¥6,890,000 (Direct Cost: ¥5,300,000、Indirect Cost: ¥1,590,000)
Keywordsマルチメディア / 画像認識 / 食事画像認識 / 食事記録 / パーソナリゼーション / 食事調査 / 栄養指導 / パーソナライゼーション / パーソナライズ認識 / 食材カテゴリー予測 / 食傾向
Outline of Final Research Achievements

In this study, to reduce the burden of food recording, we have advanced the personalization of the food recording technology based on image recognition, and built foundation of technology for recognizing meal photos and analyzing the records of specific persons. Based on these technologies, we have developed and are operating a new food recording tool suitable for nutritional guidance and food surveys. We have achieved the following research results. (1) Personalized food image recognition, (2) Personalized food recognition considering time dependency and item dependency, (3) Boosting personalized food recognition by sharing data with others, (4) Prediction and visualization of ingredient categories, (5) Development, release, operation, and improvement of the new FoodLog (FoodLog_Athl) (6) Verification of the new FoodLog through the use of nutritional guidance (7) Survey of diet and health by the new FoodLog.

Academic Significance and Societal Importance of the Research Achievements

本研究で開拓した技術は、食事記録の支援の高度化に資する。食事記録技術の精度、カバレッジを上げるために、パーソナリゼーションが本質的に重要な役割を果たすことを明らかとした。さらに、本研究の一部で構築した新しいツールであるFoodLog_Athlは、ユーザのみならず管理栄養士の利用を重視した新しいコンセプトに基づき、管理栄養士の栄養指導業務に直接利用可能なものであり、その利用が進められ、検証が進んでいる。

Report

(4 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • Research Products

    (49 results)

All 2021 2020 2019 2018 Other

All Int'l Joint Research (1 results) Journal Article (14 results) (of which Open Access: 7 results,  Peer Reviewed: 13 results) Presentation (27 results) (of which Int'l Joint Research: 1 results,  Invited: 10 results) Book (1 results) Remarks (6 results)

  • [Int'l Joint Research] National University of Singapore(シンガポール)

    • Related Report
      2018 Annual Research Report
  • [Journal Article] 食とICTの動向:マルチメディア処理の観点から -ユーザと管理栄養士のための新しい食事記録ツール2020

    • Author(s)
      相澤清晴
    • Journal Title

      電子情報通信学会誌

      Volume: 103 Pages: 876-882

    • Related Report
      2020 Annual Research Report
    • Open Access
  • [Journal Article] Multi-task Curriculum Framework for Open-Set Semi-supervised Learning2020

    • Author(s)
      Yu Qing、Ikami Daiki、Irie Go、Aizawa Kiyoharu
    • Journal Title

      EUROPEAN CONFERENCE ON COMPUTER VISION

      Volume: 1 Pages: 438-454

    • DOI

      10.1007/978-3-030-58610-2_26

    • ISBN
      9783030586096, 9783030586102
    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Unknown Class Label Cleaning For Learning With Open-Set Noisy Labels2020

    • Author(s)
      Yu Qing、Aizawa Kiyoharu
    • Journal Title

      IEEE International Conference on Image Processing

      Volume: 1 Pages: 1731-1735

    • DOI

      10.1109/icip40778.2020.9190652

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Noisy Localization Annotation Refinement For Object Detection2020

    • Author(s)
      Mao Jiafeng、Yu Qing、Aizawa Kiyoharu
    • Journal Title

      IEEE International Conference on Image Processing

      Volume: 1 Pages: 2006-2010

    • DOI

      10.1109/icip40778.2020.9190728

    • NAID

      130008082148

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Unsupervised Embedding Learning by Noisy Similarity Label Optimization2020

    • Author(s)
      Tsubota Koki、Aizawa Kiyoharu
    • Journal Title

      IEEE International Conference on Visual Communication and Image Processing

      Volume: 1 Pages: 247-250

    • DOI

      10.1109/vcip49819.2020.9301761

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Aleatoric Uncertainty Estimation Using a Separate Formulation with Virtual Residuals2020

    • Author(s)
      Takumi Kawashima, Qing Yu, Akari Asai, Daiki Ikami, Kiyoharu Aizawa
    • Journal Title

      International Conference on Pattern Recognition

      Volume: 1

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Personalized Food Image Classifier Considering Time-Dependent and Item-Dependent Food Distribution2019

    • Author(s)
      YU Qing、ANZAWA Masashi、AMANO Sosuke、AIZAWA Kiyoharu
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E102.D Issue: 11 Pages: 2120-2126

    • DOI

      10.1587/transinf.2019PCP0005

    • NAID

      130007740397

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2019-11-01
    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Recognition of Multiple Food Items in A Single Photo for Use in A Buffet-Style Restaurant2019

    • Author(s)
      Masashi ANZAWA, Sosuke AMANO, Yoko YAMAKATA, Keiko MOTONAGA, Akiko KAMEI, Kiyoharu AIZAWA
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E102.D Issue: 2 Pages: 410-414

    • DOI

      10.1587/transinf.2018EDL8183

    • NAID

      130007589314

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2019-02-01
    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Significance of Softmax-based Features in Comparison to Distance Metric Learning-based Features2019

    • Author(s)
      Horiguchi Shota、Ikami Daiki、Aizawa Kiyoharu
    • Journal Title

      IEEE Transactions on Pattern Analysis and Machine Intelligence

      Volume: 42 Pages: 1-1

    • DOI

      10.1109/tpami.2019.2911075

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Unsupervised Out-of-Distribution Detection by Maximum Classifier Discrepancy2019

    • Author(s)
      Yu Qing、Aizawa Kiyoharu
    • Journal Title

      Int. Conf. Computer Vision (ICCV)

      Volume: 1 Pages: 9518-9526

    • DOI

      10.1109/iccv.2019.00961

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Personalized Classifier for Food Image Recognition2018

    • Author(s)
      Horiguchi Shota、Amano Sosuke、Ogawa Makoto、Aizawa Kiyoharu
    • Journal Title

      IEEE Transactions on Multimedia

      Volume: 20 Issue: 10 Pages: 2836-2848

    • DOI

      10.1109/tmm.2018.2814339

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Bag-of-foods: analysis of personal foodlogging data2018

    • Author(s)
      Goda Yuji、Amano Sosuke、Yamakata Yoko、Aizawa Kiyoharu
    • Journal Title

      IJCAI Joint Workshop on Multimedia for Cooking and Eating Activities and Multimedia Assisted Dietary Management

      Volume: 1 Pages: 63-66

    • DOI

      10.1145/3230519.3230596

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Resource intensity for menu items: how much land is required to provide for each dish?2018

    • Author(s)
      Yamamata Yoko、Yamasue Eiji、McLellan Benjamin、Aizawa Kiyoharu
    • Journal Title

      IJCAI Joint Workshop on Multimedia for Cooking and Eating Activities and Multimedia Assisted Dietary Management

      Volume: 1 Pages: 15-20

    • DOI

      10.1145/3230519.3230585

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Food Image Recognition by Personalized Classifier2018

    • Author(s)
      Yu Qing、Anzawa Masashi、Amano Sosuke、Ogawa Makoto、Aizawa Kiyoharu
    • Journal Title

      IEEE International Conference on Image Processing

      Volume: 1 Pages: 171-175

    • DOI

      10.1109/icip.2018.8451422

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Presentation] 食事記録・調査のためのマルチメディアツール:FoodLog_Athl2021

    • Author(s)
      相澤清晴
    • Organizer
      超臨場感コミュニケーション産学官フォーラム
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] 栄養指導・食事調査のための食事記録ツール:FoodLog_Athl2021

    • Author(s)
      相澤清晴
    • Organizer
      日本肥満学会/日本肥満症治療学術集会
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] 食事記録・調査のためのマルチメディアツール:FoodLogAthl2020

    • Author(s)
      相澤清晴
    • Organizer
      日本官能評価学会2020 年大会
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] 食と情報処理のこれまでとこれから -食メディア研究会の活動を振り返りながら語る未来-2020

    • Author(s)
      相澤清晴
    • Organizer
      電子情報通信学会 HCGシンポジウム
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] 食事記録分析による長期外出自粛の主観的健康度への影響調査2020

    • Author(s)
      石野耀久,唐澤弘明,天野宗佑,山肩洋子,相澤清晴
    • Organizer
      電子情報通信学会ライフインテリジェンスとオフィス情報システム研究会
    • Related Report
      2020 Annual Research Report
  • [Presentation] Training Object Detectors with Noisy Localization Annotation Refinement2020

    • Author(s)
      Jiafeng Mao, Qing Yu and Kiyoharu Aizawa
    • Organizer
      画像の認識・理解シンポジウム(MIRU)
    • Related Report
      2020 Annual Research Report
  • [Presentation] 分離定式化に基づく不確かさの推定2020

    • Author(s)
      川島拓海, 郁青, 伊神大貴, 浅井明里, 相澤清晴
    • Organizer
      画像の認識・理解シンポジウム(MIRU)
    • Related Report
      2020 Annual Research Report
  • [Presentation] Open-Set Semi-Supervised Learning with Multi-Task Curriculum Framework2020

    • Author(s)
      Qing Yu, Daiki Ikami, Go Irie and Kiyoharu Aizawa
    • Organizer
      画像の認識・理解シンポジウム(MIRU)
    • Related Report
      2020 Annual Research Report
  • [Presentation] 食事記録データからの健康度予測の検討とデータ取得2020

    • Author(s)
      石野耀久、唐澤弘明、川原田美雪、天野宗佑、山肩洋子、相澤清晴
    • Organizer
      データ工学と情報マネジメントに関するフォーラム DEIM Forum 2020
    • Related Report
      2019 Annual Research Report
  • [Presentation] マルチタスクカリキュラム学習によるオープンセット半教師あり認識2020

    • Author(s)
      郁青, 入江豪, 相澤清晴
    • Organizer
      電子情報通信学会 画像工学研究会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 食習慣理解に向けた大規模レシピを用いた食事記録の解析2020

    • Author(s)
      川原田美雪、唐澤弘明、坂本美沙子、天野宗佑、山肩洋子、相澤清晴
    • Organizer
      電子情報通信学会 ライフインテリジェンスとオフィス情報システム研究会
    • Related Report
      2019 Annual Research Report
  • [Presentation] FoodLogの10年2020

    • Author(s)
      相澤清晴
    • Organizer
      電子情報通信学会 総合大会
    • Related Report
      2019 Annual Research Report
    • Invited
  • [Presentation] FoodLog: Multimedia Food Recording Platform and its Application2019

    • Author(s)
      Kiyoharu Aizawa
    • Organizer
      ACM Multimedia Workshop Multimedia Assisted Dietary Management
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 大規模レシピデータとテキストベースの食事記録に基づくアスリートの食傾向分析2019

    • Author(s)
      川原田美雪、唐澤弘明、坂本美沙子、天野宗佑、山肩洋子、相澤清晴
    • Organizer
      電子情報通信学会 ライフインテリジェンスとオフィス情報システム研究会
    • Related Report
      2019 Annual Research Report
  • [Presentation] Classifier Discrepancy Maximization for Unsupervised Out-of-Distribution Detection2019

    • Author(s)
      Qing Yu, Kiyoharu Aizawa
    • Organizer
      画像の認識・理解シンポジウム(MIRU2019)
    • Related Report
      2019 Annual Research Report
  • [Presentation] FoodLog : マルチメディア食事記録ツールとそのデータ処理 ―運動選手の栄養管理のための新しいツール開発―2019

    • Author(s)
      相澤清晴
    • Organizer
      日本スポーツ栄養学会 第6回大会
    • Related Report
      2019 Annual Research Report
    • Invited
  • [Presentation] アスリートと管理栄養士の食事管理支援システム2019

    • Author(s)
      相澤清晴
    • Organizer
      東京大学スポーツ先端科学研究拠点 研究交流会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 日常の食事を記録するFoodLog2019

    • Author(s)
      相澤清晴
    • Organizer
      情報処理学会 コンピュータビジョンとイメージメディア研究会
    • Related Report
      2019 Annual Research Report
    • Invited
  • [Presentation] 食事名とレシピデータとのマッチングによるアスリートの食傾向分析2019

    • Author(s)
      川原田美雪,唐澤弘明,坂本美沙子,天野宗祐,山肩洋子,相澤清晴
    • Organizer
      日本スポーツ栄養学会 第6回大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 大規模レシピに基づく食事記録のカテゴリ推定による食物摂取頻度解析:アスリートを対象にした実践2019

    • Author(s)
      川原田美雪,唐澤弘明,坂本美沙子,天野宗祐,山肩洋子,相澤清晴
    • Organizer
      情報科学技術フォーラム、FIT2019
    • Related Report
      2019 Annual Research Report
  • [Presentation] 大規模食事記録データと深層学習モデルによる食習慣ベクトル化手法の検討2019

    • Author(s)
      合田悠治、天野宗佑、山肩洋子、相澤清晴
    • Organizer
      映像情報メディア学会 メディア工学研究会
    • Related Report
      2018 Annual Research Report
  • [Presentation] アスリートの食事管理を支援するフードコンサルティングシステム2019

    • Author(s)
      唐澤弘明、川原田美雪、天野宗佑、山肩洋子、相澤清晴
    • Organizer
      電子情報通信学会 総合大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] FoodxIT マルチメディア食事記録2019

    • Author(s)
      相澤清晴
    • Organizer
      国立栄養・健康研究所 講演会
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Presentation] Personalized Food Image Recognition2018

    • Author(s)
      Qing Yu, Masashi Anzawa, Sosuke Amano, Kiyoharu Aizawa
    • Organizer
      画像の認識・理解シンポジウム
    • Related Report
      2018 Annual Research Report
  • [Presentation] 大規模食事記録データの栄養価クラスタリングに基づく食習慣ベクトルBag-of-Foodsとその検証2018

    • Author(s)
      合田悠治、天野宗祐、山肩洋子、相澤清晴
    • Organizer
      情報科学技術フォーラム
    • Related Report
      2018 Annual Research Report
  • [Presentation] 管理栄養士とアスリートのためのフードコンサルティングシステム2018

    • Author(s)
      唐澤弘明、川原田美雪、山肩洋子、相澤清晴
    • Organizer
      映像情報メディア学会 冬季大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] Food x IT マルチメディア食事記録2018

    • Author(s)
      相澤清晴
    • Organizer
      東京大学 教養学部 学術フロンティア講義
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Book] Connected Health in Smart Cities (Chap.1)2020

    • Author(s)
      Kiyoharu Aizawa (El Saddik, Abdulmotaleb, Hossain, M. Shamim, Kantarci, Burak)
    • Total Pages
      254
    • Publisher
      Springer
    • Related Report
      2020 Annual Research Report 2019 Annual Research Report
  • [Remarks] AIのちからで管理栄養士とアスリートのコミュニケーションを手助けします

    • URL

      http://www.foodlog-athl.org

    • Related Report
      2020 Annual Research Report
  • [Remarks]

    • URL

      https://karszawa.github.io/monster/

    • Related Report
      2019 Annual Research Report
  • [Remarks]

    • URL

      https://apps.apple.com/jp/app/foodlog-athl/id1445567985

    • Related Report
      2019 Annual Research Report
  • [Remarks]

    • URL

      https://play.google.com/store/apps/details?id=me.foologathl.app&hl=en

    • Related Report
      2019 Annual Research Report
  • [Remarks]

    • URL

      https://apps.apple.com/jp/app/foodlog-athl-for-dietitians/id1476571781

    • Related Report
      2019 Annual Research Report
  • [Remarks] FoodLog Athlete

    • URL

      https://karszawa.github.io/monster/

    • Related Report
      2018 Annual Research Report

URL: 

Published: 2018-04-23   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi