• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

The study of wording and word interpretation for intermediate object on cooking instructional system with spoken dialogue

Research Project

Project/Area Number 20700120
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeSingle-year Grants
Research Field Media informatics/Database
Research InstitutionKyoto University (2010)
National Institute of Information and Communications Technology (2008-2009)

Principal Investigator

YAMAKATA Yoko  京都大学, 大学院・情報学研究科, 准教授 (60423018)

Project Period (FY) 2008 – 2010
Project Status Completed (Fiscal Year 2010)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2010: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2009: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2008: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Keywordsヒューマンインターフェイス / メディア情報学 / 音声対話システム / 映像認識 / 自然言語理解
Research Abstract

However cooking while reading a recipe is sometimes very danger because he/she has to handle a knife and fire in the cooking. Therefore, we aim to construct a recipe guidance system that instructs how to cook according to its recipe text. To realize such recipe guidance system, it is no enough to read the recipe book. For example, it is very common that a recipe gives such instruction as “mix (1) to (2).” This sentence means an intermediate object given by process (1) would be mixed with an intermediate object given by process (2). If the system just reads this sentence with a voice, a chef might not decide which objects the system designates because he/she does not know/remember which object is given by process (1)/(2). In this case, the system should give reasonable name such as “cut onion by the previous process” and “a mix of onion and carrot”. Such reasonable name should be according to like what the chef understand the object. Therefore, we propose a method to give reasonable name according to the model of user understanding toward an intermediate food object in a cooking process.
In this research, we presented such intermediate objects is tend to be designated by components", "the name of meal the object going to be", "the name of vessel", "the name of position", and "the name of milestone (ex. "sauce", "dough). We proposed a method to specify the designated intermediate object by a model of human naming toward intermediate object. The proposed model archives 93% accuracy of object specification.
According to the model of human naming toward intermediate object, we construct a recipe guidance system based on IwaCam, the a live video cooking communication software. IwaCam aims to enable cooperative cooking between distant kitchen spaces.

Report

(4 results)
  • 2010 Annual Research Report   Final Research Report ( PDF )
  • 2009 Annual Research Report
  • 2008 Annual Research Report
  • Research Products

    (29 results)

All 2012 2011 2010 2009 2008 Other

All Journal Article (6 results) (of which Peer Reviewed: 2 results) Presentation (19 results) Remarks (4 results)

  • [Journal Article] 呼称により指示された中間食材を同定するための画像認識モデルおよび呼称解釈法の提案2011

    • Author(s)
      山肩洋子, 角所考, 美濃導彦
    • Journal Title

      電子情報通信学会論文誌

      Volume: Vol.J94-A, No.7 Pages: 519-131

    • Related Report
      2010 Final Research Report
  • [Journal Article] 把持の順序と外見の変化モデルを利用した調理作業における食材追跡2011

    • Author(s)
      橋本敦史, 森直幸, 舩冨卓哉, 山肩洋子, 椋木雅之, 角所考, 美濃 導彦
    • Journal Title

      電子情報通信学会論文誌

      Volume: Vol.J94-A, No.7 Pages: 509-518

    • NAID

      110008673446

    • Related Report
      2010 Final Research Report
  • [Journal Article] 呼称により指示された中間食材を同定するための画像認識モデルおよび呼称解釈法の提案2011

    • Author(s)
      山肩洋子
    • Journal Title

      電子時報通信学会論文誌

      Volume: Vol.J94-ANo.7 Pages: 519-531

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 把持の順序と外見の変化モデルを利用した調理作業における食材追跡2011

    • Author(s)
      橋本敦史
    • Journal Title

      電子情報通信学会論文誌

      Volume: Vol.J94-ANo.7 Pages: 509-518

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 小特集生活に役立つメディア処理-料理行動を科学する-3. 料理を作る「調理」という複雑な知的創作活動を最新の情報科学で支援する2010

    • Author(s)
      山肩洋子, 舩冨卓哉, 上田博唯, 辻秀典, 美濃導彦, 中内靖, 宮脇健三郎, 中村裕一, 椎尾一郎
    • Journal Title

      電子情報通信学会誌

      Volume: Vol.93, No.1 Pages: 39-47

    • Related Report
      2010 Final Research Report
  • [Journal Article] 小特集生活に役立つメディア処理-料理行動を科学する-3料理を作る2010

    • Author(s)
      山肩洋子
    • Journal Title

      電子情報通信学会誌 Vol.93, No.1

      Pages: 39-47

    • Related Report
      2009 Annual Research Report
  • [Presentation] 画像・振動音・荷重データを統合的に用いた食材認識2012

    • Author(s)
      井上仁
    • Organizer
      電子情報通信学会マルチメディア・仮想環境基礎(MVE)研究会
    • Place of Presentation
      富山県,富山市
    • Year and Date
      2012-03-12
    • Related Report
      2010 Annual Research Report
  • [Presentation] 画像・振動音・荷重データを統合的に用いた食材認識2012

    • Author(s)
      井上仁, 中村和晃, 舩冨卓哉, 橋本敦史, 上田真由美, 山肩洋子, 美濃導彦
    • Organizer
      マルチメディア・仮想環境基礎研究会(MVE)
    • Related Report
      2010 Final Research Report
  • [Presentation] Cooking Ingredient Recognition Based on the Load on a Chopping Board during Cutting2011

    • Author(s)
      Mayumi Ueda
    • Organizer
      3rd Workshop on Multimedia for Cooking and Eating Activities : CEA2011
    • Place of Presentation
      California, USA
    • Year and Date
      2011-12-06
    • Related Report
      2010 Annual Research Report
  • [Presentation] 鮨屋における調理場観測映像の解析によるサービス支援2011

    • Author(s)
      山肩洋子
    • Organizer
      第2回文化とコンピューティング国際会議共催イベント「食文化に関する学際的探求:作る,食べる,もてなす」
    • Place of Presentation
      京都府,京都市
    • Year and Date
      2011-10-20
    • Related Report
      2010 Annual Research Report
  • [Presentation] 調理における切断加工時の荷重特徴を用いた食材認識2011

    • Author(s)
      土本良樹
    • Organizer
      電子時報通信学会マルチメディア・仮想環境基礎(MVE)研究会
    • Place of Presentation
      長崎,伊王島
    • Year and Date
      2011-03-07
    • Related Report
      2010 Annual Research Report
  • [Presentation] Cooking Ingredient Recognition Based on the Load on a Chopping Board during Cutting2011

    • Author(s)
      Yoko Yamakata, Yoshiki Tsuchimoto, Atsushi Hashimoto, Takuya Funatomi, Mayumi Ueda, Michihiko Minoh
    • Organizer
      Workshop on Multimedia for Cooking and Eating Activities(CEA2011) in conjunction with The IEEE International Symposium on Multimedia
    • Related Report
      2010 Final Research Report
  • [Presentation] 鮨屋における調理場観測映像の解析によるサービス支援2011

    • Author(s)
      山肩洋子
    • Organizer
      第2回文化とコンピューティング国際会議共催イベント「食文化に関する学際的探求: 作る,食べる,もてなす」
    • Related Report
      2010 Final Research Report
  • [Presentation] 調理における切断加工時の荷重特徴を用いた食材認識2011

    • Author(s)
      土本 良樹, 橋本 敦史, 舩冨 卓哉, 山肩 洋子, 上田 真由美, 美濃 導彦
    • Organizer
      電子情報通信学会 マルチメディア・仮想環境基礎(MVE)研究会
    • Related Report
      2010 Final Research Report
  • [Presentation] Object Recognition based on Object's Identity for Cooking Recognition Task2010

    • Author(s)
      Yoko Yamakata
    • Organizer
      2nd Workshop on Multimedia for Cooking and Eating Activities : CEA2010
    • Place of Presentation
      Taichung, Taiwan
    • Year and Date
      2010-12-14
    • Related Report
      2010 Annual Research Report
  • [Presentation] 料理コミュニケーション支援ソフトウェアIwacamの一般家庭への導入事例報告2010

    • Author(s)
      山肩洋子
    • Organizer
      第9回情報科学技術フォーラム(FIT2010)
    • Place of Presentation
      福岡県,福岡市
    • Year and Date
      2010-09-09
    • Related Report
      2010 Annual Research Report
  • [Presentation] 料理映像コミュニケーション基盤ソフトウェアIwaCamを用いた遠隔共同料理実験2010

    • Author(s)
      辻秀典
    • Organizer
      電子情報通信学会マルチメディア・仮想環境基礎(MVE)研究会
    • Place of Presentation
      京都府,京都市
    • Year and Date
      2010-05-14
    • Related Report
      2010 Annual Research Report
  • [Presentation] Object Recognition based on Object's Identity for Cooking Recognition Task2010

    • Author(s)
      YAMAKATA YOKO, KAKUSHO KOH, MINOH MICHIHIKO
    • Organizer
      2nd Workshop on Multimedia for Cooking and Eating Activities : CEA2010, in conjunction with The IEEE International Symposium on Multimedia
    • Related Report
      2010 Final Research Report
  • [Presentation] 料理映像コミュニケーション基盤ソフトウェアIwaCamを用いた遠隔共同料理実験2010

    • Author(s)
      辻 秀典, 山肩 洋子, 舩冨 卓哉, 近藤 一晃, 出口 大輔, 井手 一郎, 宮脇 健三郎, 佐野 睦夫
    • Organizer
      電子情報通信学会 マルチメディア・仮想環境基礎(MVE)研究会
    • Related Report
      2010 Final Research Report
  • [Presentation] 双方向映像配信技術により遠隔地間での共食・共同調理を支援するコミュニケーションツール2009

    • Author(s)
      料理メディア研究会
    • Organizer
      電子情報通信学会2009年ヒューマン・コミュニケーション・グループシンポジウム
    • Place of Presentation
      札幌コンベンションセンター,北海道札幌市
    • Year and Date
      2009-12-10
    • Related Report
      2009 Annual Research Report
  • [Presentation] A Study of Object Naming According to the Manufacturing Processes in a Cooking Activity2009

    • Author(s)
      Yoko Yamakata
    • Organizer
      ACM Multimedia 2009 Workshop on Multimedia for Cooking and Eating Activities (CEA2009)
    • Place of Presentation
      Beijing Hotel, Beijing, China
    • Year and Date
      2009-10-23
    • Related Report
      2009 Annual Research Report
  • [Presentation] 双方向映像配信技術により遠隔地間での共食・共同調理を支援するコミュニケーションツール-基盤ソフトウェアの開発報告-2009

    • Author(s)
      料理メディア研究専門委員会
    • Organizer
      2009年度HCGシンポジウム
    • Related Report
      2010 Final Research Report
  • [Presentation] A Study of Object Naming According to the Manufacturing Processes in a Cooking Activity2009

    • Author(s)
      Yoko Yamakata, Takuya Funatomi, Koh Kakusho, Michihiko Minoh
    • Organizer
      ACM Multimedia 2009 Workshop on Multimedia for Cooking and Eating Activities (CEA2009)
    • Related Report
      2010 Final Research Report
  • [Presentation] Smart Kitchen : A User Centric Cooking Support System2008

    • Author(s)
      Atsushi Hashimoto
    • Organizer
      Proceedings of International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems (IPMU08)
    • Place of Presentation
      Malaga, Spain
    • Year and Date
      2008-06-23
    • Related Report
      2008 Annual Research Report
  • [Presentation] Smart Kitchen : A User Centric Cooking Support System2008

    • Author(s)
      Atsushi Hashimoto, Naoyuki Mori, Takuya Funatomi, Yoko Yamakata, Koh Kakusho, Michihiko Minoh
    • Organizer
      Information Processing and Management of Uncertainty in Knowledge-Based Systems
    • Related Report
      2010 Final Research Report
  • [Remarks] 電子情報通信学会ヒューマン・コミュニケーション・グループ 食メディア研究会において副委員長を担当

    • URL

      http://www.ccm.media.kyoto-u.ac.jp/CEA/

    • Related Report
      2010 Final Research Report
  • [Remarks] 電子情報通信学会ヒューマン・コミュニケーション・グループ食メディア研究会において副委員長を担当

    • URL

      http://www.ccm.media.kyoto-u.ac.jp/CEA/

    • Related Report
      2010 Annual Research Report
  • [Remarks] 電子情報通信学会第三種研究会料理メディア研究会ホームページ

    • URL

      http://www.ccm.media.kyoto-u.ac.jp/CM/

    • Related Report
      2009 Annual Research Report
  • [Remarks] 電子情報通信学会 第三種研究会 料理メディア研究会 ホームページ

    • URL

      http://www.ccm.media.kyoto-u.ac.jp/CM/

    • Related Report
      2008 Annual Research Report

URL: 

Published: 2008-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi