• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

On Generation of Multimedia Content Subject to Picture Books

Research Project

Project/Area Number 16500060
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Media informatics/Database
Research InstitutionShimane University

Principal Investigator

HIRAKAWA Masahito  Shimane University, Interdisciplinary Faculty of Science and Engineering, Professor, 総合理工学部, 教授 (30173222)

Project Period (FY) 2004 – 2006
Project Status Completed (Fiscal Year 2006)
Budget Amount *help
¥3,500,000 (Direct Cost: ¥3,500,000)
Fiscal Year 2006: ¥700,000 (Direct Cost: ¥700,000)
Fiscal Year 2005: ¥2,300,000 (Direct Cost: ¥2,300,000)
Fiscal Year 2004: ¥500,000 (Direct Cost: ¥500,000)
Keywordsmedia analysis and understanding / picture book / scene detection / key character identification / camera work / 物語 / 絵生成 / 段落抽出
Research Abstract

Computers are expected to be a tool for assisting people to enrich their everyday life. Computation performance was first augmented, followed by the improvement of communication capacity. It's time to provide computer capabilities to help people cultivate their intellectual faculties. Towards this, media research on utilizing media has been carried out for years. What we should do now is to carefully analyze media itself, resulting in development of well-formed media for further success in media research.
We are interested in how media convey the information and affect people-the way of their thinking. As a first step towards this goal, we investigated in this research project the analysis and generation of picture books. A scheme of generating a picture from a narrative text was proposed. Specifically, we investigated the following three issues.
1. Fundamental research on media: we analyzed (multi) media and presented a notion of UniversalMedia. It is all-in-one media to let people deal with information naturally and enrich their creativity and life.
2. Story segmentation and key character identification: Input text or script is segmented into meaningful parts (scenes). One part (scene) may correspond to one spread in a picture book. In addition, a scheme of identifying key characters (persons and items) to be presented in a picture was proposed
3. Picture formation: we have proposed a mechanism to form a picture from sentences of a scene by arranging key characters and determining the camera position.

Report

(4 results)
  • 2006 Annual Research Report   Final Research Report Summary
  • 2005 Annual Research Report
  • 2004 Annual Research Report
  • Research Products

    (22 results)

All 2007 2006 2005 2004

All Journal Article (22 results)

  • [Journal Article] 物語からの絵の自動生成2007

    • Author(s)
      木島紗弥子
    • Journal Title

      人工知能学会言語・音声理解と対話処理研究会資料 49-10

      Pages: 51-56

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Annual Research Report 2006 Final Research Report Summary
  • [Journal Article] From MultiMedia to UniversalMedia2007

    • Author(s)
      M.Hirakawa
    • Journal Title

      International Journal of Computational Science and Engineering (印刷中)

    • NAID

      120006539365

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Annual Research Report 2006 Final Research Report Summary
  • [Journal Article] Generation of Pictures from a Narrative Text2007

    • Author(s)
      S.Kijima
    • Journal Title

      JSAI Technical Report of SIG-SLUD

      Pages: 49-10

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] From MultiMedia to UniversalMedia2007

    • Author(s)
      M.Hirakawa
    • Journal Title

      International Journal of Computational Science and Engineering (in print)

    • NAID

      120006539365

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Tracking Moving Objects in a Video Stream with Camera Motion2006

    • Author(s)
      Y.Wang
    • Journal Title

      情報処理学会コンピュータビジョンとイメージメディア研究会資料 152-18

      Pages: 129-136

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Video Editing Based on Object Movement and Camera Motion2006

    • Author(s)
      Y.Wang
    • Journal Title

      Proc., ACM International Working Conference on Advanced Visual Interfaces

      Pages: 108-111

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] すくうインタフェースO-Key2006

    • Author(s)
      田部ちえみ
    • Journal Title

      情報処理学会ヒューマンインタフェース研究会資料 120-8

      Pages: 53-60

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] O-Key : A Scoopable Interface2006

    • Author(s)
      C.Tanabe
    • Journal Title

      Proc., IEEE International Symposium on Multimedia

      Pages: 185-192

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Issues, Challenges, and Future Directions in Multimedia Research (panel position)2006

    • Author(s)
      M.Hirakawa
    • Journal Title

      Proc., IEEE International Symposium on Multimedia

      Pages: 773-773

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Tracking Moving Objects in a Video Stream with Camera Motion2006

    • Author(s)
      Y.Wang
    • Journal Title

      IPSJ Technical Report of SIG-CVIM

      Pages: 152-18

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] O-Key : A Scoopable Interface2006

    • Author(s)
      C.Tanabe
    • Journal Title

      IPSJ Technical Report of SIG-HI

      Pages: 120-8

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Issues, Challenges, and Future Directions in Multimedia Research (panel position)2006

    • Author(s)
      M.Hirakawa
    • Journal Title

      Proc, IEEE International Symposium on Multimedia

      Pages: 773-773

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Video Editing Based on Object Movement and Camera Motion2006

    • Author(s)
      Y.Wang
    • Journal Title

      Proc, ACM International Working Conference on Advanced Visual Interfaces

      Pages: 108-11

    • Related Report
      2006 Annual Research Report
  • [Journal Article] O-key : A Scoopable Interface2006

    • Author(s)
      C.Tanabe
    • Journal Title

      Proc., IEEE International Symposium on Multimedia

      Pages: 185-192

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Issues, Challenges, and Future Directions in Multimedia Research (Panel position)2006

    • Author(s)
      M.Hirakawa
    • Journal Title

      Proc., IEEE International Symposium on Multimedia

      Pages: 773-773

    • Related Report
      2006 Annual Research Report
  • [Journal Article] すくうインタフェースO-key2006

    • Author(s)
      田部ちえみ
    • Journal Title

      情報処理学会ヒューマンインタフェース研究会資料 120-8

      Pages: 53-60

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Tracking Moving Objects in a Video Stream with Camera Motion2006

    • Author(s)
      Y.Wang
    • Journal Title

      情報処理学会 コンピータビジョンとイメージメディア研究会 No.152

      Pages: 129-136

    • Related Report
      2005 Annual Research Report
  • [Journal Article] A LoCoS-based Tool Capable of Providing a Clue for Idea Generation2005

    • Author(s)
      C.Tanabe
    • Journal Title

      Proc., International Conference on Active Media Technology

      Pages: 51-56

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary 2005 Annual Research Report
  • [Journal Article] Towards Understanding of Multimedia Documents : A Trial of Picture Book Analysis and Generation2005

    • Author(s)
      M.Yamamoto
    • Journal Title

      Proc., IEEE International Symposium of Multimedia

      Pages: 29-36

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary 2005 Annual Research Report
  • [Journal Article] From MultiMedia to UniversalMedia2005

    • Author(s)
      M.Hirakawa
    • Journal Title

      Proc.Workshop on Databases in Networked Information Systems

      Pages: 104-114

    • NAID

      120006539365

    • Related Report
      2004 Annual Research Report
  • [Journal Article] A LoCoS-based tool capable of providing a clue for idea generation2005

    • Author(s)
      C.Tanabe
    • Journal Title

      Proc.Conference on Active Media Technology (発表予定)

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Video Editing with Change of Camera Motion2004

    • Author(s)
      M.Hirakawa
    • Journal Title

      Proc., International Conference on Distributed Multimedia Systems

      Pages: 196-200

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary

URL: 

Published: 2004-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi