• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Intelligent Media for Realizing Question-Answering with Appropriate Images and Videos

Research Project

Project/Area Number 13480087
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionUniversity of Tsukuba

Principal Investigator

NAKAMURA Yuichi  University of Tsukuba, Institute of Engineering Mechanics and Systems, Associate Professor, 機能工学系, 助教授 (40227947)

Co-Investigator(Kenkyū-buntansha) MUKAIGAWA Yasuhiro  University of Tsukuba, Institute of Engineering Mechanics and Systems, Assistant Professor, 機能工学系, 講師 (60294435)
KUROHASHI Sadao  University of Tokyo, Graduate School of Information Science and Technology, Professor, 大学院・情報理工学研究科, 助教授 (50263108)
北原 格  筑波大学, 機能工学系, 助手 (70323277)
Project Period (FY) 2001 – 2003
Project Status Completed (Fiscal Year 2003)
Budget Amount *help
¥4,000,000 (Direct Cost: ¥4,000,000)
Fiscal Year 2003: ¥1,700,000 (Direct Cost: ¥1,700,000)
Fiscal Year 2002: ¥2,300,000 (Direct Cost: ¥2,300,000)
Keywordsmultimedia / video-based media / interactive media / video processing / natural language processing / communication media / intelligent video capturing / automated editing
Research Abstract

The purpose of this project is to realize an intelligent interactive media that answers questions based on video-based media.. Through three year's investigation, we obtained the following results
・We showed automated video capturing and indexing are efficiently integrated in our system. The objects handled in a. presentation and the manipulation done for the objects are effectively detected lay our multi-sensor system
・We proposed a method for automatic video indexcing for broadcasted contents such as cooking shows
・We proposed a framework QUEVICO, which is a question-based video composition scheme in which video indexing and editing is designed from the viewpoint of "question find answer", and in which multi-view videos can be effectively used. Based on this framework, the system retrieves a relevant video portion, even if a complete set of indices ire not given
・We proposed a novel model for video editing and summarizing based on constraint-satisfaction. In this model, a video is considered as a sequence of boxes i.e., video segments, each of which has a short length, e.g., 1 second, and the editing is defined as the problem of assigning an appropriate shot to each box. A variety of good editing patterns can be generated, and that we can control the characteristics of obtained videos by changing the rules and parameters

Report

(4 results)
  • 2003 Annual Research Report   Final Research Report Summary
  • 2002 Annual Research Report
  • 2001 Annual Research Report
  • Research Products

    (29 results)

All Other

All Publications (29 results)

  • [Publications] 伊津野, 中村, 大田: "QUEVICO QA Model for Video-Based Interactive Media"Proc Int'l Workshop on Content-Based Multimedia Indexing. 413-420 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] 尾関, 中村, 大田: "机上作業シーンの自動撮影のためのカメラワーク"電子情報通信学会論文誌. DII-J86 11. 1606-1617 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] 村山, 中村, 大田: "DocScape:文章の概覧性を高めるための概念図の生成と利用"情報処理学会論文誌. 44・4. 1150-1162 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] 伊藤, 尾関, 中村, 大田: "Simple and Robust Tracking of Hands and Objects for Video Based Multimedia Production"Proc.IEEE Conference on Multisensor Fusion and Integration. 252-257 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] 尾関, 伊藤, 里, 中村, 大田: "複合コミュニティ空間における注目の共有"日本バーチャルリアリティ学会論文誌. 8・4. 369-377 (2003)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] H.Izuno, Y.Nakamura, Y.Ohta: "QUEVICO QA Model for Video-based Interactive Media"Proc.Third International Workshop on Content-Based Multimedia Indexing. 413-420 (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] M.Ozeki, Y.Nakamura, Y.Ohta: "Automated Camera Control for Capturing Desktop Manipulations"Trans.IEICE, D-II. Vol.J86, No.11. 1606-1617 (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] M.Murayama, Y.Nakamura, Y.Ohta: "DocScape : Diagram Generation and Utilization for Grasping Documents"Journal of IPSJ. Vol.44, No.4. 1150-1162 (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] M.Itoh, M.Ozeki, Y.Nakamura, Y.Ohta: "Simple and Robust Tracking of Hands and Objects for Video-based Multimedia Production"Proc.IEEE Conference on Multisensor Fusion and Integration for Intelligent Systems. 252-257 (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] M.Ozeki, M.Itoh, Y.Sato, Y.Nakamura, Y.Ohta: "Sharing Attention in a Shared Mixed-Reality Space -Recodding Annotation for Objects by Recognizing Human Behaviors"Journal of VRSJ. Vol.8, No.4. 369-377 (2003)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2003 Final Research Report Summary
  • [Publications] 伊藤, 尾関, 中村, 大田: "Simple and Robust Tracking of hands and objects for Video-based Multimedia Production"Proc. IEE Conference on Multisensor Fusion and Integration for Intelligent Systems. 252-257 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 尾関, 伊津野, 伊藤, 中村, 大田: "Object Tracking and Task Recognition for Producing Interactive Video Content---Semi-automatic indexing for QUEVICO"Proc. Int'l Conference on Knowledge-Based Intelligent Information & Engineering Systems. 1044-1053 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 伊津野, 中村, 大田: "QUEVICO QA Model for Video-based Interactive Media"Proc. Int'l Workshop on Content-Based Multimedia Indexing. 413-420 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 尾関, 中村, 大田: "机上作業シーンの自動撮影のためのカメラワーク"電子情報通信学会論文誌. DII-J86-11. 1606-1617 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 尾形, 中村, 大田: "Computational Video Editing Model based on Optimization with Constraint Satisfaction"Proc. Pacific-Rim Conference on Multimedia. 2A1-2 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 尾関, 伊藤, 里, 中村, 大田: "複合コミュニティ空間における注目の共有〜注目誘導行動による物体への注釈付け〜"日本バーチャルリアリティ学界論文誌. 8・4. 369-377 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] 尾関, 中村, 大田: "Human Behavior Recognition System for Intelligent Video Production System"Proc.Pacific-Rim Conference on Multimedia. 1153-1160 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 久保田, 中村, 大田: "Detecting Scenes of Attention from Personal View Records"Proc.IAPR Workshop on Machine Vision and Applications. 209-213 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 村山, 中村, 大田: "Flexible Diagram Generation from Tagged Texts"Proc.Sixth Int'l Conference on Knowledge-Based Intelligent information & Engineering Systems. 582-587 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 伊津野, 中村, 大田: "QUEVICO : A Framework for Video-based Interactive Media"Int'l Workshop on Intelligent Media Technology for Communicative Reality. 6-11 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 尾関, 伊藤, 中村, 大田: "Tracking Hands and Objects for an Intelligent Video Production System"Proc.IAPR Int'l Conference on Pattern Recognition. 1011-1015 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 村山, 中村, 大田: "DocScape:文章の概覧性を高めるための概念図の生成と利用"情報処理学会論文誌. 44・4(掲載予定). (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] 中村, 尾関, 大田: "An Intelligent System for Capturing Presentations on Desktop Manipulations 10章,書名「Virtual Enviroments for Teaching and Learning」"World Scientific Publishing Company. 31 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 村山, 中村, 大田: "Diagram Generation Tagged Texts Toward Document Navigation"Proc. Int. Conf. On Multimedia and Expo. 716-719 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 尾関, 中村, 大田: "Camerawork for Intelligent Video Production"Proc. Int. Conf. On Multimedia and Expo. 41-44 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 尾関, 伊藤, 中村, 大田: "複合コミュニティ空間における注目の共有"日本バーチャルリアリティ学会第6回大会論文集. 239-242 (2001)

    • Related Report
      2001 Annual Research Report
  • [Publications] 中村, 他4名: "Augmenting Communication in a Shared Mixed-Reality Space"Proc. Int. Workshop on Pattern Recognition and Understanding. 63-74 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 河原, 黒橋: "用言と直前の格要素の組を単位とする格フレームの自動構築"自然言語処理. 9・1. 3-19 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 土屋, 黒橋, 佐藤: "Discovery of Definition Patterus by Compressing Dictionary Sentences"Proc. Natural Language Processing Pacific Rim Symposium. (2001)

    • Related Report
      2001 Annual Research Report

URL: 

Published: 2002-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi