2003 Fiscal Year Final Research Report Summary
Intelligent Media for Realizing Question-Answering with Appropriate Images and Videos
| Project/Area Number |
13480087
|
|---|
| Research Category |
Grant-in-Aid for Scientific Research (B)
|
| Allocation Type | Single-year Grants |
|---|
| Section | 一般 |
|---|
| Research Field |
Intelligent informatics
|
|---|
| Research Institution | University of Tsukuba |
|---|
Principal Investigator |
NAKAMURA Yuichi University of Tsukuba, Institute of Engineering Mechanics and Systems, Associate Professor, 機能工学系, 助教授 (40227947)
|
|---|
| Co-Investigator(Kenkyū-buntansha) |
MUKAIGAWA Yasuhiro University of Tsukuba, Institute of Engineering Mechanics and Systems, Assistant Professor, 機能工学系, 講師 (60294435)
KUROHASHI Sadao University of Tokyo, Graduate School of Information Science and Technology, Professor, 大学院・情報理工学研究科, 助教授 (50263108)
|
|---|
| Project Period (FY) |
2001 – 2003
|
| Keywords | multimedia / video-based media / interactive media / video processing / natural language processing / communication media / intelligent video capturing / automated editing |
|---|
| Research Abstract |
The purpose of this project is to realize an intelligent interactive media that answers questions based on video-based media.. Through three year's investigation, we obtained the following results
・We showed automated video capturing and indexing are efficiently integrated in our system. The objects handled in a. presentation and the manipulation done for the objects are effectively detected lay our multi-sensor system
・We proposed a method for automatic video indexcing for broadcasted contents such as cooking shows
・We proposed a framework QUEVICO, which is a question-based video composition scheme in which video indexing and editing is designed from the viewpoint of "question find answer", and in which multi-view videos can be effectively used. Based on this framework, the system retrieves a relevant video portion, even if a complete set of indices ire not given
・We proposed a novel model for video editing and summarizing based on constraint-satisfaction. In this model, a video is considered as a sequence of boxes i.e., video segments, each of which has a short length, e.g., 1 second, and the editing is defined as the problem of assigning an appropriate shot to each box. A variety of good editing patterns can be generated, and that we can control the characteristics of obtained videos by changing the rules and parameters
|
