2005 Fiscal Year Final Research Report Summary
Acquisition and Coding of Light-Ray Data for 3D Spatial Communication
| Project/Area Number |
14205059
|
|---|
| Research Category |
Grant-in-Aid for Scientific Research (A)
|
| Allocation Type | Single-year Grants |
|---|
| Section | 一般 |
|---|
| Research Field |
情報通信工学
|
|---|
| Research Institution | The University of Tokyo |
|---|
Principal Investigator |
HARASHIMA Hiroshi The University of Tokyo, Interfaculty Initiative for Information Studies, Professor, 大学院・情報学環, 教授 (60011201)
|
|---|
| Co-Investigator(Kenkyū-buntansha) |
AIZAWA Kiyoharu The University of Tokyo, Graduate School of Frontier Sciences, Dept. of Frontier Informatics, Professor, 大学院・新領域創成科学研究科, 教授 (20192453)
NAEMURA Takeshi The University of Tokyo, Interfaculty Initiative for Information Studies, Associate Professor, 大学院・情報学環, 助教授 (90292896)
IIDA Makoto The University of Tokyo, Graduate School of Engineering, Dept, of Electronic Engineering, Research Assistant, 大学院・工学系研究科, 助手 (40345103)
|
|---|
| Project Period (FY) |
2002 – 2005
|
| Keywords | Light-Ray Data / 3-D Spatial Communication / 3-D Display / Image-Based Rendering / Data Compression / Multi-View Camera |
|---|
| Research Abstract |
Under this project, we investigated some methods for acquisition and coding of light-ray data as a set of fundamental elements for 3-D spatial communication.
1.Description method of light-ray data towards 3D spatial communication
Visual data of a 3-D space can be represented as a 4-D function called a light field or a ray space, in which the light-rays filling the 3-D space are regarded as a fundamental element. We introduced the frequency domain analysis to the ray space in order to describe the processes of acquisition of multi-view images, analysis on the light-ray data, and synthesis of free-viewpoint images. Especially, we proposed the "focus measurement method" to identify clear parts on synthesized images, which is an important contribution that relates a signal processing theory with computer vision technologies.
2.Acquisition method of light-ray data for efficient capturing of 3D spatial data
Capturing light-ray data is equivalent to sampling the ray space. In this project, we cla
… More
rified the relation between the sampling condition and the quality of the images synthesized from the sampled data. To pursue the ideal sampling condition, we investigated a multi-view acquisition method using an array of thousands of lenslets in cooperation with NHK Science and Technical Research Laboratories.
3.Data compression method for light-ray data for efficient transmission of 3D spatial data
For compressing the light-ray data, we should consider the adaptability to several applications as well as the exploitation of the redundancy in the data. In this project, we focused on the "locality of reference" for synthesizing free-viewpoint images, and conducted a basic study on an efficient coding scheme using this locality.
4.Prototype of 3D spatial communication based on light-ray data
Real-time processing and low-latency are the important requirements for 3D spatial communication. We proposed and implemented a real-time algorithm for synthesizing free-viewpoint images without any off-line processing, and succeeded in real time processing of dynamic scenes. Less
|
