• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Acquisition and Coding of Light-Ray Data for 3D Spatial Communication

Research Project

Project/Area Number 14205059
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Research Field 情報通信工学
Research InstitutionThe University of Tokyo

Principal Investigator

HARASHIMA Hiroshi  The University of Tokyo, Interfaculty Initiative for Information Studies, Professor, 大学院・情報学環, 教授 (60011201)

Co-Investigator(Kenkyū-buntansha) AIZAWA Kiyoharu  The University of Tokyo, Graduate School of Frontier Sciences, Dept. of Frontier Informatics, Professor, 大学院・新領域創成科学研究科, 教授 (20192453)
NAEMURA Takeshi  The University of Tokyo, Interfaculty Initiative for Information Studies, Associate Professor, 大学院・情報学環, 助教授 (90292896)
IIDA Makoto  The University of Tokyo, Graduate School of Engineering, Dept, of Electronic Engineering, Research Assistant, 大学院・工学系研究科, 助手 (40345103)
Project Period (FY) 2002 – 2005
Project Status Completed (Fiscal Year 2005)
Budget Amount *help
¥53,560,000 (Direct Cost: ¥41,200,000、Indirect Cost: ¥12,360,000)
Fiscal Year 2005: ¥5,460,000 (Direct Cost: ¥4,200,000、Indirect Cost: ¥1,260,000)
Fiscal Year 2004: ¥20,020,000 (Direct Cost: ¥15,400,000、Indirect Cost: ¥4,620,000)
Fiscal Year 2003: ¥12,220,000 (Direct Cost: ¥9,400,000、Indirect Cost: ¥2,820,000)
Fiscal Year 2002: ¥15,860,000 (Direct Cost: ¥12,200,000、Indirect Cost: ¥3,660,000)
KeywordsLight-Ray Data / 3-D Spatial Communication / 3-D Display / Image-Based Rendering / Data Compression / Multi-View Camera
Research Abstract

Under this project, we investigated some methods for acquisition and coding of light-ray data as a set of fundamental elements for 3-D spatial communication.
1.Description method of light-ray data towards 3D spatial communication
Visual data of a 3-D space can be represented as a 4-D function called a light field or a ray space, in which the light-rays filling the 3-D space are regarded as a fundamental element. We introduced the frequency domain analysis to the ray space in order to describe the processes of acquisition of multi-view images, analysis on the light-ray data, and synthesis of free-viewpoint images. Especially, we proposed the "focus measurement method" to identify clear parts on synthesized images, which is an important contribution that relates a signal processing theory with computer vision technologies.
2.Acquisition method of light-ray data for efficient capturing of 3D spatial data
Capturing light-ray data is equivalent to sampling the ray space. In this project, we cla … More rified the relation between the sampling condition and the quality of the images synthesized from the sampled data. To pursue the ideal sampling condition, we investigated a multi-view acquisition method using an array of thousands of lenslets in cooperation with NHK Science and Technical Research Laboratories.
3.Data compression method for light-ray data for efficient transmission of 3D spatial data
For compressing the light-ray data, we should consider the adaptability to several applications as well as the exploitation of the redundancy in the data. In this project, we focused on the "locality of reference" for synthesizing free-viewpoint images, and conducted a basic study on an efficient coding scheme using this locality.
4.Prototype of 3D spatial communication based on light-ray data
Real-time processing and low-latency are the important requirements for 3D spatial communication. We proposed and implemented a real-time algorithm for synthesizing free-viewpoint images without any off-line processing, and succeeded in real time processing of dynamic scenes. Less

Report

(5 results)
  • 2005 Annual Research Report   Final Research Report Summary
  • 2004 Annual Research Report
  • 2003 Annual Research Report
  • 2002 Annual Research Report
  • Research Products

    (42 results)

All 2006 2005 2004 2003 Other

All Journal Article (29 results) Book (2 results) Publications (11 results)

  • [Journal Article] Focus Measurement and All in-Focus Image Synthesis for Light Field Rendering2006

    • Author(s)
      Keita Takahashi, Akira Kubota, Takeshi Naemura
    • Journal Title

      Systems and Comupters in Japan 37・1

      Pages: 1-12

    • NAID

      110003203206

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] 自由視点画像合成に基づく光線空間符号化2006

    • Author(s)
      田口裕一, 苗村健
    • Journal Title

      映像情報メディア学会誌 60・4

      Pages: 569-575

    • NAID

      110006838458

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Layered Light-Field Rendering with Focus Measurement2006

    • Author(s)
      Keita Takahashi, Takeshi Naemura
    • Journal Title

      Eurasip Signal rocessing : Image Communication (印刷中)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Focus Measurement and All in-Focus Image Synthesis for Light Field Rendering2006

    • Author(s)
      Keita Takahashi, Akira Kubota, Takeshi Naemura
    • Journal Title

      Systems and Computers in Japan 37-1

      Pages: 1-12

    • NAID

      110003203206

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Ray-Space Coding Based on Free-Viewpoint Image Synthesis2006

    • Author(s)
      Yuichi Taguchi, Takeshi Naemura
    • Journal Title

      The Journal of the Institute of Image Information and Television Engineers 60-4

      Pages: 569-575

    • NAID

      110006838458

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Focus Measurement and All in-Focus Image Synthesis for Light Field Rendering2006

    • Author(s)
      Keita Takahashi, Akira Kubota Takeshi Naemura
    • Journal Title

      Systems and Computers in Japan 37・1

      Pages: 573-584

    • NAID

      110003203206

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 自由視点画像合成に基づく光線空間符号化2006

    • Author(s)
      田口 裕一, 苗村 健
    • Journal Title

      映像情報メディア学会誌 60・4(掲載確定)

    • NAID

      110006838458

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 招待講演III:3次元空間情報のサンプリングと自由視点画像合成2006

    • Author(s)
      苗村 健
    • Journal Title

      高臨場感ディプレイフォーラム2005 映情学技法 29・66

      Pages: 39-42

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Light Field Renderingにおける合焦判定と全焦点画像合成2005

    • Author(s)
      高橋桂太, 久保田彰, 苗村健
    • Journal Title

      電子情報通信学会論文誌 J88-D-II・3

      Pages: 573-584

    • NAID

      110003203206

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Light Field Renderingのための合焦判定法の空間領域における定義と非格子カメラ群入力への適用2005

    • Author(s)
      高橋桂太, 苗村健
    • Journal Title

      映像情報メディア学会誌 59・10

      Pages: 1478-1482

    • NAID

      110006837884

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] レンズアレイを用いた実時間全焦点自由視点画像合成システム2005

    • Author(s)
      河宗玄, 小島將, 高橋桂太, 苗村健
    • Journal Title

      映像情報メディア学会誌 59・10

      Pages: 1483-1487

    • NAID

      110006837885

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Focus Measurement and All in-Focus Image Synthesis for Light Field Rendering2005

    • Author(s)
      Keita Takahashi, Akira Kubota, Takeshi Naemura
    • Journal Title

      The IEICE Trans. On Information and Systems J88-D-II-3

      Pages: 573-584

    • NAID

      110003203206

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Spatial Domain Definition of Focus Measurement Method for Light Field Rendering and Its Application for Images Captured with Unstructured Array of Cameras2005

    • Author(s)
      Keita Takahashi, Takeshi Naemura
    • Journal Title

      The Journal of the Institute of Image Information and Television Engineers 59-10

      Pages: 1478-1482

    • NAID

      110006837884

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Real-time All in-Focus Free-Viewpoint Image Synthesis System Using a Lens Array2005

    • Author(s)
      Jonghyun Ha, Masaru Kojima, Keita Takahashi, Takeshi Naemura
    • Journal Title

      The Journal of the Institute of Image Information and Television Engineers 59-10

      Pages: 1483-1487

    • NAID

      110006837885

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Human Communication Media2005

    • Author(s)
      Takeshi Naemura
    • Journal Title

      Telecommunication, Teleimmersion and Telexistence II

      Pages: 153-164

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Light Field Renderingのための合焦判定法の空間領域における定義と非格子カメラ郡入力への適用2005

    • Author(s)
      高橋 桂太, 苗村 健
    • Journal Title

      映像情報メディア学会誌 59・10

      Pages: 1478-1482

    • Related Report
      2005 Annual Research Report
  • [Journal Article] レンズアレイを用いた実時間全焦点自由視点画像合成システム2005

    • Author(s)
      河 宗玄, 小島 將, 高橋 桂太, 苗村 健
    • Journal Title

      映像情報メディア学会誌 59・10

      Pages: 1483-1487

    • NAID

      110006837885

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Unstructured Light Field Rendering Using on-the-Fly Focus Measurement2005

    • Author(s)
      Keita Takahashi, Takeshi Naemura
    • Journal Title

      Proc.IEEE International Conference on Multimedia and Expo. ICME2005

      Pages: 205-208

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Spatial Domain Analysis on the Focus Measurement for Light Field Rendering2005

    • Author(s)
      Keita Takahashi, Takeshi Naemura
    • Journal Title

      Proc.IEEE International Conference on Image Processing 3

      Pages: 13-16

    • NAID

      10014487642

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Free-Viewpoint Thumbnail for Light Field Compression2005

    • Author(s)
      Yuichi Taguchi, Takeshi Naemura
    • Journal Title

      ACM SIGGRAPH 2005, Posters 64

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Light Field Renderingにおける合焦判定と全焦点画像合成2005

    • Author(s)
      高橋 桂太, 久保田 彰, 苗村 健
    • Journal Title

      電子情報通信学会論文誌 J88-D-II・3

      Pages: 573-584

    • NAID

      110003203206

    • Related Report
      2004 Annual Research Report
  • [Journal Article] A Focus Measure for Light Field Rendering2004

    • Author(s)
      Keita Takahashi, Akira Kubota, Takeshi Naemura
    • Journal Title

      IEEE ICIP2004 3

      Pages: 2475-2478

    • Related Report
      2004 Annual Research Report
  • [Journal Article] All in-Focus Light Field Viewer2004

    • Author(s)
      Keita Takahashi, Takeshi Naemura
    • Journal Title

      ACM SIGGRAPH 2004 no.48(Poster)

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 合焦判定に基づくマルチカメラ画像からの全焦点自由視点画像合成「ベストセッション講演賞 受賞」2004

    • Author(s)
      高橋 桂太, 苗村 健
    • Journal Title

      第5回SICEシステムインテグレーション部門講演会(SI2004)オーガナイズドセッションマルチカメラによるセンシング 2F2-5

      Pages: 609-610

    • Related Report
      2004 Annual Research Report
  • [Journal Article] Light Field Renderingにおける合焦判定法の空間解析2004

    • Author(s)
      高橋 桂太, 苗村 健
    • Journal Title

      信学技報IE2004-101 104・493

      Pages: 57-62

    • NAID

      10014487642

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 視点依存簡易モデルの実時間生成に基づく多視点画像からの自由視点画像合成2004

    • Author(s)
      櫛田 和貴, 高橋 桂太, 苗村 健
    • Journal Title

      3次元画像コンファレンス'04 4・2

      Pages: 131-134

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 自由視点画像合成における光線情報のサンプリングと被写界深度に関する理論2003

    • Author(s)
      高橋桂太, 苗村健, 原島博
    • Journal Title

      映像情報メディア学会誌 57・10

      Pages: 1292-1299

    • NAID

      110006836881

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Theory on Sampling of Light-Ray Data and Depth of Field for Free-Viewpoint Image Synthesis2003

    • Author(s)
      Keita Takahashi, Takeshi Naemura, Hiroshi Harashima
    • Journal Title

      The Journal of the Institute of Image Information and Television Engineers 57-10

      Pages: 1292-1299

    • NAID

      110006836881

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Journal Article] Layered Light-Field Rendering with Focus Measurement

    • Author(s)
      Keita Takahashi, Takeshi Naemura
    • Journal Title

      Eurasip Signal Processing : Image Communication (accepted)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2005 Final Research Report Summary
  • [Book] Human Communication Media2005

    • Author(s)
      Takeshi Naemura
    • Total Pages
      7
    • Publisher
      Telecommunication, Teleimmersion and Telexistence II
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2005 Annual Research Report 2005 Final Research Report Summary
  • [Book] Image Processing Technologies -- Algorithms, Sensors, and Applications --2004

    • Author(s)
      Takeshi Naemura, Masahide Kaneko, Hiroshi Harashima
    • Total Pages
      495
    • Publisher
      Marcel Dekker Inc.
    • Related Report
      2004 Annual Research Report
  • [Publications] 高橋 桂太, 苗村 健, 原島 博: "自由視点画像合成における光線情報のサンプリングと被写界深度に関する理論"映像情報メディア学会誌. 57・10. 1292-1299 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Satoshi Mitsuda, Tomoyuki Yamamoto, Keita Takahashi, Takeshi Naemura, Hiroshi Harashima: "Interactive View Synthesis from Integral Photography Using Estimated Depth Information"SPIE Three-Dimensional TV Video, and Display II. 5243・18. 116-124 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Keita Takahashi, Takeshi Naemura, Hiroshi Harashima: "Depth of Field in Light Field Rendering"Processing (ICIP2003). 1. 409-412 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Keita Takahashi, Akira Kubota, Takeshi Naemura: "All in-Focus View Synthesis from Under-Sampled Light Field"International Conference on Artificial Reality and Telexistence. 249-256 (2003)

    • Related Report
      2003 Annual Research Report
  • [Publications] Tomoyuki Yamamoto, Takeshi Naemura: "Real-Time Capturing and Interactive Synthesis of 3D Scenes Using Integral Photography"IS&T/SPIE Electronic Imaging 2004. 5291A-16. (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] Takeshi Naemura, Masahide Kaneko, Hiroshi Harashima: "Image Processing Technologies ‥ Algorithms, Sensors, and Appications"Marcel Dekker Inc.. (2004)

    • Related Report
      2003 Annual Research Report
  • [Publications] 竹内 敬亮, 苗村 健, 原島 博: "3次元物体の光線記述のためのテレセントリック撮像系"映像情報メディア学会誌. 56・4. 617-627 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 山田 邦男, 望月 研二, 苗村 健, 相澤 清晴, 齊藤隆弘: "自然パノラマシーンのセッティング表現の構築とそれに基づく仮想視点移動"映像情報メデイア学会誌. 56・4. 583-591 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] T.Naemura, T.Nitta, A.Mimura, H.Harashirna: "Virtual Shadows in Mixed Reality Environment Using Flashlight-like Devices"Trans.Virtual Reality Society of Japan. 7・2. 227-237 (2002)

    • Related Report
      2002 Annual Research Report
  • [Publications] 苗村 健: "3次元空間メディアの実現"季刊InterCommunication. 44. 82-84 (2003)

    • Related Report
      2002 Annual Research Report
  • [Publications] T.Naemura, H.Harashima: "Three-Dimensional Television, Video, and Display Technology (B.Javidi and F.Okano, eds.), Chapter 8"Spriner-Verlag. 495(30(chapter 8)) (2002)

    • Related Report
      2002 Annual Research Report

URL: 

Published: 2002-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi