• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on Appearance and 3D imaging

Research Project

Project/Area Number 19H01123
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Review Section Medium-sized Section 61:Human informatics and related fields
Research InstitutionOsaka University

Principal Investigator

Matsushita Yasuyuki  大阪大学, 大学院情報科学研究科, 教授 (30756507)

Project Period (FY) 2019-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥45,630,000 (Direct Cost: ¥35,100,000、Indirect Cost: ¥10,530,000)
Fiscal Year 2023: ¥5,850,000 (Direct Cost: ¥4,500,000、Indirect Cost: ¥1,350,000)
Fiscal Year 2022: ¥5,850,000 (Direct Cost: ¥4,500,000、Indirect Cost: ¥1,350,000)
Fiscal Year 2021: ¥6,890,000 (Direct Cost: ¥5,300,000、Indirect Cost: ¥1,590,000)
Fiscal Year 2020: ¥11,050,000 (Direct Cost: ¥8,500,000、Indirect Cost: ¥2,550,000)
Fiscal Year 2019: ¥15,990,000 (Direct Cost: ¥12,300,000、Indirect Cost: ¥3,690,000)
Keywordsコンピュータビジョン / 3次元形状推定 / 質感推定 / 三次元形状復元 / 三次元イメージング / 反射率推定 / 質感
Outline of Research at the Start

本研究では,実世界物体を対象にカメラを用いた高精度な質感と三次元形状のディジタル化技術の確立に取り組む.これまでに困難であった画像を用いた質感のディジタル化に取り組み、様々な実環境で有効な「質感+三次元」イメージング技術を開発する.本研究課題の実現により,実世界物体の高精細な「質感+三次元形状」のイメージングが手軽に利用できるようになり,撮影結果を利用して対象シーンを任意の光源下でレンダリングすることができる他,物体認識等の基盤技術の精度向上に貢献できる.

Outline of Final Research Achievements

The goal of this research was to develop a technology to easily generate a digital 3D copy of a real-world object by acquiring both the 3D shape and reflectances of a real-world object as digital data using a camera. Through this research, the technology for simultaneous estimation of 3D shape and reflectance was developed, and digital 3D digitization technology was advanced. While the conventional photographic equipment for 3D digitization is large in scale, this research has also progressed on how to realize it in a compact manner. These results were widely disseminated at international conferences and in international journals.

Academic Significance and Societal Importance of the Research Achievements

本研究は,人間の視覚機能の一部である3次元形状と反射率の認識に関わる機能が,計算機上に実現できるかを問い,またそれを通じて人間の視覚機能の計算可能性について理解するという学術的な意義があります.また,実物体を3次元デジタル化することには,デジタルツイン等における広い応用先があり,産業的,社会的に大きな意義があります.

Report

(6 results)
  • 2023 Final Research Report ( PDF )
  • 2022 Annual Research Report
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • 2019 Comments on the Screening Results   Annual Research Report
  • Research Products

    (20 results)

All 2022 2021 2020 Other

All Int'l Joint Research (5 results) Journal Article (7 results) (of which Int'l Joint Research: 6 results,  Peer Reviewed: 7 results,  Open Access: 3 results) Presentation (8 results) (of which Int'l Joint Research: 8 results)

  • [Int'l Joint Research] Peking University(中国)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] Simon Fraser University(カナダ)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] Meta(米国)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] Peking University(中国)

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] Australian National University(オーストラリア)

    • Related Report
      2021 Annual Research Report
  • [Journal Article] Shape and Albedo Recovery by Your Phone using Stereoscopic Flash and No-Flash Photography2022

    • Author(s)
      Xu Cao, Michael Waechter, Boxin Shi, Ye Gao, Bo Zheng, Fumio Okura, Yasuyuki Matsushita
    • Journal Title

      International Journal of Computer Vision (IJCV)

      Volume: 130 Issue: 6 Pages: 1403-1415

    • DOI

      10.1007/s11263-022-01597-6

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Multispectral Photometric Stereo for Spatially-Varying Spectral Reflectances2022

    • Author(s)
      Heng Guo, Fumio Okura, Boxin Shi, Takuya Funatomi, Yasuhiro Mukaigawa, and Yasuyuki Matsushita
    • Journal Title

      International Journal of Computer Vision (IJCV)

      Volume: 130 Issue: 9 Pages: 2166-2183

    • DOI

      10.1007/s11263-022-01634-4

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Patch-Based Uncalibrated Photometric Stereo Under Natural Illumination2022

    • Author(s)
      Heng Guo, Zhipeng Mo, Boxin Shi, Feng Lu, Sai-Kit Yeung, Ping Tan, and Yasuyuki Matsushita
    • Journal Title

      IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)

      Volume: 44 Issue: 11 Pages: 7809-7823

    • DOI

      10.1109/tpami.2021.3115229

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Bilateral Normal Integration2022

    • Author(s)
      Cao Xu、Santo Hiroaki、Shi Boxin、Okura Fumio、Matsushita Yasuyuki
    • Journal Title

      In Proceedings of European Conference on Computer Vision (ECCV)

      Volume: 1 Pages: 552-567

    • DOI

      10.1007/978-3-031-19769-7_32

    • ISBN
      9783031197680, 9783031197697
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Deep Photometric Stereo for Non-Lambertian Surfaces2022

    • Author(s)
      Chen Guanying、Han Kai、Shi Boxin、Matsushita Yasuyuki、Wong Kwan-Yee K.
    • Journal Title

      IEEE Transactions on Pattern Analysis and Machine Intelligence

      Volume: 44 Issue: 1 Pages: 129-142

    • DOI

      10.1109/tpami.2020.3005397

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Deep Photometric Stereo Networks for Determining Surface Normal and Reflectances2020

    • Author(s)
      Santo Hiroaki、Samejima Masaki、Sugano Yusuke、Shi Boxin、Matsushita Yasuyuki
    • Journal Title

      IEEE Transactions on Pattern Analysis and Machine Intelligence

      Volume: 1 Issue: 1 Pages: 1-1

    • DOI

      10.1109/tpami.2020.3005219

    • Related Report
      2021 Annual Research Report 2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Light structure from pin motion: Geometric point light source calibration2020

    • Author(s)
      Hiroaki Santo, Michael Waechter, Wen-Yan Lin, Yusuke Sugano, Yasuyuki Matsushita
    • Journal Title

      International Journal of Computer Vision (IJCV)

      Volume: - Issue: 7 Pages: 1889-1912

    • DOI

      10.1007/s11263-020-01312-3

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] Normal Integration via Inverse Plane Fitting With Minimum Point-to-Plane Distance2021

    • Author(s)
      Xu Cao, Boxin Shi, Fumio Okura, Yasuyuki Matsushita
    • Organizer
      IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Lighting, Reflectance and Geometry Estimation From 360deg Panoramic Stereo2021

    • Author(s)
      Junxuan Li, Hongdong Li, Yasuyuki Matsushita
    • Organizer
      IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Symmetric-light Photometric Stereo2021

    • Author(s)
      Kazuma Minami, Hiroaki Santo, Fumio Okura, Yasuyuki Matsushita
    • Organizer
      IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Shape-coded ArUco: Fiducial Marker for Bridging 2D and 3D Modalities2021

    • Author(s)
      Lilika Makabe, Hiroaki Santo, Fumio Okura, Yasuyuki Matsushita
    • Organizer
      IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] What is Learned in Deep Uncalibrated Photometric Stereo?2020

    • Author(s)
      Guanying Chen, Michael Waechter, Boxin Shi, Kwan-Yee Kenneth Wong, Yasuyuki Matsushita
    • Organizer
      European Conference on Computer Vision (ECCV)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Deep near-light photometric stereo for spatially varying reflectances2020

    • Author(s)
      Hiroaki Santo, Michael Waechter, Yasuyuki Matsushita
    • Organizer
      European Conference on Computer Vision (ECCV)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Stereoscopic Flash and No-Flash Photography for Shape and Albedo Recovery2020

    • Author(s)
      Xu Cao, Michael Waechter, Boxin Shi, Ye Gao, Bo Zheng, Yasuyuki Matsushita
    • Organizer
      IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Photometric Stereo via Discrete Hypothesis-and-Test Search2020

    • Author(s)
      Kenji Enomoto, Michael Waechter, Kiriakos N. Kutulakos, Yasuyuki Matsushita
    • Organizer
      IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research

URL: 

Published: 2019-04-18   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi