Computer Vision for Shitukan Analysis

• Project Area: Integrative studies of neural mechanisms and advanced information technologies for perception of material and surface qualities
• Project/Area Number: 22135002
• Research Category: Grant-in-Aid for Scientific Research on Innovative Areas (Research in a proposed research area)
• Allocation Type: Single-year Grants
• Review Section: Complex systems
• Research Institution: National Institute of Informatics
• Principal Investigator: SATO Imari 国立情報学研究所, コンテンツ科学研究系, 准教授 (50413927)
• Co-Investigator(Kenkyū-buntansha): SATO Yoichi 東京大学, 生産技術研究所, 教授 (70302627) ; OKABE Takahiro 九州工業大学, 大学院情報工学研究員, 准教授 (00396904)
• Co-Investigator(Renkei-kenkyūsha): LAM Antony 埼玉大学, 理工学研究科, 助教 ; ZHENG Yinqiang 国立情報学研究所, コンテンツ科学研究系, 研究員
• Project Period (FY): 2010-04-01 – 2015-03-31
• Project Status: Completed (Fiscal Year 2014)
• Budget Amount: ¥58,110,000 (Direct Cost: ¥44,700,000、Indirect Cost: ¥13,410,000); Fiscal Year 2014: ¥8,710,000 (Direct Cost: ¥6,700,000、Indirect Cost: ¥2,010,000); Fiscal Year 2013: ¥9,880,000 (Direct Cost: ¥7,600,000、Indirect Cost: ¥2,280,000); Fiscal Year 2012: ¥10,400,000 (Direct Cost: ¥8,000,000、Indirect Cost: ¥2,400,000); Fiscal Year 2011: ¥16,380,000 (Direct Cost: ¥12,600,000、Indirect Cost: ¥3,780,000); Fiscal Year 2010: ¥12,740,000 (Direct Cost: ¥9,800,000、Indirect Cost: ¥2,940,000)
• Keywords: 形状推定 / 反射，蛍光解析 / インバースレンダリング / 質感知覚 / 反射解析 / 蛍光解析 / コンピュータビジョン / コンピュータグラフィックス / 物理ベースドビジョン / 光源推定 / 画像解析 / 質感解析 / 分光解析 / 任意照明下での画像合成 / 視覚情報工学 / 色彩調和 / 品質識別

Outline of Final Research Achievements

The goal of our project is modeling and predicting the complex appearance of real objects under natural illumination conditions. The appearance of an object is greatly influenced by its surface materials as well as the surrounding illumination, and it is essential for scene understanding to be able to predict its variation. We will develop image-based and inverse-rendering approaches to modeling objects’ shapes and reflectance solely from images taken under varying lighting conditions.

Research Products

• [Journal Article] From Intensity Profile to Surface Normal: Photometric Stereo for Unknown Light Sources and Isotropic Reflectances (2015)
  • Author(s): F. Lu, Y. Matsushita, I. Sato, T. Okabe, and Y. Sato
  • Journal Title: IEEE Trans. Pattern Analysis and Machine Intelligence Volume: 未定（先にオンラインで掲載済み） Issue: 10 Pages: 1999-2012
  • DOI: 10.1109/tpami.2015.2389841
  • Peer Reviewed
• [Journal Article] Reflectance and Fluorescence Spectral Recovery via Actively Lit RGB Images (2015)
  • Author(s): Y. Fu, A. Lam, Y. Kobashi, I. Sato, T. Okabe
  • Journal Title: IEEE Trans. Pattern Analysis and Machine Intelligence Volume: 未定
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Reflectance and Fluorescent Spectra recovery based on Fluorescent Chromaticity Invariance under Varying Illumination (2014)
  • Author(s): Fu Y, Lam A, Kobashi Y, Sato I, Okabe T, and Sato Y
  • Journal Title: Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2014) Volume: 未定
  • Peer Reviewed
• [Journal Article] Fast Spectral Reflectance Recovery Using DLP Projector (2013)
  • Author(s): Han S, Sato I, Okabe T, Sato Y
  • Journal Title: International Journal of Computer Vision (IJCV) Volume: 未定 Issue: 2 Pages: 172-184
  • DOI: 10.1007/s11263-013-0687-z
  • Peer Reviewed
• [Journal Article] Image-Based Separation of Reflective and Fluorescent Components using Illumination Variant and Invariant Color (2013)
  • Author(s): C. Zhang, Sato I
  • Journal Title: IEEE Transaction on Pattern Analysis and Machine Intelligence Volume: vol. 35 Issue: 12 Pages: 2866-2877
  • DOI: 10.1109/tpami.2012.255
  • Peer Reviewed
• [Journal Article] Separating Reflective and Fluorescent Components Using High Frequency Illumination in the Spectral Domain (2013)
  • Author(s): Fu Y, Lam A, Sato I, Okabe T, and Sato Y
  • Journal Title: Proc. International Conference on Computer Vision (ICCV 2013) Volume: - Pages: 457-464
  • Peer Reviewed
• [Journal Article] Spectral Imaging Using Basis Lights (2013)
  • Author(s): Lam A, Sato I, and Okabe T, and Sato Y
  • Journal Title: Proc. British Machine Vision Conference (BMVC2013) Volume: -
  • Peer Reviewed
• [Journal Article] Spectral Modeling and Relighting of Reflective-Fluorescent Scenes (2013)
  • Author(s): Lam A and I Sato
  • Journal Title: Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2013) Volume: - Pages: 1452-1459
  • Peer Reviewed
• [Journal Article] Uncalibrated Photometric Stereo for Unknown Isotropic Reflectances (2013)
  • Author(s): Lu F, Matsushita Y, Sato I, Okabe T, and Sato Y
  • Journal Title: Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2013) Volume: - Pages: 1490-1497
  • Peer Reviewed
• [Journal Article] Denoising hyperspectral images using spectral domain statistics (2012)
  • Author(s): A. Lam and I. Sato
  • Journal Title: Proc. International Conference on Pattern Recognition (ICPR 2012) Volume: なし Pages: 477-480
  • Peer Reviewed
• [Journal Article] Camera Spectral Sensitivity Estimation from a Single Image under Unknown Illumination by using Fluorescence (2012)
  • Author(s): Han S, Matsushita Y, Sato I, Okabe T, and Sato Y
  • Journal Title: Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR 2012) Volume: なし Pages: 805-812
  • Peer Reviewed
• [Journal Article] Bispectral Photometric Stereo based on fluorescence (2012)
  • Author(s): I. Sato, T. Okabe, and Y. Sato
  • Journal Title: Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR 2012) Volume: なし Pages: 270-277
  • Peer Reviewed
• [Journal Article] Toward Efficient Acquisition of BRDFs with Fewer Samples (2012)
  • Author(s): Asad Ali, I. Sato, T. Okabe, Y. Sato
  • Journal Title: Proc. Asian Conference on Computer Vision (ACCV 12), Lecture Notes in Computer Science Volume: 7727 Pages: 54-67
  • Peer Reviewed
• [Journal Article] Aesthetic Quality Classification of Photographs Based on Color Harmony (2011)
  • Author(s): M. Nishiyama, T. Okabe, I. Sato, Y. Sato
  • Journal Title: Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR2011) Volume: なし Pages: 33-40
  • Peer Reviewed
• [Journal Article] Separating Reflective and Fluorescent Components of An Image (2011)
  • Author(s): C. Zhang and I. Sato
  • Journal Title: Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR2011) Volume: なし Pages: 185-192
  • Peer Reviewed
• [Journal Article] 照明色変化に基づく蛍光成分と反射成分の分離 (2011)
  • Author(s): 佐藤いまり，Cherry Zhang
  • Journal Title: 画像の認識・理解シンポジウム Volume: なし Pages: 1104-1110
  • Peer Reviewed
• [Journal Article] 複数の注目領域を用いた写真の主観品質の識別 (2010)
  • Author(s): 西山正史, 岡部孝弘, 佐藤洋一, 佐藤いまり
  • Journal Title: 電子情報通信学会論文誌D-II Volume: vol.J93-D,No.8 Pages: 1364-1374
  • Peer Reviewed
• [Journal Article] 色彩調和を用いた写真の主観的品質の識別 (2010)
  • Author(s): 西山正史, 岡部孝弘, 佐藤いまり, 佐藤洋一
  • Journal Title: 画像の認識・理解シンポジウム(MIRU2010) Pages: 478-484
  • Peer Reviewed
• [Journal Article] Fast spectral reflectance recovery using DLP projector (2010)
  • Author(s): H.Shuai, I.Sato, T.Okabe, Y.Sato
  • Journal Title: Proceedings of Asian Conference on Computer Vision (ACCV2010) Pages: 323-335
  • Peer Reviewed
• [Journal Article] Fast Multispectral Imaging (2010)
  • Author(s): H.Shuai, I.Sato, T.Okabe, Y.Sato
  • Journal Title: 画像の認識・理解シンポジウム(MIRU2010) Pages: 1920-1926
• [Presentation] Illumination and Reflectance Spectra Separation of a Hyperspectral Image Meets Low-Rank Matrix Factorization (2015)
  • Author(s): Y. Zheng, I. Sato, and Y. Sato
  • Organizer: IEEE Conference on Computer Vision
  • Place of Presentation: Boston, アメリカ合衆国
  • Year and Date: 2015-06-08 – 2015-06-11
• [Presentation] Spectra Estimation of Fluorescent and Reflective Scenes by Using Ordinary Illuminants (2014)
  • Author(s): Y. Zheng, I. Sato, and Y. Sato
  • Organizer: European Conference on Computer Vision
  • Place of Presentation: チューリッヒ，スイス
  • Year and Date: 2014-09-10
• [Presentation] Interreflection Removal Using Fluorescence (2014)
  • Author(s): Y. Fu, A. Lam, Y. Matsushita, I. Sato, and Y. Sato
  • Organizer: European Conference on Computer Vision
  • Place of Presentation: チューリッヒ，スイス
  • Year and Date: 2014-09-10
• [Presentation] Reflectance and Fluorescent Spectra Recovery based on Fluorescent Chromaticity Invariance under Varying Illumination (2014)
  • Author(s): Y. Fu, A. Lam, Y. Kobashi, I. Sato, T. Okabe, Y. Sato
  • Organizer: IEEE Conference on Computer Vision
  • Place of Presentation: コロンバス, アメリカ合衆国
  • Year and Date: 2014-06-26
• [Presentation] Modeling Complex Appearance of Real Objects (2013)
  • Author(s): Sato I
  • Organizer: The Sixth International Workshop on Image Media Quality and its Applications (IMQA2013)
  • Place of Presentation: 東海大学（東京）
  • Invited
• [Presentation] 蛍光成分存在下における分光反射率復元 (2012)
  • Author(s): 小橋泰之，佐藤いまり，岡部孝弘，佐藤洋一
  • Organizer: 第１５回画像の認識理解シンポジウム
  • Place of Presentation: 福岡国際会議場
• [Presentation] Modeling Complex Appearance of Real Objects (2011)
  • Author(s): I. Sato
  • Organizer: Computer Graphics Workshop
  • Place of Presentation: 国立台湾科政大学（台湾）
  • Invited
• [Remarks] 佐藤いまりホームページ
  • URL: http://research.nii.ac.jp/~imarik/
• [Remarks] 佐藤いまりホームページ
  • URL: http://research.nii.ac.jp/~imarik/