• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

3D Measurement and AR application using spectral image

Research Project

Project/Area Number 19K12015
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 61010:Perceptual information processing-related
Research InstitutionChiba University

Principal Investigator

Manabe Yoshitsugu  千葉大学, 大学院工学研究院, 教授 (50273610)

Project Period (FY) 2019-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2021: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2020: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2019: ¥2,470,000 (Direct Cost: ¥1,900,000、Indirect Cost: ¥570,000)
Keywords分光画像 / 三次元画像計測 / 拡張現実感
Outline of Research at the Start

本研究は,近年注目されている拡張現実感(Augmented Reality:AR)技術のための,正確な色や形を有するデジタルコンテンツの作成手法を研究開発し理科教育などへの活用を目指すものである.ARにおいて現実空間と仮想物体を違和感なく融合させるには,表示する仮想物体の形状や表面の分光反射率などの光学的特性だけではなく,現実空間の照明環境,物体の形状や分光反射率などの物理的な情報のモデル化が重要となる.そこで本研究では,正確な色や形を有するデジタルコンテンツの作成手法として分光三次元画像計測手法を確立し,分光情報を基礎とした物理モデルベースのAR技術の開発を行う.

Outline of Final Research Achievements

This research has researched a method for measuring the spectral information and three-dimensional shape of an object, and developed a technique for appropriately displaying the obtained virtual object in AR based on the lighting environment in the real space. As a measurement method, the pattern light projection method and the multi-view stereo method was applied. In addition, the lighting environment in the real space was measured using a mirror sphere, enabling AR display of virtual objects with spectral three-dimensional information without discomfort.
The results are effective in a wide range of fields such as education and industry. Furthermore, by applying spectral image technology to the AR field, it may be possible to find new ways to utilize spectral images. In this way, the results of this research have great spillover effects not only in the application of spectral information in AR, but also in the expansion of fields that use AR and new applications of spectral images.

Academic Significance and Societal Importance of the Research Achievements

本研究では,分光画像計測を用いて物体の三次元形状計測ならびに照明環境の計測を実現し,ARへの応用をおこなった.研究成果は,教育分野や産業分野など幅広い分野で有効である.さらに,これまで研究されてきた分光計測技術をARという新しい分野に応用することで,分光画像の新たな活用方法も見出せる可能性がある.このように,本研究の成果は,分光情報のARでの応用だけではなく,ARを利用する分野の拡大や分光画像の新たな応用など大きな波及効果がある.

Report

(4 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Research-status Report
  • 2019 Research-status Report
  • Research Products

    (16 results)

All 2022 2021 2020 2019

All Journal Article (1 results) (of which Peer Reviewed: 1 results,  Open Access: 1 results) Presentation (15 results) (of which Int'l Joint Research: 7 results)

  • [Journal Article] [Paper] Double Sparse Representation for Point Cloud Registration2019

    • Author(s)
      Lu Sun, Yoshitsugu Manabe, Noriko Yata
    • Journal Title

      ITE Transactions on Media Technology and Applications

      Volume: 7 Issue: 3 Pages: 148-158

    • DOI

      10.3169/mta.7.148

    • NAID

      130007673108

    • ISSN
      2186-7364
    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] A study of colored point cloud completion for a human head2022

    • Author(s)
      Yuki Ishida, Yoshitsugu Manabe and Noriko Yata
    • Organizer
      International Workshop on Advanced Image Technology
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Study of Multimodal Head and Gaze Orientation Prediction Techniques in Virtual Space2022

    • Author(s)
      Daiki Higuchi, Yoshitsugu Manabe and Noriko Yata
    • Organizer
      International Workshop on Advanced Image Technology
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 多視点ステレオを用いた分光三次元計測手法の検討2021

    • Author(s)
      堀本泰成, 矢田紀子, 眞鍋佳嗣
    • Organizer
      映像情報メディア学会2021年冬季大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] NeRFを用いた分光三次元計測の研究2021

    • Author(s)
      渡邉大地, 眞鍋佳嗣, 矢田紀子
    • Organizer
      映像情報メディア学会2021年冬季大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] Estimation of 3D Information of Multiple Objects in a Monocular Image2021

    • Author(s)
      Takuma Hirose, Noriko Yata and Yoshitsugu Manabe
    • Organizer
      International Workshop on Advanced Imaging Technology (IWAIT) 2021
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Formulation of optical properties of cloth for CG curtain simulation2021

    • Author(s)
      Yuko Kyogasaka, Yoshitsugu Manabe and Noriko Yata
    • Organizer
      International Workshop on Advanced Imaging Technology (IWAIT) 2021
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] RGBDカメラを用いた頭部の3D再構築手法の検討2020

    • Author(s)
      石田裕基, 矢田紀子, 眞鍋佳嗣
    • Organizer
      映像情報メディア学会創立70周年記念大会講演予稿集
    • Related Report
      2020 Research-status Report
  • [Presentation] 背景条件を緩和したMRインテリアシミュレーションの検討2020

    • Author(s)
      坂井友香, 眞鍋佳嗣, 矢田紀子
    • Organizer
      映像情報メディア学会創立70周年記念大会講演予稿集
    • Related Report
      2020 Research-status Report
  • [Presentation] SLAMを用いた分光三次元計測手法の検討2020

    • Author(s)
      堀本泰成, 矢田紀子, 眞鍋佳嗣
    • Organizer
      映像情報メディア学会創立70周年記念大会講演予稿集
    • Related Report
      2020 Research-status Report
  • [Presentation] Acquisition of Wiping Area Using SLAM for Visualization of Cleaning Area2020

    • Author(s)
      Wataru Yoneda, Yoshitsugu Manabe and Noriko Yata
    • Organizer
      International Workshop on Advanced Image Technology
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Generating 3D Model of Furniture from 3D Point Cloud of Room2020

    • Author(s)
      Shunta Osakama, Yoshitsugu Manabe and Noriko Yata
    • Organizer
      International Workshop on Advanced Image Technology
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Tree Growth Model for Simulation of Appearance Change2020

    • Author(s)
      Maya Takatsuka, Yoshitsugu Manabe and Noriko Yata
    • Organizer
      International Workshop on Advanced Image Technology
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] 物体形状と分光反射率の計測およびARへの応用の検討2019

    • Author(s)
      石田裕基, 眞鍋佳嗣, 矢田紀子
    • Organizer
      映像情報メディア学会2019年冬季大会
    • Related Report
      2019 Research-status Report
  • [Presentation] ARによる周囲環境に対応したカーテンシミュレーション2019

    • Author(s)
      経ヶ阪優子, 眞鍋佳嗣, 矢田紀子
    • Organizer
      映像情報メディア学会2019年冬季大会
    • Related Report
      2019 Research-status Report
  • [Presentation] MRインテリアシミュレーションにおける陰影処理の改善2019

    • Author(s)
      南保遥佳, 眞鍋佳嗣, 矢田紀子
    • Organizer
      映像情報メディア学会2019年冬季大会
    • Related Report
      2019 Research-status Report

URL: 

Published: 2019-04-18   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi