• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Analysis and application of synthetic light field created by projector(Fostering Joint International Research)

Research Project

Project/Area Number 16KK0151
Research Category

Fund for the Promotion of Joint International Research (Fostering Joint International Research)

Allocation TypeMulti-year Fund
Research Field Perceptual information processing
Research InstitutionKyushu University (2017, 2019)
Kagoshima University (2016)

Principal Investigator

Kawasaki Hiroshi  九州大学, システム情報科学研究院, 教授 (80361393)

Project Period (FY) 2017 – 2019
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥14,040,000 (Direct Cost: ¥10,800,000、Indirect Cost: ¥3,240,000)
Keywordsコンピュテーショナルフォトグラフィ / 水中3次元計測 / VR/AR/MR / TOF / スペックル / フェイズマスク / DOE / 3次元計測
Outline of Final Research Achievements

By constructing artificial light fields in space using video projectors or laser light sources, (1) a method for estimating the internal structure of an semi-transparent objects and (2) a method for estimating shape of strong sub-surface scattering or moving objects by making locally unique light fields are proposed. Specifically, in (1), a robust active measurement method for fog or haze environments by using infrared structured light, and refraction removal method at object boundary by self-calibration technique are proposed. In (2), the design of projection patterns resistant to sub-surface scattering and the analysis of laser speckle pattern to estimate micro-movement of object-surface shapes are proposed. These results are accepted by world renowned international conferences and presented.

Academic Significance and Societal Importance of the Research Achievements

研究代表者らが提唱してきたライトフィールド・プロジェクタは,光学系の制約から,空間中に任意のライトフィールドを構築できる訳ではないため,応用分野(目的)によって適切な投影方式が必要となる.本成果では,3次元計測を目的とし,計測ターゲットの性質に基づく時空間的にユニークなパターンを設計することで,過去に実現が困難であった半透明物体や散乱の強い物体の形状計測ができることを示した.これにより,今後さらに幅広い分野でライトフィールド・プロジェクタを用いた,新しい形状や反射特性などの計測手法や,情報提示手法が提案されることが期待される.

Report

(2 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • Research Products

    (33 results)

All 2019 2018 Other

All Int'l Joint Research (4 results) Journal Article (16 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 16 results,  Open Access: 6 results) Presentation (11 results) (of which Int'l Joint Research: 5 results) Remarks (2 results)

  • [Int'l Joint Research] サイモンフレーザー大学(カナダ)2018

    • Year and Date
      2018-08-26
    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] マサチューセッツ工科大学(米国)2018

    • Year and Date
      2018-07-21
    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] Mitsubishi Electric Research Labs(米国)2018

    • Year and Date
      2018-06-30
    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] ライス大学(米国)2018

    • Related Report
      2019 Annual Research Report
  • [Journal Article] 白黒2階調の補助線を用いた幾何歪みに頑健な2次元コードとその復号方式に関する研究2019

    • Author(s)
      鞍津輪一希,上鶴晃平,久冨あすか(鹿児島大学),川崎洋(九州大学),小野智司(鹿児島大学)
    • Journal Title

      情報処理学会論文誌 数理モデルと応用(TOM)

      Volume: 2018-MPS-121 4号

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] UNDERWATER STEREO USING REFRACTION-FREE IMAGE SYNTHESIZED FROM LIGHT FIELD CAMERA2019

    • Author(s)
      Kazuto Ichimaru, Hiroshi Kawasaki
    • Journal Title

      IEEE International Conference on Image Processing ICIP

      Volume: -

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Simultaneous RGB and Depth Image Capture System Using Common Endoscope Based on Hight Frequency Alternative Pattern Projection2019

    • Author(s)
      Ryo Furukawa, Shiro Oka, Takahiro Kotachi,Yuki Okamoto,Shinji Tanaka,Hiroshi Kawasaki
    • Journal Title

      International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)

      Volume: -

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Frame-Wise Auto-Calibration of Projector-Camera Pair of 3D Endoscope2019

    • Author(s)
      Ryo Furukawa, Shiro Oka, Takahiro Kotachi,Yuki Okamoto,Shinji Tanaka,Hiroshi Kawasaki
    • Journal Title

      International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)

      Volume: -

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Non-Contact Cardiac Beat Detection Using Dot-line Based Oneshot Scanner2019

    • Author(s)
      Genki Nagamatsu, Ryo Furukawa, Hiroshi Kawasaki
    • Journal Title

      International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)

      Volume: -

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Learning-based active 3D measurement technique using light field created by video projectors2019

    • Author(s)
      Yuki Shiba1* , Satoshi Ono1 , Ryo Furukawa2 , Shinsaku Hiura2 and Hiroshi Kawasaki3
    • Journal Title

      IPSJ Transactions on Computer Vision and Applications

      Volume: Vol. 11, numbe 6 Issue: 1 Pages: 1-14

    • DOI

      10.1186/s41074-019-0058-y

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Refraction-free Underwater Active One-shot Scan using Light Field Camera2019

    • Author(s)
      Kazuto Ichimaru, Hiroshi Kawasaki(Kyushu Univ.)
    • Journal Title

      第22回画像の認識・理解シンポジウム

      Volume: -

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Simultaneous Shape Registration and Active Stereo Shape Reconstruction using Modified Bundle Adjustment2019

    • Author(s)
      Ryo Furukawa; Genki Nagamatsu; Hiroshi Kawasaki
    • Journal Title

      International Conference on 3D Vision

      Volume: - Pages: 453-462

    • DOI

      10.1109/3dv.2019.00057

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Unified Underwater Structure-from-Motion2019

    • Author(s)
      Kazuto Ichimaru,Yuichi Taguchi,Hiroshi Kawasaki
    • Journal Title

      International Conference on 3D Vision

      Volume: -

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Mobile Photometric Stereo Combined with SLAM for Dense 3D Reconstruction2019

    • Author(s)
      Maxence Remy; Hideaki Uchiyama; Hiroshi Kawasaki; Diego Thomas; Vincent Nozick; Hideo Saito
    • Journal Title

      International Conference on 3D Vision

      Volume: - Pages: 574-582

    • DOI

      10.1109/3dv.2019.00044

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Simultaneous shape and camera-projector parameter estimation for 3D endoscopic system using CNN-based grid-oneshot scan2019

    • Author(s)
      Ryo Furukawa 1 ; Genki Nagamatsu 2 ; Shiro Oka 3 ; Takahiro Kotachi 4 ; Yuki Okamoto 4 ; Shinji Tanaka 4 ; Hiroshi Kawasaki 2
    • Journal Title

      MICCAI workshops AE-CAI, CARE (MIAR)

      Volume: Vol. 6, Iss. 6 Issue: 6 Pages: 249-254

    • DOI

      10.1049/htl.2019.0070

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Human shape reconstruction with loose clothes from partially observed data by pose specific deformation2019

    • Author(s)
      Sayo Akihiko; Onizuka Hayato; Thomas Diego; Nakashima Yuta; Kawasaki Hiroshi; Ikeuchi Katsushi
    • Journal Title

      The Pacific-Rim Symposium on Image and Video Technology (PSIVT)

      Volume: vol 11854 Pages: 225-239

    • DOI

      10.1007/978-3-030-34879-3_18

    • ISBN
      9783030348786, 9783030348793
    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Flooded Road Detection from Driving Recorder: Training Deep Net forRare Event using GANs Semantic Information2019

    • Author(s)
      Sho Nakamura, Shintaro Ono, Hiroshi Kawasaki
    • Journal Title

      第17回ITSシンポジウム2019

      Volume: -

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Flooded Road Detection from Driving Recorder: Training Deep Net forRare Event using GANs Semantic Information2019

    • Author(s)
      Sho Nakamura, Shintaro Ono, Hiroshi Kawasaki
    • Journal Title

      International Journal of Intelligent Transportation Systems Research

      Volume: - Issue: 1 Pages: 1-11

    • DOI

      10.1007/s13177-019-00219-9

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Toward Interactive Self- Annotation For Video Object BoundingBox: Recurrent Self-Learning And Hierarchical Annotation Based Framework2019

    • Author(s)
      Trung-Nghia Le, Sugimoto Akihiro, Shintaro Ono, and Hiroshi Kawasaki
    • Journal Title

      2020 IEEE Winter Conference on Applicans of Computer Vision (WACV)

      Volume: -

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] パターンの最適化による複数平面への文字情報の同時投影手法2019

    • Author(s)
      平尾 勇人,岩口 尭史,川崎 洋
    • Journal Title

      第24回一般社団法人情報処理学会シンポジウム(インタラクション2020)

      Volume: -

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] 3次元内視鏡におけるambient光源にロバストな投影パターン特徴抽出2019

    • Author(s)
      古川 亮, 内藤 雅仁, 宮崎 大輔, 馬場 雅志, 日浦 慎作(広島市大), 岡 志郎, 田中 信治(広島大病院), 川崎 洋(九大)
    • Organizer
      第22回画像の認識・理解シンポジウム
    • Related Report
      2019 Annual Research Report
  • [Presentation] セマンティック情報に基づく複数ドメイン画像変換2019

    • Author(s)
      中村 奨, 小野 晋太郎, 川崎 洋
    • Organizer
      第22回画像の認識・理解シンポジウム
    • Related Report
      2019 Annual Research Report
  • [Presentation] 疎な構造化光による疎な3次元復元形状のパターン間の陰影学習による高密度化2019

    • Author(s)
      岩口 尭史, 栗田 拓弥, 時枝 康大(九大), 古川 亮(広島市大), 川崎 洋(九大)
    • Organizer
      第22回画像の認識・理解シンポジウム
    • Related Report
      2019 Annual Research Report
  • [Presentation] 頭部3次元データの位置合わせによるPPG精度向上2019

    • Author(s)
      永松 元気, Ewa Magdalena Nowara, Amruta Pai, Ashok Veeraraghavan (Rice Univ.), 川崎 洋
    • Organizer
      第22回画像の認識・理解シンポジウム
    • Related Report
      2019 Annual Research Report
  • [Presentation] Labanotation Generation from RGB videos2019

    • Author(s)
      LIU JING, Hiroshi Kawasaki
    • Organizer
      Joint Workshop on Machine Perception and Robotics (MPR2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Densifying sparse shape from sparse structured light measurement by learning shading2019

    • Author(s)
      Takafumi Iwaguchi,Kodai Tokieda,Ryo Furukawa, Hiroshi Kawasaki
    • Organizer
      Joint Workshop on Machine Perception and Robotics (MPR2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] CNNを用いたドットライン検出による堅牢なアクティブ3次元計測2019

    • Author(s)
      永松 元気, 長枝 浩, 川崎 洋
    • Organizer
      ビジョン技術の実利用ワークショップ
    • Related Report
      2019 Annual Research Report
  • [Presentation] Unsupervised 3D Human Pose Estimation with Adversarial Learning2019

    • Author(s)
      Cheng Sun, Diego Thomas, and Hiroshi Kawasaki
    • Organizer
      26th International Workshop on Frontiers of Computer Vision(IW-FCV2020)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Development of underwater 3D-reconstruction system using cross-lasers-based scanner attached on underwater ROV2019

    • Author(s)
      Hanbin Wang, Takafumi Iwaguchi, Naoki Shirakura, Jun Takamatsu, and Hiroshi Kawasaki
    • Organizer
      26th International Workshop on Frontiers of Computer Vision(IW-FCV2020)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Tensor-Based Deep Height Map Reconstruction for Rendering Time-Varying Water Drop Condensation2019

    • Author(s)
      Michihiro Mikamo, Hiroshi Kawasaki
    • Organizer
      26th International Workshop on Frontiers of Computer Vision(IW-FCV2020)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 連続画像を用いた流し撮り画像合成手法2019

    • Author(s)
      三鴨 道弘 , 川崎 洋
    • Organizer
      第177回コンピュータグラフィックスとビジュアル情報学研究発表会
    • Related Report
      2019 Annual Research Report
  • [Remarks] ライトフィールドカメラによる屈折フリー画像生成

    • URL

      http://www.cvg.ait.kyushu-u.ac.jp/ja/research/lytro_refraction_undist.html

    • Related Report
      2019 Annual Research Report
  • [Remarks] 水中におけるMulti-scale CNNを用いたパターン投影ステレオ

    • URL

      http://www.cvg.ait.kyushu-u.ac.jp/ja/research/underwater_projectedpatternstereo.html

    • Related Report
      2019 Annual Research Report

URL: 

Published: 2017-03-15   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi