• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

3D Imaging System using Aerial 3D Display

Research Project

Project/Area Number 16K12426
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Multimedia database
Research InstitutionTohoku University

Principal Investigator

Aoki Terumasa  東北大学, 未来科学技術共同研究センター, 准教授 (00302787)

Project Period (FY) 2016-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000)
Fiscal Year 2018: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2017: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2016: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
KeywordsAerial 3D Display / 画像認識 / 3次元点描画 / 形状認識 / 深層学習 / 3D / 画像マッチング / 点描画 / 形状マッチング / 情報通信工学 / 情報システム / 画像 / バーチャルリアリティ
Outline of Final Research Achievements

An image recognition method for digital devices (such as smartphones) to recognize 3D point clouds projected by Aerial 3D Display is developed in this research. The core technology to achieve this is development of a novel image recognition method for light-emitting, point-drawing and semi-transparent objects. To solve this problems, two approaches - a shape-recognition based method and deep-learning based method - are developed. And the effectiveness of these methods are shown in this report.

Academic Significance and Societal Importance of the Research Achievements

本研究の学術的特色は, (1)発光体, (2)点描画, (3)半透明(点描画の点と点の隙間に背景が写るため)という従来画像処理/画像理解分野で研究対象とされることの少なかった被写体を対象に新しい画像マッチング技術を構築する点である. 本研究の成果はAerial 3D Displayで生成された点描画コンテンツのみならず, 従来認識が困難であった(1)~(3)の性質を持つ被写体に対しても認識を可能にするため, その用途も非常に広い.

Report

(4 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Research-status Report
  • 2016 Research-status Report
  • Research Products

    (29 results)

All 2018 2017 2016

All Journal Article (7 results) (of which Int'l Joint Research: 6 results,  Peer Reviewed: 7 results,  Open Access: 6 results) Presentation (22 results) (of which Int'l Joint Research: 17 results,  Invited: 1 results)

  • [Journal Article] Skewness Map: Estimating Object Orientation for High Speed 3D Object Retrieval System2018

    • Author(s)
      Vicky Sintunata, Kurumi KAMINISHI and Terumasa AOKI
    • Journal Title

      International Journal of Intelligent Engineering Informatics

      Volume: vol.2 issue.1-2 Issue: 1/2 Pages: 44-60

    • DOI

      10.1504/ijiei.2018.090997

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Global Distribution Adjustment and Nonlinear Feature Transformation for Automatic Colorization2018

    • Author(s)
      Terumasa AOKI and Van.Ng
    • Journal Title

      Advances in Multimedia

      Volume: vol.2018 Pages: 1-15

    • DOI

      10.1155/2018/1504691

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] A Blur-Invariant Local Feature Descriptor for Gaussian and Motion Blurred Image Matching2017

    • Author(s)
      Qing Tong and Terumasa AOKI
    • Journal Title

      International Journal of Computer Science (IIJCS)

      Volume: vol.5 Issue.10 Pages: 150-161

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Skeletonization in Natural Image using Delaunay Triangulation2017

    • Author(s)
      Vicky Sintunata and Terumasa AOKI
    • Journal Title

      Advances in Science, Technology and Engineering Systems Journal (ASTESJ)

      Volume: vol.2 no.3 Issue: 3 Pages: 1013-1018

    • DOI

      10.25046/aj0203128

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] A Blur-Invariant Interest Point Detector Based on Moment Symmetry for Gaussian and Motion Blurred Image Matching2017

    • Author(s)
      Qing Tong and Terumasa AOKI
    • Journal Title

      International Journal of Signal Processing

      Volume: vol.2 Pages: 96-106

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Skewness Map: Estimating Object Orientation for High Speed 3D Object Retrieval System2017

    • Author(s)
      Vicky Sintunata, Kurumi Kaminishi and Terumasa Aoki
    • Journal Title

      International Journal of Intelligent Engineering Informatics

      Volume: 5

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] 8K/MMT時代のプライバシー保護技術 -ブラー不変マップと定点観測カメラシステムへの応用-2016

    • Author(s)
      青木 輝勝
    • Journal Title

      情報処理

      Volume: 58 Pages: 120-123

    • Related Report
      2016 Research-status Report
    • Peer Reviewed
  • [Presentation] A Convex Approach for Non-rigid Structure from Motion via Sparse Representation2017

    • Author(s)
      Junjie Hu and Terumasa Aoki
    • Organizer
      International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP2017)
    • Place of Presentation
      ポルトガル Port市
    • Year and Date
      2017-02-27
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] 空中3D点描画に対する形状認識に関する検討2017

    • Author(s)
      合田悠治, 上西くるみ, 青木輝勝
    • Organizer
      電子情報通信学会画像工学研究会(IE)
    • Place of Presentation
      北海道大学 (北海道札幌市)
    • Year and Date
      2017-02-21
    • Related Report
      2016 Research-status Report
  • [Presentation] 局所型形状記述子を用いたピクトグラムマッチングの高速化2017

    • Author(s)
      上西くるみ, 青木輝勝
    • Organizer
      電子情報通信学会画像工学研究会(IE)
    • Place of Presentation
      北海道大学 (北海道札幌市)
    • Year and Date
      2017-02-20
    • Related Report
      2016 Research-status Report
  • [Presentation] ピクトグラムマッチングのための輪郭情報を取り入れた局所形状記述子2017

    • Author(s)
      上西くるみ, 青木輝勝
    • Organizer
      情報処理学会第205回コンピュータビジョンとイメージメディア研究会(CVIM)
    • Place of Presentation
      京都大学 (京都府京都市)
    • Year and Date
      2017-01-19
    • Related Report
      2016 Research-status Report
  • [Presentation] Improving the Performance of Non-rigid 3D Shape Recovery by Points Classification2017

    • Author(s)
      Junjie Hu and Terumasa AOKI
    • Organizer
      IAPR International Conference on Machine Vision Applications (IAPR MVA2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Blur-Invariant Local Feature for Motion Blurred Image Matching2017

    • Author(s)
      Qiang Tong and Terumasa AOKI
    • Organizer
      International Conference on Digital Image Processing
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Grey-Scale Skeletonization using Delaunay Triangulation2017

    • Author(s)
      Vicky Sintunata and Terumasa AOKI
    • Organizer
      IEEE International Conference on Consumer Electronics Taiwan (IEEE ICCE-TW2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Novel Blur-Invariant Local Feature Scheme for Image Matching2017

    • Author(s)
      Qiang Tong and Terumasa AOKI
    • Organizer
      IEEE International Conference on Consumer Electronics Taiwan (IEEE ICCE-TW2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Multicolor removal based on Color Lines and Improved Hough Transform for SFS2017

    • Author(s)
      Wang Tianqi and Terumasa AOKI
    • Organizer
      IEEE International Conference on Image Processing (IEEE ICIP2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Non-rigid Structure from Motion via Sparse Self-Expressive Representation2017

    • Author(s)
      Junjie Hu and Terumasa AOKI
    • Organizer
      IEEE International Conference on Image Processing (IEEE ICIP2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Local Descriptor for High-speed and High-performance Pictogram Matching2017

    • Author(s)
      Terumasa AOKI and Kurumi KAMINISHI
    • Organizer
      IEEE International Conference on Image Processing (IEEE ICIP2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Skeleton Extraction in Cluttered Image Based on Delaunay Triangulation2016

    • Author(s)
      Vicky Sintunata; Terumasa Aoki
    • Organizer
      IEEE International Symposium on Multimedia (ISM2016)
    • Place of Presentation
      米国 California州 SanJose市
    • Year and Date
      2016-12-13
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Multicolor removal based on Color Lines for SFS2016

    • Author(s)
      Wang Tianqi and Terumasa Aoki
    • Organizer
      IEEE International Conference on Image Processing (IEEE ICIP2016)
    • Place of Presentation
      米国 Arizona州 Phoenix市
    • Year and Date
      2016-09-27
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Points classification for non-rigid structure from motion2016

    • Author(s)
      Junjie Hu and Terumasa Aoki
    • Organizer
      IEEE International Conference on Image Processing (IEEE ICIP2016)
    • Place of Presentation
      米国 Arizona州 Phoenix市
    • Year and Date
      2016-09-26
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] ブラー不変マップ生成とMMT時代の応用2016

    • Author(s)
      青木輝勝
    • Organizer
      第15回情報科学技術フォーラム
    • Place of Presentation
      富山大学 (富山県富山市)
    • Year and Date
      2016-09-07
    • Related Report
      2016 Research-status Report
    • Invited
  • [Presentation] Enhanced Hemisphere Concept for Color Pixel Classification2016

    • Author(s)
      Nguyen Thi Huyen Van and Terumasa Aoki
    • Organizer
      International Conference on Multimedia Systems and Signal Processing (ICMSSP2016)
    • Place of Presentation
      台湾 台北市
    • Year and Date
      2016-09-03
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Moment Symmetry: A novel method for interest point detection to match blurred and non-blurred images2016

    • Author(s)
      Qiang Tong and Terumasa Aoki
    • Organizer
      IEEE International Conference on Image, Vision and Computing (IEEE ICIVC2016)
    • Place of Presentation
      イギリス Portsmouth市
    • Year and Date
      2016-08-03
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Improved Image Quality in Fast Inpainting with Omnidirectional Filling2016

    • Author(s)
      Ossi Hirvola, Timo Viitanen, Vicky Sintunata and Terumasa Aoki
    • Organizer
      IEEE International Conference on Image, Vision and Computing (IEEE ICIVC2016)
    • Place of Presentation
      イギリス Portsmouth市
    • Year and Date
      2016-08-03
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Object orientation estimation for high speed 3D object retrieval system2016

    • Author(s)
      Vicky Sintunata and Terumasa Aoki
    • Organizer
      International Conference on Information and Communication Technology (ICoICT 2016)
    • Place of Presentation
      インドネシア Bandung
    • Year and Date
      2016-05-25
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] 高精度ピクトグラムマッチングのための射影変換に頑強な特徴量2016

    • Author(s)
      上西くるみ, 青木輝勝
    • Organizer
      情報処理学会第202回コンピュータビジョンとイメージメディア研究会(CVIM)
    • Place of Presentation
      立命館大学いばらきキャンパス (大阪府茨木市)
    • Year and Date
      2016-05-12
    • Related Report
      2016 Research-status Report
  • [Presentation] High speed 3D object retrieval using skewness value2016

    • Author(s)
      Vicky Sintunata and Terumasa Aoki
    • Organizer
      IEEE Region 10 Symposium (IEEE TENSYMP 2016)
    • Place of Presentation
      インドネシア Jakarta市
    • Year and Date
      2016-05-09
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] 3D object retrieval system using skewness database2016

    • Author(s)
      Vicky Sintunata and Terumasa Aoki
    • Organizer
      IEEE International Conference on Control, Decision and Information Technologies (IEEE CoDIT 2016)
    • Place of Presentation
      Maita共和国 St.Paul’sBay
    • Year and Date
      2016-04-06
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2016-04-21   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi