• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of an augmented reality system that includes the estimation functions of the current environment

Research Project

Project/Area Number 16K00707
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Design science
Research InstitutionOsaka University

Principal Investigator

Fukuda Tomohiro  大阪大学, 工学研究科, 准教授 (80379114)

Project Period (FY) 2016-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2018: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2017: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2016: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
Keywordsデザイン設計支援 / 拡張現実感 / 景観 / シミュレーション / 複合現実感 / 環境推定 / 緑視率 / 深層学習 / 天空率 / 隠消現実感 / アルゴリズム / Structure from Motion / 設計工学 / 環境質定量化・予測 / 可視化 / 環境調和型都市基盤整備・建築 / シミュレーション工学
Outline of Final Research Achievements

In this research, an AR (Augmented Reality) system for architectural and urban field was developed which consists of estimation functions of the current environment in addition to overlaying 3D virtual model on live video via the same viewpoint. To realize this challenge, an automatic estimation of green view index, and an optical integrity and occlusion processing between 3D virtual model and live video were implemented using image processing and deep learning technology. After prototype systems have been applied virtual projects in Osaka University Campus, were confirmed the applicability of the system.

Academic Significance and Societal Importance of the Research Achievements

建築・都市分野では,設計対象など現存しない3次元空間や,視野に含まれる緑の量など視認が困難な対象が含まれる.本研究は,これら肉眼では見えない情報を,より高精度・高機能な状態で実現可能なAR(拡張現実)システムを開発したものである.ARは,ユーザーがAR体験している現実空間とつながりを保ちながら,見えない情報を現実空間に重ね合わせることができるため,設計対象地や建設現場などの現実空間で,高い臨場感の中で建築・都市の検討が可能となる.

Report

(4 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Research-status Report
  • 2016 Research-status Report
  • Research Products

    (22 results)

All 2019 2018 2017 2016 Other

All Presentation (21 results) (of which Int'l Joint Research: 16 results) Remarks (1 results)

  • [Presentation] Quantifying Visual Environment by Semantic Segmentation Using Deep Learning2019

    • Author(s)
      Rui Cao, Tomohiro Fukuda, Nobuyoshi Yabuki
    • Organizer
      24th International Conference on Computer-Aided Architectural Design Research in Asia (CAADRIA 2019)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Integrating UAV Development Technology with Augmented Reality Toward Landscape Tele-simulation2019

    • Author(s)
      Liang Yan, Tomohiro Fukuda, Nobuyoshi Yabuki
    • Organizer
      24th International Conference on Computer-Aided Architectural Design Research in Asia (CAADRIA 2019)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Synthesizing 360-Degree Live Streaming for an Erased Background to Study Renovation Using Mixed Reality2019

    • Author(s)
      Yuehan Zhu, Tomohiro Fukuda, Nobuyoshi Yabuki
    • Organizer
      24th International Conference on Computer-Aided Architectural Design Research in Asia (CAADRIA 2019)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Point Cloud Stream on Spatial Mixed Reality: Toward Telepresence in Architectural Field2018

    • Author(s)
      Tomohiro Fukuda, Yuehan Zhu, Nobuyoshi Yabuki
    • Organizer
      36th Annual Conference on Education and research in Computer Aided Architectural Design in Europe (eCAADe 2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Development of Real-time Object Detection System with Diminished Reality for Landscape Design Simulation2018

    • Author(s)
      Daiki Kido, Tomohiro Fukuda, Nobuyoshi Yabuki
    • Organizer
      Asian-Pacific Planning Societies 2018
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Tracking Robustness and Green View Index Estimation of Augmented and Diminished Reality for Environmental Design - PhotoAR+DR2017 project2018

    • Author(s)
      Kazuya Inoue, Tomohiro Fukuda, Rui Cao, Nobuyoshi Yabuki
    • Organizer
      23rd International Conference on Computer-Aided Architectural Design Research in Asia (CAADRIA 2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] SLAM-Based MR with Animated CFD for Building Design Simulation2018

    • Author(s)
      Yuehan Zhu, Tomohiro Fukuda, Nobuyoshi Yabuki
    • Organizer
      23rd International Conference on Computer-Aided Architectural Design Research in Asia (CAADRIA 2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Augmented Realityの動的オクルージョン解決に向けたリアルタイムセマンティックセグメンテーションシステムの開発2018

    • Author(s)
      城戸大輝,福田知弘,矢吹信喜
    • Organizer
      日本建築学会 第41回情報・システム・利用・技術シンポジウム
    • Related Report
      2018 Annual Research Report
  • [Presentation] A Design of Landscape Tele-simulation System Using Unmanned Aerial Vehicle and Augmented Reality2018

    • Author(s)
      Liang Yan, Tomohiro Fukuda, Nobuyoshi Yabuki
    • Organizer
      日本建築学会 第41回情報・システム・利用・技術シンポジウム
    • Related Report
      2018 Annual Research Report
  • [Presentation] A Real-Time Visual Environmental Estimation System Using Image Segmentation: A Prototype for Green View Index2018

    • Author(s)
      Rui Cao, Tomohiro Fukuda, Nobuyoshi Yabuki
    • Organizer
      日本建築学会 第41回情報・システム・利用・技術シンポジウム
    • Related Report
      2018 Annual Research Report
  • [Presentation] Tracking Robustness and Green View Index Estimation of Augmented and Diminished Reality for Environmental Design2018

    • Author(s)
      Kazuya Inoue, Tomohiro Fukuda, Rui Cao and Nobuyoshi Yabuki
    • Organizer
      23rd International Conference on Computer-Aided Architectural Design Research in Asia (CAADRIA 2018)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] SLAM-Based MR with Animated CFD for Building Design Simulation2018

    • Author(s)
      Yuehan Zhu, Tomohiro Fukuda and Nobuyoshi Yabuki
    • Organizer
      23rd International Conference on Computer-Aided Architectural Design Research in Asia (CAADRIA 2018)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Point Cloud Stream on Spatial Mixed Reality: Toward Telepresence in Architectural Field2018

    • Author(s)
      Tomohiro Fukuda, Yuehan Zhu, Nobuyoshi Yabuki
    • Organizer
      36th eCAADe Conference (Education and research in Computer Aided Architectural Design in Europe)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] PhotoAR+DR2016: Automatic Estimation of Green View Index using Image Processing and Augmented and Diminished Reality for Architectural and Urban Design2017

    • Author(s)
      FUKUDA, Tomohiro, INOUE, Kazuya, YABUKI, Nobuyoshi
    • Organizer
      eCAADe2017 (The 35th Education and research in Computer Aided Architectural Design in Europe)
    • Place of Presentation
      Sapienza University of Rome, Italy
    • Year and Date
      2017-09-20
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Optical Integrity of Diminished Reality Using Deep Learning and Sensors2017

    • Author(s)
      FUKUDA, Tomohiro, KUWAMURO, Yasuyuki, YABUKI, Nobuyoshi
    • Organizer
      eCAADe2017 (The 35th Education and research in Computer Aided Architectural Design in Europe)
    • Place of Presentation
      Sapienza University of Rome, Italy
    • Year and Date
      2017-09-20
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] OUTDOOR MAKER-LESS AUGMENTED REALITY SYSTEM FOR VISUALIZING A BUILDING MODEL AND ITS INFORMATION USING SIMULTANEOUS LOCALIZATION AND MAPPING2017

    • Author(s)
      MIYAKE, Munetoshi, FUKUDA, Tomohiro, YABUKI, Nobuyoshi, and MOTAMEDI, Ali
    • Organizer
      CAADRIA2017 (The 22nd International Conference on Computer-Aided Architectural Design Research in Asia)
    • Place of Presentation
      XI'AN JIAOTONG-LIVERPOOL UNIVERSITY, SUZHOU, CHINA
    • Year and Date
      2017-04-05
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Outdoor MarkerLess Augmented Reality - A System for Visualizing Building Models Using Simultaneous Localization and Mapping2017

    • Author(s)
      Munetoshi Miyake, Tomohiro Fukuda, Nobuyoshi Yabuki, and Ali Motamedi
    • Organizer
      22nd International Conference on Computer-Aided Architectural Design Research in Asia (CAADRIA 2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Optical Integrity of Diminished Reality Using Deep Learning2017

    • Author(s)
      Tomohiro Fukuda, Yasuyuki Kuwamuro, Nobuyoshi Yabuki
    • Organizer
      35th eCAADe Conference (Education and research in Computer Aided Architectural Design in Europe)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] PhotoAR+DR2016: Integrating Automatic Estimation of Green View Index and Augmented and Diminished Reality for Architectural Design Simulation2017

    • Author(s)
      Tomohiro Fukuda, Kazuya Inoue, Nobuyoshi Yabuki
    • Organizer
      35th eCAADe Conference (Education and research in Computer Aided Architectural Design in Europe)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] 環境設計支援手法としての緑視率測定と拡張現実機能を有するDiminished Realityシステム2016

    • Author(s)
      井上和哉,福田知弘,矢吹信喜,Ali Motamedi
    • Organizer
      日本建築学会・情報システム技術委員会 第39回情報・システム・利用技術シンポジウム
    • Place of Presentation
      建築会館(東京)
    • Year and Date
      2016-12-08
    • Related Report
      2016 Research-status Report
  • [Presentation] 建築デザイン検討のためのSLAMを用いた屋外型ARシステムの開発2016

    • Author(s)
      三宅宗俊,福田知弘,矢吹信喜,Ali Motamedi
    • Organizer
      日本建築学会・情報システム技術委員会 第39回情報・システム・利用技術シンポジウム
    • Place of Presentation
      建築会館(東京)
    • Year and Date
      2016-12-08
    • Related Report
      2016 Research-status Report
  • [Remarks] 大阪大学 研究者詳細

    • URL

      http://www.dma.jim.osaka-u.ac.jp/view?l=ja&u=7273

    • Related Report
      2017 Research-status Report

URL: 

Published: 2016-04-21   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi