• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Constructing in-situ AR environment for mobile devices

Research Project

Project/Area Number 24300048
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypePartial Multi-year Fund
Section一般
Research Field Media informatics/Database
Research InstitutionOsaka University

Principal Investigator

TAKEMURA Haruo  大阪大学, サイバーメディアセンター, 教授 (60263430)

Co-Investigator(Kenkyū-buntansha) KIYOKAWA Kiyoshi  大阪大学, サイバーメディアセンター, 准教授 (60358869)
MASHITA Tomohiro  大阪大学, サイバーメディアセンター, 講師 (00467606)
中澤 篤志  大阪大学, サイバーメディアセンター, 講師 (20362593)
Project Period (FY) 2012-04-01 – 2015-03-31
Project Status Completed (Fiscal Year 2014)
Budget Amount *help
¥17,940,000 (Direct Cost: ¥13,800,000、Indirect Cost: ¥4,140,000)
Fiscal Year 2014: ¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000)
Fiscal Year 2013: ¥5,980,000 (Direct Cost: ¥4,600,000、Indirect Cost: ¥1,380,000)
Fiscal Year 2012: ¥7,540,000 (Direct Cost: ¥5,800,000、Indirect Cost: ¥1,740,000)
Keywords拡張現実感 / 大規模ARシステム / 国際情報交換 / コンピュータビジョン / パターン認識 / ユーザインタフェース / 携帯端末
Outline of Final Research Achievements

In this project, we developed several methods for in-situ AR system including methods for object/environment reconstruction, methods object/environment authoring, photometric registration, and so on. To actualize editable AR environment, we developed not only the methods to estimate geometric properties including shape of an object and camera position and position but also the methods to estimate optical properties including texture of an object and lighting environment. In addition, we developed user interface for editing those properties. As a result of these development, the stability of the estimation of camera position and pose or reconstruction of environment decreases with time because real environment is constantly changing. Especially optical variation is critical for the feature point tracking. Therefore we tackled to develop a feature point tracking method robust for lighting variation.

Report

(4 results)
  • 2014 Annual Research Report   Final Research Report ( PDF )
  • 2013 Annual Research Report
  • 2012 Annual Research Report
  • Research Products

    (22 results)

All 2015 2014 2013 2012

All Journal Article (3 results) (of which Peer Reviewed: 3 results,  Acknowledgement Compliant: 3 results) Presentation (19 results)

  • [Journal Article] インバースレンダリングに基づく拡張現実感のための光源環境と反射特性のオンライン推定2014

    • Author(s)
      間下 以大, 安原 広幸, プロプスキ アレクサンダー, 清川 清, 竹村, 治雄
    • Journal Title

      電気学会論文誌C

      Volume: 134 Pages: 1473-1480

    • NAID

      130004694085

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Pinch-n-Paste: Direct Texture Transfer Interaction in Augmented Reality2014

    • Author(s)
      Atsushi Umakatsu, Kiyoshi Kiyokawa, Tomohiro Mashita, Haruo Takemura,
    • Journal Title

      Transactions of Virtual Reality Society of Japan

      Volume: 19 Pages: 141-151

    • NAID

      40019838765

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Context-related visualization modes of an AR-based Context-Aware Assembly Support System in Object Assembly,2014

    • Author(s)
      Min Khuong Bui, Kiyoshi Kiyokawa, Andrew Miller, Joseph J. LaViola Jr., Tomohiro Mashita, Haruo Takemura
    • Journal Title

      Transactions of Virtual Reality Society of Japan

      Volume: 19 Pages: 195-205

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] 異なる光源環境における画像特徴の頑健性の調査2015

    • Author(s)
      工藤 彰, Alexander Plopski, Tobias Hollerer, 間下以大, 竹村 治雄, 清川 清
    • Organizer
      情報処理学会CVIM研究会
    • Place of Presentation
      奈良先端科学技術大学院大学
    • Year and Date
      2015-01-22 – 2015-01-23
    • Related Report
      2014 Annual Research Report
  • [Presentation] Reflectance and Lightsource Estimation for Indoor AR Applications,2014

    • Author(s)
      Alexander Plopski, Tomohiro Mashita, Kiyoshi Kiyokawa, and Haruo Takemura
    • Organizer
      The 7th Korea-Japan Workshop on Mixed Reality
    • Place of Presentation
      Jeon-buk, Korea
    • Year and Date
      2014-04-18 – 2014-04-20
    • Related Report
      2014 Annual Research Report
  • [Presentation] Pinch-n-Paste: Texture Transfer Gesture Interaction System with a see-through HMD2014

    • Author(s)
      Mami Mori, Tomohiro Mashita, Kiyoshi Kiyokawa, and Haruo Takemura
    • Organizer
      The 7th Korea-Japan Workshop on Mixed Reality
    • Place of Presentation
      Jeon-buk, Korea
    • Year and Date
      2014-04-18 – 2014-04-20
    • Related Report
      2014 Annual Research Report
  • [Presentation] Reflectance and Light Source Estimation for Indoor AR Applications,2014

    • Author(s)
      Alexander Plopski, Tomohiro Mashita, Kiyoshi Kiyokawa, and Haruo Takemura
    • Organizer
      IEEE Virtual Reality
    • Place of Presentation
      Minnesota, USA
    • Related Report
      2013 Annual Research Report
  • [Presentation] The Effectiveness of an AR-based Context-Aware Assembly Support System in Object Assembly2014

    • Author(s)
      Bui Minh Khuong, Kiyoshi Kiyokawa, Andrew Miller, Joseph J. LaViola Jr., Tomohiro Mashita, and Haruo Takemura
    • Organizer
      IEEE Virtual Reality
    • Place of Presentation
      Minnesota, USA
    • Related Report
      2013 Annual Research Report
  • [Presentation] Reflectance and Lightsource Estimation for Indoor AR Applications2014

    • Author(s)
      lexander Plopski, Tomohiro Mashita, Kiyoshi Kiyokawa, and Haruo Takemura
    • Organizer
      The 7th Korea-Japan Workshop on Mixed Reality
    • Place of Presentation
      Korea
    • Related Report
      2013 Annual Research Report
  • [Presentation] Pinch-n-Paste: Texture Transfer Gesture Interaction System with a see-through HMD2014

    • Author(s)
      Mami Mori, Tomohiro Mashita, Kiyoshi Kiyokawa, and Haruo Takemura
    • Organizer
      The 7th Korea-Japan Workshop on Mixed Reality
    • Place of Presentation
      Korea
    • Related Report
      2013 Annual Research Report
  • [Presentation] Pinch-n-Paste : Direct Texture Transfer Interaction in Augmented Reality2013

    • Author(s)
      Atsushi Umakat su, Tomohiro Mashita, Kiyoshi Kiyokawa, Haruo Takemura
    • Organizer
      IEEE Virtual Reality 2013
    • Place of Presentation
      Frolida, USA
    • Year and Date
      2013-03-18
    • Related Report
      2012 Annual Research Report
  • [Presentation] ARのための光源環境と物体の反射特性のオンライン推定2013

    • Author(s)
      安原広幸, 間下以大, 清川清, 竹村治雄
    • Organizer
      電子情報通信学会 MVE研究会
    • Place of Presentation
      京都大学, 京都府
    • Year and Date
      2013-01-24
    • Related Report
      2012 Annual Research Report
  • [Presentation] Parallel Lighting and Reflectance Estimation based on Inverse Rendering2013

    • Author(s)
      Tomohiro Mashita, Hiroyuki Yasuhara, Alexander Plopski, Kiyoshi Kiyokawa and Haruo Takemura
    • Organizer
      The 23rd International Conference on Artificial Reality and Telexistence
    • Place of Presentation
      Tokyo
    • Related Report
      2013 Annual Research Report
  • [Presentation] In-situ Lighting and Reflectance Estimation for indoor AR systems2013

    • Author(s)
      Tomohiro Mashita, Hiroyuki Yasuhara, Alexander Plopski, Kiyoshi Kiyokawa, Haruo Takemura
    • Organizer
      IEEE International Symposium on Mixed and Augmented Reality
    • Place of Presentation
      Adelaide, Australia
    • Related Report
      2013 Annual Research Report
  • [Presentation] A Study on an AR-based Toy-block Assembly Support System with Automatic Error Detection2013

    • Author(s)
      Bui Minh Khuong, Kiyoshi Kiyokawa, Tomohiro Mashita, and Haruo Takemura
    • Organizer
      The 6th Korea-Japan Workshop on Mixed Reality
    • Place of Presentation
      Okinawa, Japan
    • Related Report
      2013 Annual Research Report
  • [Presentation] インバースレンダリングに基づく拡張現実感のための光源環境と物体の反射特性の推定2013

    • Author(s)
      安原 広幸, 間下 以大, プロプスキ アレクサンダー, 清川 清, 竹村 治雄
    • Organizer
      第18回バーチャルリアリティ学会大会
    • Place of Presentation
      大阪
    • Related Report
      2013 Annual Research Report
  • [Presentation] Pinch-n-Paste : Direct Texture Transfer Interaction in Augmented Reality2012

    • Author(s)
      Atsushi Umakatsu, Tomohiro Mashita, Kiyoshi Kiyokawa, Haruo Takemura
    • Organizer
      ACM Symp. on Virtual Reality Software and Technology (VRST)
    • Place of Presentation
      Toronto, Canada
    • Year and Date
      2012-12-10
    • Related Report
      2012 Annual Research Report
  • [Presentation] Touch-n-Paste : Direct Texture Transfer Interaction in AR Environments2012

    • Author(s)
      At sushi Umakatsu, Tomohiro Mashita, Kiyoshi Kiyokawa, Haruo Takemura
    • Organizer
      International Symposium on Mixed and Augmented Reality 2012
    • Place of Presentation
      Atlanta, Georgia
    • Year and Date
      2012-11-03
    • Related Report
      2012 Annual Research Report
  • [Presentation] タブレット端末と据置型距離センサを用いたARインテリアデザインシステム2012

    • Author(s)
      越智惇也, 間下以大, 清川清, 竹村治雄
    • Organizer
      ヒューマンインタフェースシンポジウム
    • Place of Presentation
      九州大学, 福岡県
    • Year and Date
      2012-09-07
    • Related Report
      2012 Annual Research Report
  • [Presentation] AR Diorama : Natural hand and Tangible AR Interaction System2012

    • Author(s)
      Atsushi Umakatsu, ThammaChip Piumsomboon, Adrian Clark, Tomohiro Mashita, Kiyoshi Kiyokawa, Haruo Takemura, and Mark Billinghurst
    • Organizer
      Korea-Japan Workshop on Mixed Reality (KJMR)
    • Place of Presentation
      Seoul, Korea
    • Year and Date
      2012-04-14
    • Related Report
      2012 Annual Research Report
  • [Presentation] A 3D Reconstruction Method Based on Appearance Consistency for an AR Diorama System2012

    • Author(s)
      Hiroyuki Yasuhara, Tomohiro Mashita, Kiyoshi Kiyokawa, and Haruo Takeiura
    • Organizer
      Korea-Japan Workshop on Mixed Reality (KJMR)
    • Place of Presentation
      Seoul, Korea
    • Year and Date
      2012-04-14
    • Related Report
      2012 Annual Research Report
  • [Presentation] An AR Interior Design System using a Tablet Device and a Real-time Range Sensor2012

    • Author(s)
      Junya Ochi, Tomohiro Mash it a, Kiyoshi Kiyokawa, and Haruo Takemura
    • Organizer
      Korea-Japan Workshop on Mixed Reality (KJMR)
    • Place of Presentation
      Seoul, Korea
    • Year and Date
      2012-04-14
    • Related Report
      2012 Annual Research Report

URL: 

Published: 2012-04-24   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi