• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Augmented Reality based on Ensuring Perceptual Consistency

Research Project

Project/Area Number 20H00608
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Review Section Medium-sized Section 61:Human informatics and related fields
Research InstitutionNara Institute of Science and Technology

Principal Investigator

Kato Hirokazu  奈良先端科学技術大学院大学, デジタルグリーンイノベーションセンター, 教授 (70221182)

Co-Investigator(Kenkyū-buntansha) 天野 敏之  和歌山大学, システム工学部, 教授 (60324472)
蒲池 みゆき  工学院大学, 情報学部(情報工学部), 教授 (70395101)
山本 豪志朗  京都大学, 医学研究科, 准教授 (70571446)
斎藤 英雄  慶應義塾大学, 理工学部(矢上), 教授 (90245605)
Project Period (FY) 2020-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥44,850,000 (Direct Cost: ¥34,500,000、Indirect Cost: ¥10,350,000)
Fiscal Year 2023: ¥12,350,000 (Direct Cost: ¥9,500,000、Indirect Cost: ¥2,850,000)
Fiscal Year 2022: ¥10,790,000 (Direct Cost: ¥8,300,000、Indirect Cost: ¥2,490,000)
Fiscal Year 2021: ¥9,750,000 (Direct Cost: ¥7,500,000、Indirect Cost: ¥2,250,000)
Fiscal Year 2020: ¥11,960,000 (Direct Cost: ¥9,200,000、Indirect Cost: ¥2,760,000)
Keywords拡張現実感 / 認知的整合性 / 知覚・認知プロセス
Outline of Research at the Start

拡張現実感(以下AR)とは、仮想物体をあたかもそれが現実世界に存在するかのように表示する技術である。ARの目的は、現実環境に直感的でわかりやすい情報を付加することで、ユーザの活動を支援することであり、心理的な側面からの評価が重要である。このような評価基準で考えられたARを、我々は認知的整合性駆動型ARと定義した。本研究は、以下の4つの研究項目を設定し、この認知的整合性駆動型ARを実現する技術の確立を目指す。
・現実環境の状況に依存した仮想物体の知覚・認知プロセスのモデル化
・知覚・認知プロセスの逆変換技術の構築
・認知的整合性駆動型仮想物体表示パイプラインの実現
・認知的整合性駆動型ARの有効性評価

Outline of Final Research Achievements

Augmented reality is a technology that displays virtual objects and information to the user as if they existed in the real world. Conventionally, such technologies have been evaluated based on the consistency of physical appearance, but we believe that consistency in psychological appearance is more suitable for the purpose of task support, and have defined this as cognitive consistency-driven augmented reality. In this study, we modeled the perception and recognition process of virtual objects to express the psychological appearance relative to the physical appearance, with the aim of establishing a technology that realizes cognitive consistency-driven augmented reality. We then constructed an evaluation system and conducted comparative experiments with a conventional system to demonstrate the effectiveness of cognitive consistency-driven augmented reality.

Academic Significance and Societal Importance of the Research Achievements

近年、拡張現実感が様々な場面で使われるようになった。これは、拡張現実感技術の優れた情報伝達能力が認められるようになったからである。しかし、これまでの拡張現実感研究における情報伝達能力の評価は、物理的な尺度によって行われてきた。この場合、提示された情報を人間が正しく認識したかどうかまでは考慮されない。この研究の成果である認知的整合性駆動型拡張現実感技術は、人間が情報を認識する過程を含めて情報伝達性能の向上を狙ったもので、例えば、錯視現象によって誤って認識されることまでも加味して正確な情報伝達を実現する技術である。これにより、ユーザに対し、より的確に情報を提供するシステムを実現できる。

Report

(6 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Annual Research Report
  • 2021 Annual Research Report
  • 2020 Comments on the Screening Results   Annual Research Report
  • Research Products

    (52 results)

All 2024 2023 2022 2021

All Journal Article (12 results) (of which Peer Reviewed: 11 results,  Open Access: 11 results) Presentation (40 results) (of which Int'l Joint Research: 18 results,  Invited: 4 results)

  • [Journal Article] The importance of self-body visibility for movements in virtual reality2024

    • Author(s)
      湯村 颯悟、尾上 凌太、蒲池 みゆき
    • Journal Title

      Transactions of the Virtual Reality Society of Japan

      Volume: 29 Issue: 1 Pages: 49-56

    • DOI

      10.18974/tvrsj.29.1_49

    • ISSN
      1344-011X, 2423-9593
    • Year and Date
      2024-03-31
    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] 光線場投影を用いた光学モデルに基づく異方性反射の操作2024

    • Author(s)
      大隅 祥伍、天野 敏之
    • Journal Title

      日本バーチャルリアリティ学会論文誌

      Volume: 29

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Effects on Size Perception by Changing Dynamic Invisible Body Size2024

    • Author(s)
      Ryota Kondo、Maki Sugimoto、Hideo Saito
    • Journal Title

      Proceedings of 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)

      Volume: - Pages: 733-734

    • DOI

      10.1109/vrw62533.2024.00163

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Augmented reality encouraging proper speed control by drivers2023

    • Author(s)
      淺田 樹生、澤邊 太志、藤本 雄一郎、神原 誠之、加藤 博一
    • Journal Title

      Transactions of the Virtual Reality Society of Japan

      Volume: 28 Issue: 3 Pages: 211-220

    • DOI

      10.18974/tvrsj.28.3_211

    • ISSN
      1344-011X, 2423-9593
    • Year and Date
      2023-09-30
    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Robust Appearance Manipulation against Changes in the Lighting Environment2023

    • Author(s)
      岡本 侑汰郎、天野 敏之
    • Journal Title

      Transactions of the Virtual Reality Society of Japan

      Volume: 28 Issue: 3 Pages: 271-279

    • DOI

      10.18974/tvrsj.28.3_271

    • ISSN
      1344-011X, 2423-9593
    • Year and Date
      2023-09-30
    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Viewpoint dependent Gloss Enhancement for Glossy Objects using Light Field Feedback2023

    • Author(s)
      松本 侑大、天野 敏之
    • Journal Title

      Transactions of the Virtual Reality Society of Japan

      Volume: 28 Issue: 3 Pages: 255-262

    • DOI

      10.18974/tvrsj.28.3_255

    • ISSN
      1344-011X, 2423-9593
    • Year and Date
      2023-09-30
    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] A Study of Real-World Information Mapping for Information Sharing Using Edge Devices2023

    • Author(s)
      Hara Takenori、Saito Hideo
    • Journal Title

      Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2024)

      Volume: - Pages: 477-484

    • DOI

      10.1145/3603421.3603438

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Operating Room Surveillance Video Analysis for Group Activity Recognition2023

    • Author(s)
      Yokoyama Koji、Yamamoto Goshiro、Liu Chang、Kishimoto Kazumasa、Kuroda Tomohiro
    • Journal Title

      Advanced Biomedical Engineering

      Volume: 12 Issue: 0 Pages: 171-181

    • DOI

      10.14326/abe.12.171

    • ISSN
      2187-5219
    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Cognition of self-body affects performances in Virtual Reality environment2022

    • Author(s)
      湯村颯悟、蒲池みゆき
    • Journal Title

      Transactions of the Virtual Reality Society of Japan

      Volume: 27 Issue: 4 Pages: 291-300

    • DOI

      10.18974/tvrsj.27.4_291

    • ISSN
      1344-011X, 2423-9593
    • Year and Date
      2022-12-28
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Recognition of Instrument Passing and Group Attention for Understanding Intraoperative State of Surgical Team2022

    • Author(s)
      横山晃士,山本豪志朗,劉暢,杉山治,黒田知宏
    • Journal Title

      Advanced Biomedical Engineering

      Volume: 11 Issue: 0 Pages: 37-47

    • DOI

      10.14326/abe.11.37

    • NAID

      130008160196

    • ISSN
      2187-5219
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] プロジェクターによって拡張される実世界 プロジェクションによる適応的な見かけの操作の原理と応用2022

    • Author(s)
      天野敏之
    • Journal Title

      日本光学会機関紙「光学」

      Volume: 52 (1), 2-7, 2023-01 Pages: 2-7

    • Related Report
      2022 Annual Research Report
  • [Journal Article] [Paper] Driver Visibility Improvement using Spatial Augmented Reality with Pixelated Headlights2022

    • Author(s)
      Toshiyuki Amano, Takaya Kano
    • Journal Title

      ITE Transactions on Media Technology and Applications

      Volume: 10 Issue: 4 Pages: 171-177

    • DOI

      10.3169/mta.10.171

    • ISSN
      2186-7364
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] 軌跡に重み付けされた単一方向動作への順応が異方向動作に及ぼす影響2024

    • Author(s)
      湯村 颯悟、尾上 凌太、蒲池 みゆき
    • Organizer
      日本視覚学会2024年冬季大会
    • Related Report
      2023 Annual Research Report
  • [Presentation] バーチャル空間の自然な動作の丁寧さと自己身体可視性との関係2023

    • Author(s)
      湯村 颯悟、尾上 凌太、蒲池 みゆき
    • Organizer
      第28回日本バーチャルリアリティ学会大会
    • Related Report
      2023 Annual Research Report
  • [Presentation] 軌跡に重み付けされた手の一方向性運動学習がリーチング動作に及ぼす影響2023

    • Author(s)
      尾上 凌太、湯村 颯悟、蒲池 みゆき
    • Organizer
      第28回日本バーチャルリアリティ学会大会
    • Related Report
      2023 Annual Research Report
  • [Presentation] 身体の可視性有無による自然な動作の「丁寧さ」への影響2023

    • Author(s)
      湯村 颯悟、尾上 凌太、蒲池 みゆき
    • Organizer
      日本視覚学会2023年夏季大会
    • Related Report
      2023 Annual Research Report
  • [Presentation] 軌跡に重み付けされた手と一方向性運動の協応が自己受容感覚に及ぼす影響2023

    • Author(s)
      尾上 凌太、湯村 颯悟、蒲池 みゆき
    • Organizer
      日本視覚学会2023年夏季大会
    • Related Report
      2023 Annual Research Report
  • [Presentation] Object-wise Individual Appearance Manipulation with Layer Detection2023

    • Author(s)
      Takahiro Nagata、Toshiyuki Amano
    • Organizer
      15th Asia-Pacific Workshop on Mixed and Augmented Reality
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 周辺領域との輝度差を考慮した光線場投影による違和感のないBRDF提示2023

    • Author(s)
      小段海人、天野敏之
    • Organizer
      日本バーチャルリアリティ学会第28回大会
    • Related Report
      2023 Annual Research Report
  • [Presentation] 五つのプロジェクタカメラ系を用いた対象物体の全周囲に対する見かけの操作2023

    • Author(s)
      山本奨騎、天野敏之
    • Organizer
      日本バーチャルリアリティ学会第28回大会
    • Related Report
      2023 Annual Research Report
  • [Presentation] 複数レイヤの同時見かけの制御2023

    • Author(s)
      永田剛大、天野敏之
    • Organizer
      画像の認識・理解シンポジウム
    • Related Report
      2023 Annual Research Report
  • [Presentation] 自由視点画像生成のためのフォーカルスタックによる多層シーン表現2023

    • Author(s)
      石川玲奈,森尚平,上田 栞,デニス・カルコーフェン,斎藤英雄
    • Organizer
      日本バーチャルリアリティ学会 複合現実感研究会
    • Related Report
      2022 Annual Research Report
  • [Presentation] A Study of Real-World Information Mapping for Information Sharing Using Edge Devices2023

    • Author(s)
      Takenori Hara, Hideo Saito
    • Organizer
      the 7th International Conference on Virtual and Augmented Reality Simulations (ICVARS2023)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Manipulation of anisotropic reflections based on optical models using multiple projectors2022

    • Author(s)
      Shogo Ohsumi, Toshiyuki Amano
    • Organizer
      14th APMAR 2022
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Cast-Shadow Removal for Cooperative Adaptive Appearance Manipulation2022

    • Author(s)
      Shoko Uesaka, Toshiyuki Amano
    • Organizer
      ICAT - EGVE - International Conference on Artificial Reality and Telexistence - Eurographics Symposium on Virtual Environments 2022
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] プロジェクタカメラ系によるリアリティの操作2022

    • Author(s)
      天野敏之
    • Organizer
      電気関係学会関西連合大会
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] A new planetarium harmonized with natural starry sky2022

    • Author(s)
      Chisato Yamauchi, Toshiyuki Amano, Masami Okyudo
    • Organizer
      IDW'22 - The 28th International Display Workshop
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Robust Appearance Manipulation against Changes in the Lighting Environment2022

    • Author(s)
      Yutaro Okamoto, Toshiyuki Amano
    • Organizer
      IDW'22 - The 28th International Display Workshop
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 照明環境の変動に頑強な見かけの制御2022

    • Author(s)
      岡本侑汰郎, 天野敏之
    • Organizer
      画像の認識・理解シンポジウム 2022
    • Related Report
      2022 Annual Research Report
  • [Presentation] 2軸移動に対応した見かけの操作における投影のずれ補償2022

    • Author(s)
      狩野貴哉, 天野 敏之
    • Organizer
      画像の認識・理解シンポジウム 2022
    • Related Report
      2022 Annual Research Report
  • [Presentation] 部位依存の劣化に対応する空間拡張現実感を用いた視覚補助2022

    • Author(s)
      東 奏太, 天野 敏之
    • Organizer
      画像の認識・理解シンポジウム 2022
    • Related Report
      2022 Annual Research Report
  • [Presentation] Perceptual BRDF manipulation by 4-DoF Light Field Projection using Multiple Mirrors and Projectors2022

    • Author(s)
      Kayo Kimura, Toshiyuki Amano
    • Organizer
      19th EuroXR International Conference - EuroXR 2022
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Multiple Mirror based Arbitrary Lighting Environment Reproduction2022

    • Author(s)
      Toshiyuki Amano, Raichi Kubo
    • Organizer
      19th EuroXR International Conference - EuroXR 2022
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Advanced Reality: Real-world Appearance Manipulation with Projector Camera Systems2022

    • Author(s)
      Toshiyuki Amano
    • Organizer
      IMID 2022, 06. AR/VR/MR and 3D Display Optics
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 複数の鏡とプロジェクタを用いた光線空間の生成による質感表示2022

    • Author(s)
      木村佳代, 天野敏之
    • Organizer
      画像の認識・理解シンポジウム 2022
    • Related Report
      2022 Annual Research Report
  • [Presentation] Geometric Calibration with Multi-Viewpoints for Multi-Projector Systems on Arbitrary Shapes Using Homography and Pixel Maps2022

    • Author(s)
      A. Ueno, T. Amano, C. Yamauchi
    • Organizer
      2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Apparent Shape Manipulation by Light-Field Projection onto a Retroreflective Surface2022

    • Author(s)
      J. Kanaya, T. Amano
    • Organizer
      2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Geometric Calibration with Multi-Viewpoints for Multi-Projector Systems on Arbitrary Shapes Using Homography and Pixel Maps2021

    • Author(s)
      A. Ueno, T. Amano, C. Yamauchi
    • Organizer
      2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Apparent Shape Manipulation by Light-Field Projection onto a Retroreflective Surface2021

    • Author(s)
      J. Kanaya, T. Amano
    • Organizer
      2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 高速インスタンスセグメンテーションを用いた投影による選択的色操作の提案2021

    • Author(s)
      小石原遼, 天野敏之, 渡辺義浩
    • Organizer
      研究報告コンピュータビジョンとイメージメディア(CVIM)
    • Related Report
      2021 Annual Research Report
  • [Presentation] プロジェクタとカメラを用いた光学フィードバックによる現実世界の操作2021

    • Author(s)
      天野敏之
    • Organizer
      レーザー学会学術講演会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 光学限界を超える見かけの操作に関する考察2021

    • Author(s)
      天野敏之
    • Organizer
      日本光学会情報フォトニクス研究グループ第6回MIETA+ワーキンググループ研究会
    • Related Report
      2021 Annual Research Report
    • Invited
  • [Presentation] A Study on Shadow Removal for Viewing Direction Dependent Appearance Manipulation2021

    • Author(s)
      Yudai Matsumoto, Toshiyuki Amano
    • Organizer
      18th EuroXR International Conference - EuroXR 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Automotive lighting technology for driver's visibility improvement using imperceptible pattern illumination2021

    • Author(s)
      Toshiyuki Amano, Keigo Takemine, Junna Tsukuma
    • Organizer
      IDW'21 - The 28th International Display Workshop
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Projection Alignment Correction for In-Vehicle Projector-Camera System2021

    • Author(s)
      Toshiyuki Amano, Taichi Kagawa
    • Organizer
      ICAT-EGVE 2021 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 見かけの制御の分散協調投影のための重畳部分の輝度補正2021

    • Author(s)
      上坂 祥子, 天野 敏之
    • Organizer
      画像の認識・理解シンポジウム 2021
    • Related Report
      2021 Annual Research Report
  • [Presentation] リアル星空とのハイブリッドプラネタリウムのための外構プロジェクションに関する研究2021

    • Author(s)
      上野 敦矢, 國枝 志帆, 天野 敏之, 山内 千里
    • Organizer
      画像の認識・理解シンポジウム 2021
    • Related Report
      2021 Annual Research Report
  • [Presentation] 複数のプロジェクタを用いた視点依存の見かけの操作の立体物への適応2021

    • Author(s)
      大隅 祥伍, 天野 敏之
    • Organizer
      画像の認識・理解シンポジウム 2021
    • Related Report
      2021 Annual Research Report
  • [Presentation] クレイク・オブライエン効果を応用した投影対象の存在感を低減させる光学イリュージョンの提案2021

    • Author(s)
      松本 侑大, 天野 敏之
    • Organizer
      画像の認識・理解シンポジウム 2021
    • Related Report
      2021 Annual Research Report
  • [Presentation] プロジェクタアレイを用いた立体物上でのBRDF の提示2021

    • Author(s)
      金谷 慈恩, 天野 敏之
    • Organizer
      画像の認識・理解シンポジウム 2021
    • Related Report
      2021 Annual Research Report
  • [Presentation] Effects of Skin and Water Conditions on Water Surface Perception2021

    • Author(s)
      Kohei Kawamata, Miyuki G.Kamachi
    • Organizer
      International Symposium on Advanced Technology
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Influencing Driving Speed Using Perception-Based Augmented Reality2021

    • Author(s)
      Nicko R. Caluya, Yuichiro Fujimoto, Masayuki Kanbara, Hirokazu Kato
    • Organizer
      Asia-Pacific Workshop on Mixed and Augmented Reality 2021 (APMAR2021)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research

URL: 

Published: 2020-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi