• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

加齢黄斑変性患者の視界を改善するコレクト/コンプリメント・リアリティ(CR)技術

Research Project

Project/Area Number 20K20408
Project/Area Number (Other) 19H05472 (2019)
Research Category

Grant-in-Aid for Challenging Research (Pioneering)

Allocation TypeMulti-year Fund (2020)
Single-year Grants (2019)
Review Section Studies on the Super-Aging Society
Research InstitutionUniversity of Yamanashi

Principal Investigator

茅 暁陽  山梨大学, その他部局等, 理事 (20283195)

Co-Investigator(Kenkyū-buntansha) 藤代 一成  慶應義塾大学, 理工学部(矢上), 教授 (00181347)
柏木 賢治  山梨大学, 大学院総合研究部, 教授 (30194723)
郷 健太郎  山梨大学, 大学院総合研究部, 教授 (50282009)
豊浦 正広  山梨大学, 大学院総合研究部, 教授 (80550780)
Project Period (FY) 2020-04-01 – 2025-03-31
Project Status Granted (Fiscal Year 2023)
Budget Amount *help
¥25,610,000 (Direct Cost: ¥19,700,000、Indirect Cost: ¥5,910,000)
Fiscal Year 2023: ¥2,860,000 (Direct Cost: ¥2,200,000、Indirect Cost: ¥660,000)
Fiscal Year 2022: ¥7,670,000 (Direct Cost: ¥5,900,000、Indirect Cost: ¥1,770,000)
Fiscal Year 2021: ¥5,330,000 (Direct Cost: ¥4,100,000、Indirect Cost: ¥1,230,000)
Fiscal Year 2020: ¥6,500,000 (Direct Cost: ¥5,000,000、Indirect Cost: ¥1,500,000)
Fiscal Year 2019: ¥3,250,000 (Direct Cost: ¥2,500,000、Indirect Cost: ¥750,000)
Keywords加齢黄斑変性 / 変視症 / 視野同定 / Corrected Reality / 適応的視力増強 / 加齢黄斑変性症 / AR・VR・CR / 計算眼科学
Outline of Research at the Start

加齢黄斑変性症(AMD)は,年齢を重ねるに従って網膜の中心に位置し視力の中核的機能を担う黄斑に異常が生じ,見え方の質が著しく低下する病気である.本研究では,老齢者でも患者自らが身近なPC・携帯端末等を用いて自身の症状を手軽に検査でき,その結果に基づいて,日常生活の場面ごとに個人の視覚特性に合致したコンテンツを提示することにより,視野の歪みを軽減し,中心暗点で消失した情報を補い,患者の見え方の質,ひいては生活の質まで大幅に改善させられるような情報工学技術としてCR(Corrected/Complemented Reality)技術を確立する.

Outline of Annual Research Achievements

加齢黄斑変性症(AMD、Age-Related Macular Degeneration)は、年齢を重ねるに従って網膜の中心に位置し視力の中核的機能を担う黄斑に異常が生じ、ものが歪んで見えたり(変視)、視界の中心部が暗くなったり(中心暗点)、 QOV (見え方の質、Quality of Vision)が著しく低下する病気である。本研究では、患者自らが身近なPC・携帯端末等を用いて自身の症状を手軽に検査でき、その結果に基づいて、日常生活の場面ごとに個人の視覚特性に合致したコンテンツを提示することにより、視野の歪みを軽減し、欠損した情報を補い、患者のQOV ひいてはQOL まで大幅に改善させられるような情報工学技術の提案を目的とし、A:視界特性同定、B:視界矯正/補完、C:症状-病態の相互予測の3 つの研究課題から構成されている。
令和5年度の成果として、課題Aについては、視線追跡機能を備えたVRヘッドセットを用いた高速視野同定技術を開発した。臨床用の検査装置は長時間の姿勢維持が必要であり、患者に大きな身体的および心理的負担を与えるという問題があった。提案手法では、空間の階層的表現法である4分木アルゴリズムを用いて簡単な操作で迅速な視野同定を可能にした。10名の正常な視野を持つ協力者に代表的な視野欠損症状を模擬する眼鏡を装着してもらい評価実験を実施したところ、既存手法に比べ、同等以上の精度を得ながら、検査時間を三分の一に短縮することができた。課題Bについては視野矯正補間において視線情報のリアルタイム反映がより重要なため、これまでに開発したシステムにおける視線追跡データの反映法の改善を行った。課題Cの症状-病態相互予測については、最新の深層学習技術を用いてカラー眼底画像から視野検査結果を予測する技術を開発し、既存のOCT画像を用いた手法よりも高い精度で予測することに成功した。

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

新型コロナウィルス感染症の拡大により、本技術のサポート対象である高齢者による評価実験の実施を予定より遅らせる必要があったが、令和6年度に完了予定である

Strategy for Future Research Activity

課題Aについてはすでに令和4年度に2名の患者による評価結果を分析した結果、インタフェースの改善が必要であることが明らかになったため、令和5年度はインタフェースの改善を行い、追加実験の環境を整えたため、令和6年度にさらに4名程度の協力者を募り、評価実験を実施する予定である。また、評価実験の結果を踏まえ、国際会議論文を拡張し論文誌への投稿を行う予定である。課題Bについてはこれまで正常な視野をもつ協力者による模擬的な試験においてよい結果が得られているが、令和6年度は実際の患者による評価実験を実施し、成果を論文にまとめる予定である。課題Cについてはさらに深層学習モデルの改良を行い、精度を改善を図った上で、成果をまとめた論文を投稿する予定である。

Report

(5 results)
  • 2023 Research-status Report
  • 2022 Research-status Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • 2019 Annual Research Report
  • Research Products

    (39 results)

All 2024 2023 2022 2021 2020 2019 Other

All Int'l Joint Research (4 results) Journal Article (23 results) (of which Int'l Joint Research: 11 results,  Peer Reviewed: 23 results,  Open Access: 5 results) Presentation (8 results) (of which Int'l Joint Research: 2 results,  Invited: 1 results) Remarks (3 results) Patent(Industrial Property Rights) (1 results)

  • [Int'l Joint Research] 杭州電子科技大学(中国)

    • Related Report
      2022 Research-status Report
  • [Int'l Joint Research] 杭州電子科技大学(中国)

    • Related Report
      2021 Research-status Report
  • [Int'l Joint Research] 杭州電子科技大学(中国)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] カリフォルニア大学Davis校Computer Science学科(米国)

    • Related Report
      2019 Annual Research Report
  • [Journal Article] Image recoloring for color vision deficiency compensation using Swin transformer2024

    • Author(s)
      Chen Ligeng、Zhu Zhenyang、Huang Wangkang、Go Kentaro、Chen Xiaodiao、Mao Xiaoyang
    • Journal Title

      Neural Computing and Applications

      Volume: 36 Issue: 11 Pages: 6051-6066

    • DOI

      10.1007/s00521-023-09367-2

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Augmented Aroma: The Influence of Augmented Particles' Movement and Color on Emotion during Olfactory Perception2023

    • Author(s)
      Jin Ye-Ji、Omata Masaki、Chang Won-Du、Mao Xiaoyang
    • Journal Title

      Proceedings of the 29th ACM Symposium on Virtual Reality Software and Technology

      Volume: - Pages: 1-2

    • DOI

      10.1145/3611659.3617216

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Metamorphopsia Insepction System Based on Relevance Feedback2023

    • Author(s)
      Zhu Zhenyang、Moritake Katsuhito、Kashiwagi Kenji、Toyoura Masahiro、Go Kentaro、Fujishiro Issei、Mao Xiaoyang
    • Journal Title

      Proceedings of 2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC)

      Volume: - Pages: 4667-4674

    • DOI

      10.1109/smc53992.2023.10394105

    • Related Report
      2023 Research-status Report
    • Peer Reviewed
  • [Journal Article] Deep Learning and Augmented-Reality Glasses based Meat Cooking Support for Color Vision Disorder Compensation2023

    • Author(s)
      Chiba Shota、Zhu Zhenyang、Inoue Daisuke、Mao Xiaoyang
    • Journal Title

      Proceedings of 2023 Nicograph International (NicoInt)

      Volume: - Pages: 62-67

    • DOI

      10.1109/nicoint59725.2023.00019

    • Related Report
      2023 Research-status Report
    • Peer Reviewed
  • [Journal Article] CC-Glasses: Color Communication Support for People with Color Vision Deficiency Using Augmented Reality and Deep Learning2022

    • Author(s)
      Zhenyang Zhu, Jiyi Li, Ying Tang, Kentaro Go, Masahiro Toyoura, Kenji Kashiwagi, Issei Fujishiro, Xiaoyang Mao
    • Journal Title

      Proceedings of Augmented Humans (AHs) 2022

      Volume: 0 Pages: 190-199

    • DOI

      10.1145/3582700.3582707

    • Related Report
      2022 Research-status Report
    • Peer Reviewed
  • [Journal Article] A Study on Contextual Task Performance of Simulated Homonymous Hemianopia Patients with Computational Glasses-based Compensation2022

    • Author(s)
      Chao Ge, Zhenyang Zhu, Keisuke Ichinose, Issei Fujishiro, Kentaro Go, Kenji Kashiwagi, Masahiro Toyoura, Xiaoyang Mao
    • Journal Title

      ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI)

      Volume: 0 Pages: 1-8

    • DOI

      10.1145/3574131.3574441

    • Related Report
      2022 Research-status Report
    • Peer Reviewed
  • [Journal Article] Image recoloring for Red-Green dichromats with compensation range-based naturalness preservation and refined dichromacy gamut2022

    • Author(s)
      Wangkang Huang, Zhenyang Zhu, Ligeng Chen, Kentaro Go, Xiaodiao Chen, Xiaoyang Mao
    • Journal Title

      The Visual Computer

      Volume: 38 Issue: 9-10 Pages: 3405-3418

    • DOI

      10.1007/s00371-022-02549-4

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Swin Transformerを利用した色覚障がい支援用色変換手法2022

    • Author(s)
      陳 立庚,朱 臻陽,郷 健太郎,黄 望康,茅 暁陽
    • Journal Title

      Visual Computing シンポジウム

      Volume: 0 Pages: 1-6

    • Related Report
      2022 Research-status Report
    • Peer Reviewed
  • [Journal Article] Image Recoloring for Color Vision Deficiency Compensation: A Survey2021

    • Author(s)
      Zhenyang Zhu, Xiaoyang Mao
    • Journal Title

      The VISUAL COMPUTER

      Volume: 37 Issue: 12 Pages: 2999-3018

    • DOI

      10.1007/s00371-021-02240-0

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Enhancing Edge Indicator for Visual Field Loss Compensation for Homonymous Hemianopia Patients2021

    • Author(s)
      Keisuke Ichinose, Xi Zhao, Issei Fujishiro, Masahiro Toyoura, Kentaro Go, Kenji Kashiwagi, Xiaoyang Mao
    • Journal Title

      The VISUAL COMPUTER

      Volume: 38 Issue: 4 Pages: 1263-1274

    • DOI

      10.1007/s00371-021-02156-9

    • Related Report
      2021 Research-status Report
    • Peer Reviewed
  • [Journal Article] Behaviors Related to Artificial Visual Field Defects - A Pilot Study of Video-Based Perimetry2021

    • Author(s)
      Changtong Mao, Kentaro Go, Yuichiro Kinoshita, Kenji Kashiwagi, Masahiro Toyoura, Issei Fujishiro, Jianjun Li, Xiaoyang Mao
    • Journal Title

      IEEE ACCESS

      Volume: 9 Pages: 77649-77660

    • DOI

      10.1109/access.2021.3080687

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Fast Contrast and Naturalness Preserving Image Recolouring for Dichromats2021

    • Author(s)
      Xinyi Wang, Zhenyang Zhu, Xiaodiao Chen, Kentaro Go, Masahiro Toyoura, Xiaoyang Mao
    • Journal Title

      COMPUTERS & GRAPHICS-UK

      Volume: 98 Pages: 19-28

    • DOI

      10.1016/j.cag.2021.04.027

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Personalized Image Recoloring for Color Vision Deficiency Compensation2021

    • Author(s)
      Zhenyang Zhu, Masahiro Toyoura, Kentaro Go, Kenji Kashiwagi, Issei Fujishiro, Tien-Tsin Wong, Xiaoyang Mao
    • Journal Title

      IEEE Transactions on Multimedia

      Volume: - Pages: 1721-1734

    • DOI

      10.1109/tmm.2021.3070108

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] LineM: assessing metamorphopsia symptom using line manipulation task2021

    • Author(s)
      Zhenyang Zhu ,Masahiro Toyoura,Issei Fujishiro,Kentaro Go,Kenji Kashiwagi,Xiaoyang Mao
    • Journal Title

      The Visual Computer

      Volume: - Issue: 5 Pages: 1607-1617

    • DOI

      10.1007/s00371-021-02091-9

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Using an Eye Tracking Device to Discriminate Different Symptoms in Glaucoma2020

    • Author(s)
      Lina Chen, Kentaro Go, Yuichiro Kinoshita, Kenji Kashiwagi, Masahiro Toyoura, Issei Fujishiro, Xiaoyang Mao
    • Journal Title

      Proceedings of Cyberworlds 2020

      Volume: - Pages: 141-144

    • DOI

      10.1109/cw49994.2020.00030

    • Related Report
      2020 Research-status Report
    • Peer Reviewed
  • [Journal Article] Visual Field Loss Compensation for Homonymous Hemianopia Patients Using Edge Indicator2020

    • Author(s)
      Keisuke Ichinose, Xi Zhao, Issei Fujishiro, Masahiro Toyoura, Kenji Kashiwagi, Kentaro Go, Xiaoyang Ma
    • Journal Title

      Proceedings of Cyberworlds 2020

      Volume: - Pages: 79-85

    • DOI

      10.1109/cw49994.2020.00019

    • Related Report
      2020 Research-status Report
    • Peer Reviewed
  • [Journal Article] Different Eye Movement Patterns on Simulated Visual Field Defects by Video-watching Task2020

    • Author(s)
      Changtong Mao, Kentaro Go, Yuichiro Kinoshita, Kenji Kashiwagi, Masahiro Toyoura, Issei Fujishiro, Jianjun Li, Xiaoyang Mao
    • Journal Title

      Proceedings of Cyberworlds 2020

      Volume: - Pages: 153-156

    • DOI

      10.1109/cw49994.2020.00033

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Enhancing visual performance of hemianopia patients using overview window2020

    • Author(s)
      Zhao, Xi, Fujishiro, Issei, Go, Kentaro, Toyoura, Masahiro, Kashiwagi, Kenji, Mao, Xiaoyang
    • Journal Title

      Computers & Graphics

      Volume: 29 Pages: 59-67

    • DOI

      10.1016/j.cag.2020.04.001

    • Related Report
      2020 Research-status Report
    • Peer Reviewed
  • [Journal Article] Evaluation of Color Vision Compensation Algorithms for People with Varying Degree of Color Vision Deficiency2020

    • Author(s)
      Xinyi Wang, Zhenyang Zhu, Xiaodiao Chen, Masahiro Toyoura, and Xiaoyang Mao
    • Journal Title

      Proceedings of Cyberworlds 2020

      Volume: - Pages: 149-152

    • DOI

      10.1109/cw49994.2020.00032

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Visual Assessment of Distorted View for Metamorphopsia Patient by Interactive Line Manipulation2019

    • Author(s)
      Hiromichi Ichige, Masahiro Toyoura, Kentaro Go, Kenji Kashiwagi, Issei Fujishiro, Xiaoyang Mao
    • Journal Title

      Proceedings of Cyberworlds 2019

      Volume: 1 Pages: 187-190

    • DOI

      10.1109/cw.2019.00038

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Collaborative visual analysis with multi-level information sharing using a wall-size display and see-through HMDs2019

    • Author(s)
      Tianchen Sun, Yucong Chris Ye, Issei Fujishiro, Kwan-Liu Ma
    • Journal Title

      Proceedings of IEEE PacificVis 2019

      Volume: 1 Pages: 11-20

    • DOI

      10.1109/pacificvis.2019.00010

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Computational alleviation of homonymous visual field defect with OST-HMD2019

    • Author(s)
      Xi Zhao, Kentaro Go, Kenji Kashiwagi, Masahiro Toyoura, Xiaoyang Mao,Issei Fujishiro
    • Journal Title

      Proceedings of Cyberworlds 2019

      Volume: 1 Pages: 175-182

    • DOI

      10.1109/cw.2019.00036

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Eyes-Free Text Entry with EdgeWrite Alphabets for Round-Face Smartwatches (Best paper Award)2019

    • Author(s)
      Kentaro Go, Mei Kikawa, Yuichiro. Kinoshita and Xiaoyang Mao
    • Journal Title

      Proceedings of Cyberworlds 2019

      Volume: 1 Pages: 183-186

    • DOI

      10.1109/cw.2019.00037

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Presentation] Fast Image Recoloring for Anomalous Trichromacy with Contrast Enhancement and Naturalness Preservation2023

    • Author(s)
      Haiqiang Zhou,Wangkang Huang,Zhenyang Zhu,Xiaodiao Chen,Xiaoyang Mao
    • Organizer
      Visual Computing シンポジウム
    • Related Report
      2023 Research-status Report
  • [Presentation] A Personalized Generative Model for Color Vision Deficienc2023

    • Author(s)
      陳 立庚,朱 臻陽,茅 暁陽
    • Organizer
      画像電子学会ビジュアルコンピューティングワークショップ
    • Related Report
      2023 Research-status Report
  • [Presentation] Eye-Tracker-Free Compensation for Metamorphopsia2021

    • Author(s)
      Katsuhito Moritake, Zhenyang Zhu, Masahiro Toyoura, Kentaro Go, Kenji Kashiwagi, Issei Fujishiro, Xiaoyang Mao
    • Organizer
      Cyberworlds 2021
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Relevance feedbackを用いた変視症の検査2021

    • Author(s)
      森竹活仁,朱 臻陽,茅 暁陽
    • Organizer
      情報処理学会 第84回全国大会
    • Related Report
      2021 Research-status Report
  • [Presentation] 同名半盲患者のための視野外情報補償2021

    • Author(s)
      一瀬 佳祐,趙 希,藤代 一成,豊浦 正広,柏木 賢治,郷 健太郎,茅 暁陽
    • Organizer
      情報処理学会第83回全国大会
    • Related Report
      2020 Research-status Report
  • [Presentation] 最適化を利用した二色覚補償のための高速色変換技術2020

    • Author(s)
      Zhenyang Zhu, Xinyi Wang, Xiaodiao Chen, Masahiro Toyoura, Xiaoyang Mao
    • Organizer
      Visual Computing シンポジウム
    • Related Report
      2020 Research-status Report
  • [Presentation] Computational Ophthalmology: Digital Approaches to Visually Impaired Support2019

    • Author(s)
      Xiaoyang Mao
    • Organizer
      IEEE International Conference on Sensors and Nanotechnology
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Use of an Eye-tracking Device for the Detection of Visual Field Defects2019

    • Author(s)
      Lina Chen, Changtong Mao, Kentaro Go, Xiaoyang Mao, Masahiro Toyoura, Kenji Kashiwagi, Zhenyang Zhu, Hiromichi Ichige, Ying Tang, Issei Fujishiro, Xi Zhao, Yuichiro Kinoshita
    • Organizer
      日本バーチャルリアリティ学会第69回サイバースペースと仮想都市研究会
    • Related Report
      2019 Annual Research Report
  • [Remarks] 計算眼科学

    • URL

      https://vc.media.yamanashi.ac.jp/research-ophtalomology/

    • Related Report
      2023 Research-status Report
  • [Remarks] 計算眼科学

    • URL

      http://vc.media.yamanashi.ac.jp/

    • Related Report
      2022 Research-status Report
  • [Remarks] 計算眼科学

    • URL

      http://www.vc.media.yamanashi.ac.jp/ja/research/ophtalomology/

    • Related Report
      2021 Research-status Report 2020 Research-status Report 2019 Annual Research Report
  • [Patent(Industrial Property Rights)] 画像処理方法、画像処理プログラム、及び表示装置2020

    • Inventor(s)
      茅 暁陽,王 欣怡,朱 臻陽,豊浦 正広
    • Industrial Property Rights Holder
      山梨大学
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2020-117905
    • Filing Date
      2020
    • Related Report
      2020 Research-status Report

URL: 

Published: 2019-07-04   Modified: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi