Realization of Corneal Feedback AR

• Project/Area Number: 15H02738
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Human interface and interaction
• Research Institution: Nara Institute of Science and Technology (2017); Osaka University (2015-2016)
• Principal Investigator: Kiyokawa Kiyoshi 奈良先端科学技術大学院大学, 情報科学研究科, 教授 (60358869)
• Co-Investigator(Kenkyū-buntansha): 間下 以大 大阪大学, サイバーメディアセンター, 准教授 (00467606) ; 中澤 篤志 京都大学, 情報学研究科, 准教授 (20362593)
• Project Period (FY): 2015-04-01 – 2018-03-31
• Project Status: Completed (Fiscal Year 2017)
• Budget Amount: ¥16,250,000 (Direct Cost: ¥12,500,000、Indirect Cost: ¥3,750,000); Fiscal Year 2017: ¥5,070,000 (Direct Cost: ¥3,900,000、Indirect Cost: ¥1,170,000); Fiscal Year 2016: ¥5,720,000 (Direct Cost: ¥4,400,000、Indirect Cost: ¥1,320,000); Fiscal Year 2015: ¥5,460,000 (Direct Cost: ¥4,200,000、Indirect Cost: ¥1,260,000)
• Keywords: 拡張現実 / 角膜反射 / 視線推定 / ユーザインタフェース

Outline of Final Research Achievements

Targeting augmented reality (AR) using optical see-through head mounted displays (HMD), we worked on the research and development of a new AR concept "cornea feedback AR" that optimizes the user experience by corneal imaging. Specifically, we developed a method for automatically calibrating the eyeball center in the HMD coordinate system from corneal reflection images, and a method for accurately estimating the gaze direction with an error of about 1.7 degrees using corneal reflection images. We also developed a method to robustly and accurately match corneal images with images of a scene camera, and based on this, developed a system that automatically finds eye contacts. In addition, we developed a system that automatically diagnoses anomaly eye movement from gaze behaviors and a system that a user can replay a fast 3D motion at a slower speed slow around the area of point of gaze.

Research Products

• [Int'l Joint Research] Georgia Institute of Technology(米国)
• [Int'l Joint Research] IFSTTAR(フランス)
• [Int'l Joint Research] Augusta University/University of Kansas Medical Center(米国)
• [Int'l Joint Research] Technical University of Munich(ドイツ)
• [Int'l Joint Research] Technical University of Munich/The German Res. Cen. for Art. Int.(Germany)
• [Int'l Joint Research] Graz University of Technology(Austria)
• [Int'l Joint Research] Mississippi State University(米国)
• [Journal Article] Computational Tender-Care Science: Computational and Cognitive Neuroscientific Approaches for Understanding the Tender Care (2018)
  • Author(s): Nakazawa A.; Kurazume R.; Honda M.; Sato W.; Ishikawa S.; Yoshikawa S.; Ito M.
  • Journal Title: IUI Workshop on Symbiotic Interaction and Harmonius Collaboration for Wisdom Computing Volume: 1 Pages: 1-9
  • Peer Reviewed
• [Journal Article] ユマニチュードを行動から，脳から知りたい， (2018)
  • Author(s): 中澤篤志
  • Journal Title: 医学界新聞 Volume: 3154号 Pages: 13-13
  • Open Access
• [Journal Article] An AR Furniture Arrangement System with Automatic View Recommendation (2017)
  • Author(s): 森 磨美、間下 以大、黒田 嘉宏、清川 清、竹村 治雄
  • Journal Title: Transactions of the Virtual Reality Society of Japan Volume: 22 Issue: 2 Pages: 157-164
  • DOI: 10.18974/tvrsj.22.2_157
  • NAID: 130005701308
  • ISSN: 1344-011X, 2423-9593
  • Peer Reviewed
• [Journal Article] Hybrid Object and Screen Stabilized Visualization Techniques for an AR Assembly Support System (2017)
  • Author(s): Bui Minh Khuong, Kiyoshi Kiyokawa, Tomohiro Mashita, Haruo Takemura
  • Journal Title: Transactions of the Virtual Reality Society of Japan Volume: 22 Issue: 2 Pages: 167-174
  • DOI: 10.18974/tvrsj.22.2_167
  • NAID: 130005701307
  • ISSN: 1344-011X, 2423-9593
  • Peer Reviewed
• [Journal Article] Point of gaze estimation using corneal surface reflection and omnidirectional camera image (2017)
  • Author(s): Ogawa Taishi、Nakazawa Atsushi、Nishida Toyoaki
  • Journal Title: 2017 Fifteenth IAPR International Conference on Machine Vision Applications (MVA) Volume: 1 Pages: 201-204
  • DOI: 10.23919/mva.2017.7986842
  • NAID: 130006729796
  • Peer Reviewed
• [Journal Article] 医療コミュニケーションにおける人工知能の可能性 医師の「五感」をも定量化できる時代へ (2017)
  • Author(s): 中澤篤志
  • Journal Title: 総合診療 Volume: 第27巻，５号 Pages: 621-623
• [Journal Article] DEEP eye contact detector: Robust eye contact bid detection using convolutional neural network (2017)
  • Author(s): Mitsuzumi Y; Nakazawa A.; Nishida T.
  • Journal Title: British Machine Vision Conference (BMVC2017) Volume: 1 Pages: 1-12
  • Peer Reviewed / Open Access
• [Journal Article] Noninvasive Corneal Image-Based Gaze Measurement System (2017)
  • Author(s): Eunji Chong, Christian Nitschke, Atsushi Nakazawa, Agata Rozga, James M Rehg
  • Journal Title: arXiv preprint arXiv:1708.00908 Volume: 1 Pages: 1-12
  • Open Access / Int'l Joint Research
• [Journal Article] Emulation of Physician Tasks in Eye-tracked Virtual Reality for Remote Diagnosis of Neurodegenerative Disease (2017)
  • Author(s): Jason Orlosky, Yuta Itoh, M Ranchet, Kiyoshi Kiyokawa, J Morgan, and H. Devos
  • Journal Title: IEEE Transactions on Visualization and Computer Graphics (TVCG) Volume: Vol.23 Issue: 4 Pages: 1302-1311
  • DOI: 10.1109/tvcg.2017.2657018
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] 立体映像技術の研究開発動向 (2017)
  • Author(s): 清川 清
  • Journal Title: 映像情報メディア学会誌 Volume: 71 Pages: 68-73
  • NAID: 130008140839
• [Journal Article] Registration of eye reflection and scene images using an aspheric eye model (2016)
  • Author(s): Atsushi Nakazawa, Christian Nitschke, Toyoaki Nishida
  • Journal Title: Journal of the Optical Society of America Volume: 33 Issue: 8 Pages: 2264-2276
  • DOI: 10.1080/01691864.2016.1277552
  • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] ヘッドマウントディスプレイの研究動向 (2016)
  • Author(s): 清川 清
  • Journal Title: 画像ラボ Volume: 27 Pages: 1-5
  • NAID: 40021122729
• [Journal Article] Research Trends in Head Worn Displays for VR and AR (2016)
  • Author(s): Kiyoshi Kiyokawa
  • Journal Title: SID Japan Chapter Newsletter Volume: 62 Pages: 1-2
• [Journal Article] Heat map visualization of multi-slice medical images through correspondence matching of video frames (2016)
  • Author(s): Divesh Lala and Atsushi Nakazawa
  • Journal Title: Proc. of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications (ETRA) Volume: 9 Pages: 119-122
  • DOI: 10.1145/2857491.2857504
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] The Role of Focus in Advanced Visual Interfaces (2015)
  • Author(s): Jason Orlosky, Takumi Toyama, Daniel Sonntag, Kiyoshi Kiyokawa
  • Journal Title: Kunstliche Intelligenz (Journal on Artificial Intelligence in Germany) Volume: Vol. 29 Issue: 3-4 Pages: 1-10
  • DOI: 10.1007/s13218-015-0411-y
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] ModulAR: Eye-controlled Vision Augmentations for Head Mounted Displays (2015)
  • Author(s): Jason Orlosky, Takumi Toyama, Kiyoshi Kiyokawa, Daniel Sonntag,
  • Journal Title: IEEE Transactions on Visualization and Computer Graphics (TVCG) Volume: Vol. 21 Issue: 11 Pages: 1259-1268
  • DOI: 10.1109/tvcg.2015.2459852
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] Corneal-Imaging Calibration for Optical See-Through Head-Mounted Displays (2015)
  • Author(s): Alexandor Plopski, Yuta Itoh, Christian Nitschke, Kiyoshi Kiyokawa, Gudrun Klinker, and Haruo Takemura
  • Journal Title: IEEE Transaction on Visualization and Computer Graphics (TVCG) Volume: 21 Issue: 4 Pages: 481-490
  • DOI: 10.1109/tvcg.2015.2391857
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] ヘッドマウントディスプレイ (2015)
  • Author(s): 清川 清
  • Journal Title: 映像情報メディア学会誌 Volume: 69 Pages: 41-44
• [Journal Article] Non-Calibrated and Real-time human view estimation using a mobile corneal imaging camera (2015)
  • Author(s): Atsushi Nakazawa, Chrisian Nitschke
  • Journal Title: International Conf. on Multimedia and Expo, Workshop on Wearable and Ego-vision Systems for Augmented Experience (WeSAX) Volume: 1 Pages: 1-6
  • DOI: 10.1109/icmew.2015.7169846
  • Peer Reviewed / Acknowledgement Compliant
• [Presentation] An Interactive 4D Vision Augmentation of Rapid Motion (2018)
  • Author(s): Tao Tao, Photchara Ratsamee, Yuki Uranishi, Kiyoshi Kiyokawa, Tomohiro Mashita, and Haruo Takemura
  • Organizer: Augmented Human 2018
  • Int'l Joint Research
• [Presentation] AR Timewarping: A Temporal Synchronization Framework for Real-Time Sensor Fusion in Head-Mounted Displays (2018)
  • Author(s): Peter Kim, Jason Orlosky and Kiyoshi Kiyokawa
  • Organizer: Augmented Human 2018
  • Int'l Joint Research
• [Presentation] 深層学習を用いた可視光画像からの瞳孔検出と注視点推定への応用 (2018)
  • Author(s): 北角 一哲,中澤 篤志,西田 豊明
  • Organizer: 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 0913-5685 電子情報通信学会 2018-01-18 117 392 93-99 https://ci.nii.ac.jp/naid/40021465187/
• [Presentation] 半教師あり学習によるアイコンタクト検出 (2018)
  • Author(s): 三鼓 悠,中澤 篤志,西田 豊明
  • Organizer: 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 0913-5685 電子情報通信学会 2018-01-18 117 392 339-345 https://ci.nii.ac.jp/naid/40021465692
• [Presentation] 深層学習を用いた自己撮影画像の撮影位置検索 (2018)
  • Author(s): 江川 佳輝,小川 太士,中澤 篤志
  • Organizer: 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 0913-5685 電子情報通信学会 2018-01-18 117 392 333-337 https://ci.nii.ac.jp/naid/400
• [Presentation] 人の視覚情報の可視化と優しい介護技術学習への展開 (2018)
  • Author(s): 中澤 篤志
  • Organizer: 破壊的イノベーションがもたらすデジタル社会研究会
  • Invited
• [Presentation] 視覚拡張技術で拡がるパーソナライズドリアリティの可能性 (2018)
  • Author(s): 清川 清
  • Organizer: 電子情報通信学会 パターン認識・メディア理解研究会（PRMU）
  • Invited
• [Presentation] ヘッドマウントディスプレイの基礎及び応用技術と最新動向 (2018)
  • Author(s): 清川 清
  • Organizer: 情報機構 技術セミナー
  • Invited
• [Presentation] AR技術の現状と将来展望 (2018)
  • Author(s): 清川 清
  • Organizer: ジャパンマーケティングサーベイ 技術セミナー
  • Invited
• [Presentation] VR/ARの現状と未来 (2018)
  • Author(s): 清川 清
  • Organizer: OPIE 2018 併設セミナー
  • Invited
• [Presentation] From Augmented Reality to Personalized Reality (2018)
  • Author(s): Kiyoshi Kiyokawa
  • Organizer: Cyberworlds 2018
  • Int'l Joint Research / Invited
• [Presentation] Evaluation of Care Skills using First Person Video (FPV) (2017)
  • Author(s): Atsushi Nakazawa
  • Organizer: AAAI 2017 Spring Symposium, Wellbeing AI: From Machine Learning to Subjectively Oriented Computing
  • Place of Presentation: Palo Alto
  • Year and Date: 2017-03-27
  • Int'l Joint Research / Invited
• [Presentation] Monocular Focus Estimation Method for a Freely-Orienting Eye using Purkinje-Sanson Images (2017)
  • Author(s): Yuta Itoh, Jason Orlosky, Kiyoshi Kiyokawa, Toshiyuki Amano, and Maki Sugimoto
  • Organizer: Proceedings of IEEE Virtual Reality 2017
  • Place of Presentation: Los Angeles
  • Year and Date: 2017-03-18
  • Int'l Joint Research
• [Presentation] 拡張現実向けヘッドマウントディスプレイの研究動向 (2017)
  • Author(s): 清川 清
  • Organizer: 技術情報協会セミナー
  • Place of Presentation: 技術情報協会
  • Year and Date: 2017-02-28
  • Invited
• [Presentation] MR(AR/VR)の最新技術動向とソニーに期待する事 (2017)
  • Author(s): 清川 清
  • Organizer: ソニー先端技術セミナー
  • Place of Presentation: ソニー厚木テクノロジーセンター
  • Year and Date: 2017-02-24
  • Invited
• [Presentation] 拡張現実向けヘッドマウントディスプレイの研究動向 (2017)
  • Author(s): 清川 清
  • Organizer: AndTechセミナー
  • Place of Presentation: 東京中央区立産業会館
  • Year and Date: 2017-01-31
  • Invited
• [Presentation] VisMerge: Light Adaptive Vision Augmentation via Spectral and Temporal Fusion of Non-visible Light (2017)
  • Author(s): Jason Orlosky, Peter Kim, Kiyoshi Kiyokawa, Tomohiro Mashita, Photchara Ratsamee, Yuki Uranishi, and Haruo Takemura
  • Organizer: IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
  • Int'l Joint Research
• [Presentation] [POSTER] DotWarp: Dynamic Object Timewarping for Video See-Through Augmented Reality (2017)
  • Author(s): Peter Kim, Jason Orlosky, Kiyoshi Kiyokawa, Photchara Ratsamee, Tomohiro Mashita
  • Organizer: IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
  • Int'l Joint Research
• [Presentation] Image Matching between Cameras for Vision Augmentation HMDs (2017)
  • Author(s): Ryosuke Goto, Jason Orlosky, Photchara Ratsamee, Tomohiro Mashita, Yuki Uranishi, Kiyoshi Kiyokawa and Haruo Takemura
  • Organizer: Asia-Pacific Workshop on Mixed-Reality (APMAR)
  • Int'l Joint Research
• [Presentation] PRMU応用研究におけるオープンアイデア ～ PRMU第二期グランドチャレンジ ～ (2017)
  • Author(s): 中澤篤志・山崎俊彦・松下康之・安倍 満・舩冨卓哉・木村昭悟・内田誠一・前田英作
  • Organizer: 電子情報通信学会技術研究報告 = IEICE technical report : 信学技報 0913-5685 電子情報通信学会 2017-12-17 117 362 41-43 https://ci.nii.ac.jp/naid/40021432486/
  • Invited
• [Presentation] The environmental light and your eye -- retrieving your vision using computer vision -- (2017)
  • Author(s): 中澤 篤志
  • Organizer: CiNet Talk Series
  • Invited
• [Presentation] An Interactive 4D Visualization of Dynamic 3D Information (2017)
  • Author(s): Tao Tao, Photchara Ratsamee, Yuki Uranishi, Kiyoshi Kiyokawa, Tomohiro Mashita, Haruo Takemura
  • Organizer: 第22回日本バーチャルリアリティ学会大会講演論文集
• [Presentation] Segmentation of Reflection and Iris Pattern in Human Corneal Images (2017)
  • Author(s): Anshi Liu, Photchara Ratsamee, Tomohiro Mashita, Kiyoshi Kiyokawa, Yuki Uranishi, Haruo Takemura
  • Organizer: 第22回日本バーチャルリアリティ学会大会講演論文集
• [Presentation] AR用ヘッドマウントディスプレイの動向と視覚拡張への応用 (2017)
  • Author(s): 清川 清
  • Organizer: 電子情報通信学会ソサイエティ大会依頼シンポジウムセッション「新たな体験を生み出すAR/VR技術」
  • Invited
• [Presentation] AR技術の開発動向と応用の展望 (2017)
  • Author(s): 清川 清
  • Organizer: 技術情報協会セミナー「ARヘッドマウントディスプレイの光学設計と応用市場の可能性」
  • Invited
• [Presentation] MR夏の陣～MRのイマとミライを徹底討論！ (2017)
  • Author(s): 清川 清
  • Organizer: 第22回日本バーチャルリアリティ学会大会
  • Invited
• [Presentation] 究極のヘッドマウントディスプレイを目指して (2017)
  • Author(s): 清川 清
  • Organizer: 日本光学会情報フォトニクス研究グループ「次世代映像技術」セミナー
  • Invited
• [Presentation] Image Processing and Analysis for Personalized Reality (2017)
  • Author(s): Kiyoshi Kiyokawa
  • Organizer: the 1st International Symposium on Intelligent video analysis and application (IVAA-01)
  • Int'l Joint Research / Invited
• [Presentation] 共生社会に資するパーソナライズドリアリティのための視覚拡張技術 (2017)
  • Author(s): 清川 清
  • Organizer: システム制御情報学会セミナー2017「人間拡張工学の最先端」
  • Invited
• [Presentation] リアルとバーチャルの融合～複合現実感 (2017)
  • Author(s): 清川 清
  • Organizer: バーチャルリアリティ技術者認定講習会
  • Invited
• [Presentation] ヘッドマウントディスプレイの基礎・要件，研究開発動向と今後の展望 (2017)
  • Author(s): 清川 清
  • Organizer: サイエンス＆テクノロジー技術セミナー
  • Invited
• [Presentation] AR技術の動向と展望 (2017)
  • Author(s): 清川 清
  • Organizer: ふくい光学エンジン研究会
  • Invited
• [Presentation] 拡張現実感からパーソナライズドリアリティへ (2017)
  • Author(s): 清川 清
  • Organizer: 網膜走査技術市場創出(MERIT)コンソーシアム
  • Invited
• [Presentation] Non-Calibrated and Real-Time Human View Estimation Using a Mobile Corneal Imaging Camera (2017)
  • Author(s): Atsushi Nakazawa
  • Organizer: 2017 International Symposium toward the Future of Advanced Researches in Shizuoka University
  • Place of Presentation: Hamamatsu
  • Int'l Joint Research / Invited
• [Presentation] HMD研究の最新動向 (2016)
  • Author(s): 清川 清
  • Organizer: ウェアラブルコンピュータ研究開発機構 HMDミーティング
  • Place of Presentation: グランフロント大阪
  • Year and Date: 2016-12-21
  • Invited
• [Presentation] 我々はまだ何もみえていない-PRMU第二期グランドチャレンジ- (2016)
  • Author(s): 中澤篤志
  • Organizer: パターン認識・メディア理解研究会(PRMU)
  • Place of Presentation: 鳥取
  • Year and Date: 2016-12-15
  • Invited
• [Presentation] Dynamic View Expansion for Improving Visual Search in Video See-through AR (2016)
  • Author(s): Yuki Yano, Jason Orlosky, Kiyoshi Kiyokawa, Haruo Takemura
  • Organizer: Proc. of the 26th International Conference on Artificial Reality and Telexistence and the 21st Eurographics Workshop on Virtual Environments (ICAT-EGVE 2016)
  • Place of Presentation: Little Rock
  • Year and Date: 2016-12-07
  • Int'l Joint Research
• [Presentation] Noise stable image registration using RANdom RESAmple Consensus (2016)
  • Author(s): Atsushi Nakazawa
  • Organizer: ICPR 2016
  • Place of Presentation: Cancun
  • Year and Date: 2016-12-04
  • Int'l Joint Research
• [Presentation] Estimation of Task Difficulty and Habituation Effect While Visual Manipulation Using Pupillary Response (2016)
  • Author(s): Asami Matsumoto, Yuta Tange, Atsushi Nakazawa, Toyoaki Nishida
  • Organizer: VAAM/FFER 2016
  • Place of Presentation: Cancun
  • Year and Date: 2016-12-04
  • Int'l Joint Research
• [Presentation] Evaluation of face-to-face communication skills for people with dementia using a head-mounted system (2016)
  • Author(s): Atsushi Nakazawa
  • Organizer: International Workshop on Pattern Recognition for Healthcare Analytics
  • Place of Presentation: Cancun
  • Year and Date: 2016-12-04
  • Int'l Joint Research
• [Presentation] 角膜イメージング法の基礎と応用 (2016)
  • Author(s): 中澤篤志
  • Organizer: 日本生体医工学MEとバイオサイバネティクス研究会; IEEE EMBS Japan Chapter
  • Place of Presentation: 大阪
  • Year and Date: 2016-10-22
  • Invited
• [Presentation] Automated Spatial Calibration of HMD Systems with Unconstrained Eye-cameras (2016)
  • Author(s): Alexander Plopski, Yuta Itoh, Jason Orlosky, Christian Nitschke, Kiyoshi Kiyokawa, Gudrun Klinker
  • Organizer: Proc. of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
  • Place of Presentation: Merida
  • Year and Date: 2016-09-19
  • Int'l Joint Research
• [Presentation] AR Displays (2016)
  • Author(s): Kiyoshi Kiyokawa
  • Organizer: The First Augmented Reality School AR101
  • Place of Presentation: Merida
  • Year and Date: 2016-09-19
  • Int'l Joint Research / Invited
• [Presentation] 光学シースルーHMDのバックライト自動調光のための視認性評価における個人差の検証 (2016)
  • Author(s): 劉 暢, プロプスキ アレクサンダー, 間下 以大, 黒田 嘉宏, 清川 清, 竹村 治雄
  • Organizer: 第21回 バーチャルリアリティ学会大会
  • Place of Presentation: つくば
  • Year and Date: 2016-09-14
• [Presentation] Evaluation of Care Skills using First Person Video (FPV) (2016)
  • Author(s): Atsushi Nakazawa
  • Organizer: 2016 Korea-Japan Workshop on Robotics and Information Technology for Better Quality of Life
  • Place of Presentation: Seoul
  • Year and Date: 2016-09-10
  • Int'l Joint Research / Invited
• [Presentation] Redesigning Vision: Achieving Super Human Eyesight by Head Mounted Displays (2016)
  • Author(s): Kiyoshi Kiyokawa
  • Organizer: The 16th International Meeting on Information Display (IMID)
  • Place of Presentation: Jeju
  • Year and Date: 2016-08-23
  • Int'l Joint Research / Invited
• [Presentation] Redesigning Vision: Achieving Super Human Eyesight by Head Mounted Displays (2016)
  • Author(s): Kiyoshi Kiyokawa
  • Organizer: The 16th International Meeting on Information Display (IMID)
  • Place of Presentation: Jeju, Korea
  • Year and Date: 2016-08-23
  • Int'l Joint Research / Invited
• [Presentation] Redesigning Vision by Head Worn Displays (2016)
  • Author(s): Kiyoshi Kiyokawa
  • Organizer: Imaging and Applied Optics Congress (IMAGING)
  • Place of Presentation: Heidelberg
  • Year and Date: 2016-07-25
  • Int'l Joint Research / Invited
• [Presentation] Redesigning Vision by Head Worn Displays (2016)
  • Author(s): Kiyoshi Kiyokawa
  • Organizer: 3D Image Acquisition and Display: Technology, Perception and Applications 2016
  • Place of Presentation: Heidelberg, Germany
  • Year and Date: 2016-07-25
  • Int'l Joint Research / Invited
• [Presentation] A Wide Field of View Head Mounted Display and Its Effects on Search Performance in Augmented Reality (2016)
  • Author(s): Kiyoshi Kiyokawa
  • Organizer: Society for Information Display's Display Week (SID) 2016
  • Place of Presentation: San Francisco
  • Year and Date: 2016-05-22
  • Int'l Joint Research / Invited
• [Presentation] シンポジウム：これからの認証ケアとデータ活用 (2016)
  • Author(s): 中澤篤志
  • Organizer: ITヘルスケア学会第10回記念学術大会
  • Place of Presentation: 東京
  • Year and Date: 2016-05-21
  • Invited
• [Presentation] マルチスライス画像における視線データの視覚化手法 (2016)
  • Author(s): ラーラー ディベッシュ, 中澤篤志
  • Organizer: パターン認識・メディア理解研究会(PRMU)
  • Place of Presentation: 名古屋
  • Year and Date: 2016-05-19
• [Presentation] 頭部装着型カメラを用いた介護スキル評価 (2016)
  • Author(s): 沖野祐介, 中澤篤志, 本田美和子, 石川翔吾, 竹林洋一, 西田豊明
  • Organizer: パターン認識・メディア理解研究会(PRMU)
  • Place of Presentation: 名古屋
  • Year and Date: 2016-05-19
• [Presentation] Automated Backlight Adjustment of Optical See-through HMDs for Improved Visibility (2016)
  • Author(s): Chang Liu, Alexander Plopski, Tomohiro Mashita, Yoshihiro Kuroda, Kiyoshi Kiyokawa and Haruo Takemura
  • Organizer: Proc. 8th Asia-Pacific Workshop on Mixed Reality (APMR)
  • Place of Presentation: 安東市, 韓国
  • Year and Date: 2016-04-22
  • Int'l Joint Research
• [Presentation] Automated Backlight Adjustment of Optical See-through HMDs for Improved Visibility (2016)
  • Author(s): Chang Liu, Alexander Plopski, Tomohiro Mashita, Yoshihiro Kuroda, Kiyoshi Kiyokawa and Haruo Takemura
  • Organizer: Asia-Pacific Workshop on Mixed Reality 2016
  • Place of Presentation: Andong, Korea
  • Year and Date: 2016-04-22
  • Int'l Joint Research
• [Presentation] OST Rift: Temporally Consistent Augmented Reality with a Consumer Optical See-Through Head-Mounted Display (2016)
  • Author(s): Yuta Itoh, Jason Orlosky, Kiyoshi Kiyokawa, Manuel Huber, and Gudrun Klinker
  • Organizer: IEEE Virtual Reality 2016
  • Place of Presentation: Greenville, USA
  • Year and Date: 2016-03-19
  • Int'l Joint Research
• [Presentation] Consistency Perception in Optical- and Video-See-Through Head-Mounted Augmentations (2016)
  • Author(s): Alexander Plopski, Kenneth R. Moser, Kiyoshi Kiyokawa, J. Edward Swan II, and Haruo Takemura
  • Organizer: IEEE Virtual Reality 2016
  • Place of Presentation: Greenville, USA
  • Year and Date: 2016-03-19
  • Int'l Joint Research
• [Presentation] ビデオシースルーHMDを用いた実環境における動的視野拡張手法の検討 (2016)
  • Author(s): 矢野 裕季, オーロスキ ジェーソン, 清川 清, 竹村 治雄
  • Organizer: 電子情報通信学会技術研究報告
  • Place of Presentation: 沖縄
  • Year and Date: 2016-03-07
• [Presentation] 情報視認性向上のための光学シースルーHMDにおけるバックライト輝度の自動調整 (2016)
  • Author(s): 劉 暢, アレクサンダー プロプスキ, 間下 以大, 黒田 嘉宏, 清川 清, 竹村 治雄
  • Organizer: 電子情報通信学会技術研究報告
  • Place of Presentation: 沖縄
  • Year and Date: 2016-03-07
• [Presentation] Laplacian Vision: Augmenting Motion Prediction via Optical See-Through Head-Mounted Displays (2016)
  • Author(s): Yuta Itoh, Jason Orlosky, Kiyoshi Kiyokawa, and Gudrun Klinker
  • Organizer: ACM Augmented Human 2016
  • Place of Presentation: Geneva, Switzerland
  • Year and Date: 2016-02-25
  • Int'l Joint Research
• [Presentation] Redesigning Vision (2016)
  • Author(s): Kiyoshi Kiyokawa
  • Organizer: Dagstuhl Seminar on Eyewear Computing – Augmenting the Human with Head-mounted Wearable Assistants
  • Place of Presentation: Dagstuhl, Germany
  • Year and Date: 2016-01-24
  • Int'l Joint Research / Invited
• [Presentation] 認知症ケアの視覚化 (2016)
  • Author(s): 中澤篤志
  • Organizer: 第1回高齢社会デザインシンポジウム
  • Place of Presentation: 東京
  • Invited
• [Presentation] Non-Calibrated and Real-time human view estimation using a mobile corneal imaging camera (2015)
  • Author(s): Atsushi Nakazawa
  • Organizer: Are robots and digital humans becoming partners in Human daily life?
  • Place of Presentation: 韓国、ソウル
  • Year and Date: 2015-12-13
  • Int'l Joint Research / Invited
• [Presentation] ヘッドマウントディスプレイのツボ (2015)
  • Author(s): 清川 清
  • Organizer: りそな中小企業振興財団 技術懇談会
  • Place of Presentation: 大阪
  • Year and Date: 2015-11-05
  • Invited
• [Presentation] Corneal-Imaging Calibration for Optical See-Through Head-Mounted Displays (2015)
  • Author(s): Alexandor Plopski, Yuta Itoh, Christian Nitschke, Kiyoshi Kiyokawa, Gudrun Klinker, and Haruo Takemura
  • Organizer: SIGGRAPH Asia 2015, IEEE TVCG Special Session on Augmented and Virtual Reality
  • Place of Presentation: 神戸
  • Year and Date: 2015-11-05
  • Int'l Joint Research / Invited
• [Presentation] Hybrid Eye Tracking: Combining Iris Contour and Corneal Imaging (2015)
  • Author(s): Alexander Plopski, Christian Nitschke, Kiyoshi Kiyokawa, Dieter Schmalstieg and Haruo Takemura
  • Organizer: International Conference on Artificial Reality and Telexistence and Eurographics Workshop on Virtual Environments (ICAT-EGVE 2015)
  • Place of Presentation: 京都
  • Year and Date: 2015-10-28
  • Int'l Joint Research
• [Presentation] Accurate Passive Eye-Pose Estimation through Corneal Imaging (2015)
  • Author(s): Alexander Plopski, Christian Nitschke, Kiyoshi Kiyokawa, Dieter Schmalstieg and Haruo Takemura
  • Organizer: International Conference on Artificial Reality and Telexistence and Eurographics Workshop on Virtual Environments (ICAT-EGVE 2015)
  • Place of Presentation: 京都
  • Year and Date: 2015-10-28
  • Int'l Joint Research
• [Presentation] 多様化するAR/MR：スマホ，HMD，プロジェクションマッピング (2015)
  • Author(s): 清川 清
  • Organizer: ISMAR2015特別セミナー「ISMARが拓くAR/MRの未来」
  • Place of Presentation: 福岡
  • Year and Date: 2015-10-03
  • Invited
• [Presentation] Non-Calibrated and Real-time human view estimation using a mobile corneal imaging camera (2015)
  • Author(s): Atsushi Nakazawa
  • Organizer: Japan-Korea Workshop on Information and Robot Technology for Daily Life Support
  • Place of Presentation: 奈良
  • Year and Date: 2015-09-04
  • Int'l Joint Research / Invited
• [Presentation] 感情を扱うコンピューティング - Affective Computing (2015)
  • Author(s): 中澤篤志
  • Organizer: 自動車技術会ヒューマンファクター部門委員会
  • Place of Presentation: 東京
  • Year and Date: 2015-08-27
  • Invited
• [Presentation] A mobile corneal imaging camera for estimation of human's view (2015)
  • Author(s): Atsushi Nakazawa
  • Organizer: 画像の認識と理解シンポジウム2015
  • Place of Presentation: 大阪
  • Year and Date: 2015-07-27
• [Presentation] 一人称視点映像による実環境の記憶可能推定 (2015)
  • Author(s): 大泉建人、中澤篤志、西田豊明
  • Organizer: 画像の認識と理解シンポジウム2015
  • Place of Presentation: 大阪
  • Year and Date: 2015-07-27
• [Presentation] 視覚操作タスクでの集中度と瞳孔系変化の定量的関係 (2015)
  • Author(s): 丹下雄太、松本麻見、中澤篤志、西田豊明
  • Organizer: 画像の認識と理解シンポジウム2015
  • Place of Presentation: 大阪
  • Year and Date: 2015-07-27
• [Presentation] HMD研究最前線～現実の再定義による次世代一人称コンテンツ (2015)
  • Author(s): 清川 清
  • Organizer: マルチメディア，分散，協調とモバイル(DICOMO2015)シンポジウム
  • Place of Presentation: 安比
  • Year and Date: 2015-07-08
  • Invited
• [Book] VR/AR技術の開発動向と最新応用事例 (2018)
  • Author(s): 清川 清,大林 勇人,嵯峨 智,村上 郁也,荒井 観,繁桝 博昭,石塚 裕己,佐藤 雅之,池井 寧,青山 敦,前田 有希,鳴海 拓志,小泉 直也,河合 隆史,苗村 健,宮岡 徹,的場 修,黄 健,大城 理,神田 健介,掛谷 英紀,権藤 雅彦,堀越 力,田辺 健,橋本 直己,藤田 欣也,下馬場 朋禄,中村 則雄,藤波 香織,栗田 雄一,天野 敏之,橋本 悠希,眞鍋 佳嗣
  • Total Pages: 11
  • Publisher: 技術情報協会
  • ISBN: 9784861046940
• [Book] The Wiley Handbook of Human Computer Interaction: InputDevice - Motion Capture (2018)
  • Author(s): Atsushi Nakazawa, Takaaki Shiratori
  • Total Pages: 14
  • Publisher: John Wiley & Sons, Ltd
  • ISBN: 9781118977279
• [Book] The Wiley Handbook of Human Computer Interaction: Corneal Imaging (2018)
  • Author(s): Christian Nitschke, Atsushi Nakazawa
  • Total Pages: 19
  • Publisher: John Wiley & Sons, Ltd
  • ISBN: 9781118977279
• [Book] Handbook of Visual Display Technology, 2nd Edition (2016)
  • Author(s): Kiyoshi Kiyokawa
  • Total Pages: 2900
  • Publisher: Springer
• [Book] ウェアラブルデバイスの小型、薄型化と伸縮、柔軟性の向上技術 (2015)
  • Author(s): 清川 清
  • Total Pages: 510
  • Publisher: 技術情報協会
• [Book] Fundamentals of Wearable Computers and Augmented Reality, 2nd edition (2015)
  • Author(s): Kiyoshi Kiyokawa
  • Total Pages: 739
  • Publisher: CRC Press
• [Book] AR (拡張現実) の基礎・発展・実践 (2015)
  • Author(s): 蔵田武志, 清川 清
  • Total Pages: 390
  • Publisher: 科学技術出版
• [Book] 角膜イメージング法による視覚推定とその将来展望 、学術の動向 (2015)
  • Author(s): 中澤篤志
  • Total Pages: 3
  • Publisher: 日本学術協力財団
• [Book] 感情を扱うコンピューティング - Affective Computing (2015)
  • Author(s): 中澤篤志
  • Total Pages: 4
  • Publisher: 公益法人自動車技術会
• [Remarks] Kiyoshi Kiyokawa Publications
  • URL: http://www.lab.ime.cmc.osaka-u.ac.jp/~kiyo/pukiwiki/index.php?Publications