Driving assistance system based on the gaze analysis of drivers

• Project/Area Number: 15K00308
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: Intelligent informatics
• Research Institution: Hiroshima City University
• Principal Investigator: Li SHIGANG 広島市立大学, 情報科学研究科, 教授 (50252630)
• Co-Investigator(Kenkyū-buntansha): 白岩 史 鳥取大学, 工学研究科, 助教 (80640276)
• Project Period (FY): 2015-04-01 – 2018-03-31
• Project Status: Completed (Fiscal Year 2017)
• Budget Amount: ¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000); Fiscal Year 2017: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000); Fiscal Year 2016: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000); Fiscal Year 2015: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
• Keywords: 運転補助 / 視線推定 / 注意解析 / 車運転補助 / 顕著性マップ / 視線計測

Outline of Final Research Achievements

The achievements of this research project are as follows. (1) We proposed new methods of estimating gaze direction by using eye-model and predicting the position and shape deformation of iris in image. Furthermore, we also developed a new method of estimating gaze points of scenes by using a full-view camera. (2) We carried out the analysis of driving environment by a full-view camera mounted on roof of an electrical vehicle. (3) We carried out the prediction of users’ gaze by generating a salience map using deep learning approach. And the comparative experiments were also carried out to evaluate the proposed methods.

Research Products

• [Int'l Joint Research] Southwest University(China)
• [Journal Article] Descriptor Matching for a Discrete Spherical Image with a Convolutional Neural Network (2018)
  • Author(s): Yuhao Shan and Shigang Li
  • Journal Title: IEEE Access Volume: 1 Pages: 1-1
  • DOI: 10.1109/access.2018.2825477
  • Peer Reviewed / Open Access
• [Journal Article] Plotting Gaze Trajectory in Full-View Image (2016)
  • Author(s): 藤浦達也、李仕剛、中西功
  • Journal Title: 電子情報通信学会論文誌D 情報・システム Volume: J99-D Issue: 7 Pages: 679-682
  • DOI: 10.14923/transinfj.2015JDL8030
  • ISSN: 1880-4535, 1881-0225
  • Year and Date: 2016-07-01
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Discrete Spherical Laplacian Operator (2016)
  • Author(s): Shigang Li and Hiroya Funaki
  • Journal Title: IEICE Transactions on Information and Systems Volume: E99.D Issue: 6 Pages: 1716-1719
  • DOI: 10.1587/transinf.2016EDL8023
  • NAID: 130005154736
  • ISSN: 0916-8532, 1745-1361
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] FAST Corner Detector in Discrete Spherical Image (2016)
  • Author(s): 北村理知、李仕剛、中西功
  • Journal Title: IEEJ Transactions on Electronics, Information and Systems Volume: 136 Issue: 6 Pages: 838-843
  • DOI: 10.1541/ieejeiss.136.838
  • NAID: 130005155109
  • ISSN: 0385-4221, 1348-8155
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] Calibration of Non-Overlapping In-Vehicle Cameras with Laser Pointer (2015)
  • Author(s): Wuhe Zou and Shigang Li
  • Journal Title: IEEE Transactions on Intelligent Transportation Systems Volume: Vol. 16, No. 3 Issue: 3 Pages: 1348-1359
  • DOI: 10.1109/tits.2014.2361666
  • Peer Reviewed
• [Journal Article] Gaze Estimation from Color Image Based on Eye Model with Known Head Pose (2015)
  • Author(s): Jianfeng Li and Shigang Li
  • Journal Title: IEEE Transactions on Human-Machine Systems Volume: 未定 Issue: 3 Pages: 1-10
  • DOI: 10.1109/thms.2015.2477507
  • Peer Reviewed
• [Presentation] 注視計測機能を有した全天周ドライビングレコーダー (2018)
  • Author(s): 趙梓豪 、李 仕剛 、小嵜 貴弘 満上 育久
  • Organizer: 2018年電子情報通信学会総合大会
• [Presentation] トップダウン要因とボトムアップ要因を用いた顕著性マップにおける比較評価 (2018)
  • Author(s): 足立翔一、白岩史、李仕剛
  • Organizer: 電子情報通信学会研究会
• [Presentation] 全天周カメラによる車線の検出 (2017)
  • Author(s): 松尾 将司 、李 仕剛 、小嵜 貴弘 、満上 育久
  • Organizer: 第19回IEEE広島支部学生シンポジウム
• [Presentation] Tracking on full-view image for camera motion estimation based on spherical mode (2017)
  • Author(s): Jianfeng Li, Shigang Li and Tong Chen
  • Organizer: IEEE International Conference on Robotics and Biomimetrics
  • Int'l Joint Research
• [Presentation] Recording gaze trajectory of wheelchair users by a spherical camera (2017)
  • Author(s): Shigang Li, Tetsuya Fujiura and Isao Nakanishi
  • Organizer: IEEE International Conference on Rehabilitation Robotics
  • Int'l Joint Research
• [Presentation] 視線計測を用いた顕著性マップにおけるトップダウン要因とボトムアップ要因の比較 (2017)
  • Author(s): 足立翔一、白岩史、李仕剛
  • Organizer: 第20回 画像の認識・理解シンポジウム (MIRU2017)
• [Presentation] 自動車運転時における注視位置推定の検討 (2017)
  • Author(s): 白岩史、足立翔一、李仕剛
  • Organizer: 電気学会知覚情報研究会
• [Presentation] 視線計測を用いた自動車運転時の顕著性マップモデルにおける評価の比較 (2016)
  • Author(s): 足立翔一，白岩史，李仕剛
  • Organizer: ViEW2016 ビジョン技術の実利用ワークショップ
  • Place of Presentation: パシフィコ横浜アネックスホール（神奈川県横浜市）
  • Year and Date: 2016-12-08
• [Presentation] Discrete spherical Harris corner detector (2016)
  • Author(s): Shigang Li, Hanchao Jia, Jianfeng Li
  • Organizer: 2016 IEEE International Conference on Robotics and Biomimetics
  • Place of Presentation: Qingdao, China
  • Year and Date: 2016-12-03
  • Int'l Joint Research
• [Presentation] 視線計測を用いた自動車運転時の顕著性マップモデルの評価 (2016)
  • Author(s): 足立 翔一,白岩 史,中西 功,李 仕剛
  • Organizer: 2016 年電子情報通信学会総合大会
  • Place of Presentation: 福岡市
  • Year and Date: 2016-03-15
• [Presentation] 全天周画像を用いた注視軌跡マップの作成 (2015)
  • Author(s): 藤浦達也,李仕剛,中西功
  • Organizer: 第 18 回画像の認識・理解シンポジウム
  • Place of Presentation: 大阪
  • Year and Date: 2015-07-27
• [Patent(Industrial Property Rights)] １つの全天周カメラによる視線計測装置 (2017)
  • Inventor(s): 李仕剛、藤浦達也
  • Industrial Property Rights Holder: 李仕剛、藤浦達也
  • Industrial Property Rights Type: 特許
  • Filing Date: 2017-03-15