• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Image recognition using sparse graph neural networks and its application

Research Project

Project/Area Number 18K11380
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 61010:Perceptual information processing-related
Research InstitutionWaseda University

Principal Investigator

KAMATA Seiichiro  早稲田大学, 理工学術院(情報生産システム研究科・センター), 教授 (00204602)

Project Period (FY) 2018-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000)
Fiscal Year 2020: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2019: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2018: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Keywordsグラフニューラルネットワーク / 画像認識 / スパースグラフ表現 / 顔認識 / ニューラルネットワーク / ヒューマンエラー / 調剤過誤防止 / 薬学リスクマネジメント / スパースグラフ / 物体認識 / ヒアリハット / スペクトルフィルタ / 眼底画像識別 / 病変部位相関グラフ / 顔画像認識 / スパース表現 / 深層学習 / 畳込ニューラルネットワーク / 薬剤画像識別 / マシンビジョン
Outline of Final Research Achievements

Recently several graph-based convolutional neural networks (GNN) have been proposed to solve the problems of object recognition. These methods take advantage of a fact that objects have the graph structure. However, these methods are weaker than the deep CNN. We reconsider the identification of the graph structure benefit from the development of the GNN . In order to introduce the GNN, objects in an image is modeled as a sparse graph. The major challenge is how to estimate the sparse graph. A generic sparse graph based convolutional networks (SGNN) is proposed, which is almost equivalent to a deep CNN called CosFace. The model implements the projected gradient descent algorithm with structured sparse representation. In the application, in order to reduce a risk of human errors when prescribing medicines, which has been becoming a social problem, a medicine inspection system is created to solve this problem, and it is verified that it can reduce the number of nearly-missed accidents.

Academic Significance and Societal Importance of the Research Achievements

画像認識において、スパースグラフ表現によるGNNの内部構造を解析しながら、グラフスパース化などによる高度化を図り、認識能力向上の可能性を探求した。スパースグラフ表現は、以前から注目されている方法論であり、グラフ特徴抽出の一概念である。顔認識による比較評価実験の結果、SGNNによる画像認識手法は、深層CNNのCosFaceとほぼ同等の性能を有することがわかった。また薬剤監査システムの有効性について検討し、薬剤監査システムの評価(フィールドテスト)の結果、調剤過誤のヒヤリハットが数分の一に減らせることが確認でき、社会的問題解決に役立つことが検証できた。

Report

(4 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (37 results)

All 2021 2020 2019 2018 Other

All Int'l Joint Research (3 results) Journal Article (25 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 25 results,  Open Access: 1 results) Presentation (9 results) (of which Int'l Joint Research: 5 results)

  • [Int'l Joint Research] ダラム大学(英国)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] Durham University(英国)

    • Related Report
      2019 Research-status Report
  • [Int'l Joint Research] ダラム大学(英国)

    • Related Report
      2018 Research-status Report
  • [Journal Article] Generic Sparse Graph Based Convolutional Networks for Face Recognition2021

    • Author(s)
      Wu Renjie、Kamata Sei-ichiro
    • Journal Title

      Proc. IEEE Int. Conf. Image Processing

      Volume: -

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Transformer and Node-Compressed DNN Based Dual-Path System for Manipulated Face Detection2021

    • Author(s)
      Luo Zengbo、Kamata Sei-ichiro、Sun Zitang
    • Journal Title

      Proc. IEEE Int. Conf. Image Processing

      Volume: -

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Semantic Segmentation Refinement Using Entropy and Boundary-guided Monte Carlo Sampling and Directed Regional Search2021

    • Author(s)
      Sun Zitang、Kamata Sei-Ichiro、Wang Ruojing
    • Journal Title

      Proc. IEEE Int. Conf. Pattern Recognition

      Volume: 25 Pages: 3931-3938

    • DOI

      10.1109/icpr48806.2021.9413099

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Skin Lesion Classification Using Weakly-supervised Fine-grained Method2021

    • Author(s)
      Xue Xi、Kamata Sei-ichiro、Luo Daming
    • Journal Title

      Proc. IEEE Int. Conf. Pattern Recognition

      Volume: 25 Pages: 9083-9090

    • DOI

      10.1109/icpr48806.2021.9412042

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] An efficient computational algorithm for Hausdorff distance based on points-ruling-out and systematic random sampling2021

    • Author(s)
      Ryu Jegoon、Kamata Sei-ichiro
    • Journal Title

      Pattern Recognition

      Volume: 114 Pages: 107857-107857

    • DOI

      10.1016/j.patcog.2021.107857

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Extending Compressive Bilateral Filtering For Arbitrary Range Kernel2020

    • Author(s)
      Sumiya Yuto、Fukushima Norishige、Sugimoto Kenjiro、Kamata Sei-ichiro
    • Journal Title

      Proc. IEEE Int. Conf. Image Processing

      Volume: 27 Pages: 1018-1022

    • DOI

      10.1109/icip40778.2020.9191123

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Diabetic retinopathy grading based on Lesion correlation graph2020

    • Author(s)
      Luo Daming、Kamata Sei-Ichiro
    • Journal Title

      Proc. IEEE Int. Conf. Imaging, Vision and Pattern Recognition

      Volume: 4 Pages: 1-6

    • DOI

      10.1109/icievicivpr48672.2020.9306664

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Second-Order Estimation Based Attention Network for Metric Learning2020

    • Author(s)
      Sun Zeyu、Kamata Sei-ichiro
    • Journal Title

      Proc. IEEE Int. Conf. Imaging, Vision and Pattern Recognition

      Volume: 4 Pages: 1-6

    • DOI

      10.1109/icievicivpr48672.2020.9306560

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Diabetic retinopathy grading based on Lesion correlation graph2020

    • Author(s)
      Luo Daming, Kamata Sei-ichiro
    • Journal Title

      Proc.IEEE International Conference on Imaging, Vision and Pattern Recognition

      Volume: 4

    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] A Ranking Based Attention Approach for Visual Tracking2019

    • Author(s)
      Peng Shenhui、Kamata Sei-ichiro、Breckon Toby P.
    • Journal Title

      Proc.IEEE International Conference on Image Processing

      Volume: 26 Pages: 3073-3077

    • DOI

      10.1109/icip.2019.8803358

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Classification of Structural MRI Images in Adhd Using 3D Fractal Dimension Complexity Map2019

    • Author(s)
      Wang Tianyi、Kamata Sei-ichiro
    • Journal Title

      Proc.IEEE International Conference on Image Processing

      Volume: 26 Pages: 215-219

    • DOI

      10.1109/icip.2019.8802930

    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] 200 FPS Constant-Time Bilateral Filter Using SVD and Tiling Strategy2019

    • Author(s)
      Sugimotoy Kenjiro、Fukushimazy Norishige、Kamatay Sei-ichiro
    • Journal Title

      Proc.IEEE International Conference on Image Processing

      Volume: 26 Pages: 190-194

    • DOI

      10.1109/icip.2019.8802927

    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] Edge-guided Hierarchically Nested Network for Real-time Semantic Segmentation2019

    • Author(s)
      Li Yuqi、Kamata Sei-Ichiro、Liu Haoran
    • Journal Title

      Proc.IEEE International Conference on Signal and Image Processing Applications

      Volume: 6 Pages: 296-301

    • DOI

      10.1109/icsipa45851.2019.8977788

    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] Hybrid Featured based Pyramid Structured CNN for Texture Classification2019

    • Author(s)
      Liu Haoran、Kamata Sei-Ichiro、Li Yuqi
    • Journal Title

      Proc.IEEE International Conference on Signal and Image Processing Applications

      Volume: 6 Pages: 170-175

    • DOI

      10.1109/icsipa45851.2019.8977773

    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] Video Super-Resolution Using Wave-Shape Network2019

    • Author(s)
      Wu Yanan、Kamata Sei-ichiro
    • Journal Title

      Proc.International Conference on Video and Image Processing

      Volume: 3 Pages: 132-136

    • DOI

      10.1145/3376067.3376079

    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] Fundus Image Classification for Diabetic Retinopathy Using Disease Severity Grading2019

    • Author(s)
      Aiki SAKAGUCHI and Sei-ichiro KAMATA
    • Journal Title

      ACM Prooceedings of 9th International Conference on Biomedical Engineering and Technology (ICBET 2019)

      Volume: 1 Pages: 1-6

    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Journal Article] PCA based Guided Bilateral Filter for Medical Color Images2019

    • Author(s)
      Toshiki KAGE, Kenjiro SUGIMOTO and Sei-ichiro KAMATA
    • Journal Title

      ACM Proceedings of 9th International Conference on Biomedical Engineering and Technology (ICBET 2019)

      Volume: 1 Pages: 1-6

    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Journal Article] Sparse Graph Based Deep Learning Networks for Face Recognition2018

    • Author(s)
      Renjie WU, Sei-ichiro KAMATA
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E101.D Issue: 9 Pages: 2209-2219

    • DOI

      10.1587/transinf.2017PCP0012

    • NAID

      130007479641

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2018-09-01
    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Journal Article] Character Recognition in Japanese Historical Documents via Adaptive Multi-Region Model2018

    • Author(s)
      Yueyu Wang, Sei-ichiro Kamata
    • Journal Title

      IEEE Proceedings of Joint 7th International Conference on Informatics, Electronics & Vision (ICIEV)

      Volume: 1 Pages: 404-409

    • DOI

      10.1109/iciev.2018.8640960

    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Journal Article] Deep Neural Networks with Mixture of Experts Layers for Complex Event Recognition from Images2018

    • Author(s)
      Mingyao Li, Sei-ichiro Kamata
    • Journal Title

      IEEE Proceedings of Joint 7th International Conference on Informatics, Electronics & Vision (ICIEV)

      Volume: 1 Pages: 410-415

    • DOI

      10.1109/iciev.2018.8641027

    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Journal Article] Deep Metric Learning with Online Hard and Soft Selection for Person Re-identification2018

    • Author(s)
      Mingyang Yu, Sei-ichiro Kamata
    • Journal Title

      IEEE Proceedings of Joint 7th International Conference on Informatics, Electronics & Vision (ICIEV)

      Volume: 1 Pages: 426-431

    • DOI

      10.1109/iciev.2018.8641037

    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Journal Article] Nuclei Segmentation of Cervical Cell Images based on Intermediate Segment Qualifier2018

    • Author(s)
      Rui WANG, Sei-ichiro KAMATA
    • Journal Title

      IEEE Proceedings of International Conference on Pattern Recognition (ICPR2018)

      Volume: 1 Pages: 3941-3946

    • DOI

      10.1109/icpr.2018.8546215

    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Journal Article] Infrared Image Colorization Using a S-Shape Network2018

    • Author(s)
      Ziyue DONG, Sei-ichiro KAMATA and Toby BRECKON
    • Journal Title

      IEEE Proceedings of International Conference on Image Processing

      Volume: 1 Pages: 2242-2246

    • DOI

      10.1109/icip.2018.8451230

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] K3-Sparse Graph Convolutional Networks for Face Recognition2018

    • Author(s)
      Renjie WU, Sei-ichiro KAMATA
    • Journal Title

      IEEE Proceedings of 2018 15th International Conference on Control, Automation, Robotics and Vision

      Volume: 1 Pages: 174-179

    • DOI

      10.1109/icarcv.2018.8581214

    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Journal Article] GPU-friendly Approximate Bilateral Filter for 3D Volume Data2018

    • Author(s)
      Koichi YANO, Kenjiro SUGIMOTO, Sei-ichiro KAMATA
    • Journal Title

      IEEE Proceedings of 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC)

      Volume: 1 Pages: 2054-2058

    • DOI

      10.23919/apsipa.2018.8659773

    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Presentation] 複素スティーラブルピラミッドの位相抽出の効率化による高速な motion magnification2020

    • Author(s)
      杉本 憲治郎
    • Organizer
      第35回信号処理シンポジウム
    • Related Report
      2020 Annual Research Report
  • [Presentation] Optimization of Sliding-DCT Based Gaussian Filtering for Hardware Accelerator2020

    • Author(s)
      Tomoki Otsuka
    • Organizer
      IEEE International Conference on Visual Communications and Image Processing
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Constant-Time Gaussian Filtering for Acceleration of Structure Similarity2020

    • Author(s)
      Tomohiro SASAKI
    • Organizer
      International Conference on Image Processing and Robotics
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] スライディング変換を用いた定数時間ガボールフィルタ2019

    • Author(s)
      杉本 憲治郎
    • Organizer
      信号処理シンポジウム
    • Related Report
      2019 Research-status Report
  • [Presentation] ガウシアンの周辺化を用いた非等方ガウシアンフィルタのカーネル分解2019

    • Author(s)
      杉本 憲治郎
    • Organizer
      信号処理シンポジウム
    • Related Report
      2019 Research-status Report
  • [Presentation] Hybrid Connection Network for Semantic Segmentation2018

    • Author(s)
      Xiao LIANG and Sei-ichiro KAMATA
    • Organizer
      10th International Conference on Digital Image Processing
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] GPU 処理に適した三次元画像の高速近似バイラテラルフィルタ2018

    • Author(s)
      矢野光一,杉本憲治郎,鎌田清一郎
    • Organizer
      第24回画像センシングシンポジウム
    • Related Report
      2018 Research-status Report
  • [Presentation] Forgery Image Detection via Mask Filter Banks based CNN2018

    • Author(s)
      Luyue WANG and Sei-ichiro KAMATA
    • Organizer
      11th International Conference on Graphics and Image Processing
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Densely Connected AutoEncoders for Image Compression2018

    • Author(s)
      Zebang SONG and Sei-ichiro KAMATA
    • Organizer
      2nd International Conference on Image and Graphics Processing
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2018-04-23   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi