• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Training of deep learning models by introducing prior knowledge

Research Project

Project/Area Number 21K12049
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 61040:Soft computing-related
Research InstitutionHiroshima University

Principal Investigator

Kurita Takio  広島大学, 先進理工系科学研究科(工), 教授 (10356941)

Co-Investigator(Kenkyū-buntansha) 日高 章理  東京電機大学, 理工学部, 准教授 (70553519)
Project Period (FY) 2021-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥4,030,000 (Direct Cost: ¥3,100,000、Indirect Cost: ¥930,000)
Fiscal Year 2023: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2022: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2021: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Keywords深層学習 / 事前知識 / 不変特徴抽出 / パターン認識 / 機械学習
Outline of Research at the Start

訓練データに基づいて学習したディープラーニングのモデルは,タスクを達成するために必要な情報だけでなく,タスクに無関係で不必要な情報をも学習してしまっており,データの背後にあるタスク自体の制約条件を十分に取り込めていない.
研究代表者等は,この課題を解決するため,学習の目的関数に正則化項を加えることで事前知識を取り込む手法を開発してきた.本研究課題では,これをさらに進めて,事前知識を取り込む学習法の体系化の基盤を作ることを目指す.具体的には,(1)識別に無関係な変動に対して不変な特徴の抽出による学習の誘導,(2)事前知識を利用して訓練データを生成する手法の2つのサブ課題について研究する.

Outline of Final Research Achievements

We studied methods for actively incorporating task constraints into the learning results of deep learning. Specifically, we proposed methods for incorporating prior knowledge as a regularization term, removing information irrelevant to the task from the training results, and augmenting the training data using prior knowledge. We applied the proposed approaches to image identification, image region extraction, and object detection, and experimentally confirmed their effectiveness.

Academic Significance and Societal Importance of the Research Achievements

深層学習は訓練データから自動的にモデルのパラメータを推定してくれるため非常に便利であるが得られたモデルにタスクが持つ制約条件が十分に取り入れられていない.本研究では深層学習の学習結果にタスクの制約条件を積極的に取り込むための方法について研究した.これは深層学習の結果を信頼して使うためのひとつのアプローチであると考える.

Report

(4 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Research-status Report
  • 2021 Research-status Report
  • Research Products

    (33 results)

All 2024 2023 2022 2021

All Journal Article (17 results) (of which Int'l Joint Research: 11 results,  Peer Reviewed: 17 results,  Open Access: 14 results) Presentation (16 results) (of which Int'l Joint Research: 16 results)

  • [Journal Article] Improved Head and Data Augmentation to Reduce Artifacts at Grid Boundaries in Object Detection2024

    • Author(s)
      UCHINOURA Shinji、KURITA Takio
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E107.D Issue: 1 Pages: 115-124

    • DOI

      10.1587/transinf.2023EDP7079

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2024-01-01
    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Nonlinear dimensionality reduction with q-Gaussian distribution2024

    • Author(s)
      Abe Motoshi、Nomura Yuichiro、Kurita Takio
    • Journal Title

      Pattern Analysis and Applications

      Volume: 27 Issue: 1 Pages: 1-12

    • DOI

      10.1007/s10044-024-01210-1

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] An Object Detection Method Using Probability Maps for Instance Segmentation to Mask Background2023

    • Author(s)
      Uchinoura Shinji、Miyao Junichi、Kurita Takio
    • Journal Title

      Journal of Advanced Computational Intelligence and Intelligent Informatics

      Volume: 27 Issue: 5 Pages: 886-895

    • DOI

      10.20965/jaciii.2023.p0886

    • ISSN
      1343-0130, 1883-8014
    • Year and Date
      2023-09-20
    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Convolutional autoencoder based on latent subspace projection for anomaly detection2023

    • Author(s)
      Yu Qien、Li Chen、Zhu Ye、Kurita Takio
    • Journal Title

      Methods

      Volume: 214 Pages: 48-59

    • DOI

      10.1016/j.ymeth.2023.04.007

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Image Inpainting for Large and Irregular Mask Based on Partial Convolution and Cross Semantic Attention2023

    • Author(s)
      Wang Yin、Aizawa Hiroaki、Kurita Takio
    • Journal Title

      Pattern Recognition. ACPR 2023. Lecture Notes in Computer Science, vol 14407. Springer, Cham.

      Volume: 1 Pages: 115-128

    • DOI

      10.1007/978-3-031-47637-2_9

    • ISBN
      9783031476365, 9783031476372
    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Data Expansion Approach with Attention Mechanism for Learning with Noisy Labels2023

    • Author(s)
      Nomura Yuichiro、Kurita Takio
    • Journal Title

      International Journal on Artificial Intelligence Tools

      Volume: 32 Issue: 01 Pages: 1-19

    • DOI

      10.1142/s0218213023500276

    • Related Report
      2022 Research-status Report
    • Peer Reviewed
  • [Journal Article] Attention-effective multiple instance learning on weakly stem cell colony segmentation2023

    • Author(s)
      Yudistira Novanto、Kavitha Muthu Subash、Rajan Jeny、Kurita Takio
    • Journal Title

      Intelligent Systems with Applications

      Volume: 17 Pages: 200187-200187

    • DOI

      10.1016/j.iswa.2023.200187

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Sample Selection Approach with Number of False Predictions for Learning with Noisy Labels2022

    • Author(s)
      NOMURA Yuichiro、KURITA Takio
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E105.D Issue: 10 Pages: 1759-1768

    • DOI

      10.1587/transinf.2022EDP7033

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2022-10-01
    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Consistency Regularization on Clean Samples for Learning with Noisy Labels2022

    • Author(s)
      NOMURA Yuichiro、KURITA Takio
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E105.D Issue: 2 Pages: 387-395

    • DOI

      10.1587/transinf.2021EDP7127

    • NAID

      130008149969

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2022-02-01
    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Weakly-Supervised Action Localization, and Action Recognition Using Global-Local Attention of 3D CNN2022

    • Author(s)
      Yudistira Novanto、Kavitha Muthu Subash、Kurita Takio
    • Journal Title

      International Journal of Computer Vision

      Volume: 130 Issue: 10 Pages: 2349-2363

    • DOI

      10.1007/s11263-022-01649-x

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Deep Neural Network Models for Colon Cancer Screening2022

    • Author(s)
      Kavitha Muthu Subash、Gangadaran Prakash、Jackson Aurelia、Venmathi Maran Balu Alagar、Kurita Takio、Ahn Byeong-Cheol
    • Journal Title

      Cancers

      Volume: 14 Issue: 15 Pages: 3707-3707

    • DOI

      10.3390/cancers14153707

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Improvement for Single Image Super-resolution and Image Segmentation by Graph Laplacian Regularizer Based on Differences of Neighboring Pixels2022

    • Author(s)
      Lukman HAKIM, Huipeng ZHEN, and Takio KURITA
    • Journal Title

      International Journal of Intelligent Engineering and Systems

      Volume: 15 Issue: 1 Pages: 95-105

    • DOI

      10.22266/ijies2022.0228.10

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Deep Metric Learning for Multi-Label and Multi-Object Image Retrieval2021

    • Author(s)
      MOJOO Jonathan、KURITA Takio
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E104.D Issue: 6 Pages: 873-880

    • DOI

      10.1587/transinf.2020EDP7226

    • NAID

      130008046653

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2021-06-01
    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Extensive framework based on novel convolutional and variational autoencoder based on maximization of mutual information for anomaly detection2021

    • Author(s)
      Yu Qien、Kavitha Muthu Subash、Kurita Takio
    • Journal Title

      Neural Computing and Applications

      Volume: 33 Issue: 20 Pages: 13785-13807

    • DOI

      10.1007/s00521-021-06017-3

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Autoencoder framework based on orthogonal projection constraints improves anomalies detection2021

    • Author(s)
      Yu Qien、Kavitha Muthusubash、Kurita Takio
    • Journal Title

      Neurocomputing

      Volume: 450 Pages: 372-388

    • DOI

      10.1016/j.neucom.2021.04.033

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Regularizer based on Euler characteristic for retinal blood vessel segmentation2021

    • Author(s)
      Hakim Lukman、Kavitha Muthu Subash、Yudistira Novanto、Kurita Takio
    • Journal Title

      Pattern Recognition Letters

      Volume: 149 Pages: 83-90

    • DOI

      10.1016/j.patrec.2021.05.023

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Leveraging network using controlled weight learning approach for thyroid cancer lymph node detection2021

    • Author(s)
      Kavitha Muthu Subash、Yudistira Novanto、Ahn Byeong-Cheol、Kurita Takio
    • Journal Title

      Biocybernetics and Biomedical Engineering

      Volume: 41 Issue: 4 Pages: 1589-1600

    • DOI

      10.1016/j.bbe.2021.10.003

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Tackling Background Misclassification in Box-supervised Segmentation: A Background Constraint Approach2024

    • Author(s)
      Zhicheng Zhang and Takio Kurita
    • Organizer
      The International Workshop on Frontiers of Computer Vision (IW-FCV)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Clustering of Face Images in Video by Using Deep Learning2024

    • Author(s)
      Eito Tada and Takio Kurita
    • Organizer
      The International Workshop on Frontiers of Computer Vision (IW-FCV)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Important Pixels Sampling for NeRF Training based on Edge Values and Squared Errors between the Ground Truth and the Estimated Colors2024

    • Author(s)
      Kohei Fukuda, Hiroaki Aizawa, and Takio Kurita
    • Organizer
      International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Improvement of Robustness to Noise for Medical Image Segmentation by using Self-Supervised Learning Approach2023

    • Author(s)
      Yuta Konishi and Takio Kurita
    • Organizer
      The 29th International Workshop on Frontiers of Computer Vision (IW-FCV2023)
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Summary of Works on Image Classification with Noisy Labels2022

    • Author(s)
      Yuichiro Nomura and Takio Kurita
    • Organizer
      2022 International Power Electronics Conference, IPEC-Himeji 2022 -ECCE Asia-
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Pixel Relationships-Based Regularizer for Retinal Vessel Image Segmentation2022

    • Author(s)
      Lukman Hakim and Takio Kurita
    • Organizer
      2022 International Power Electronics Conference, IPEC-Himeji 2022 -ECCE Asia-
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Graph Laplacian Regularization based on the Differences of Neighboring Pixels for Conditional Convolutions for Instance Segmentation2022

    • Author(s)
      Shinji Uchinoura and Takio Kurita
    • Organizer
      2022 26th International Conference on Pattern Recognition (ICPR),
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Supervised Learning for Convolutional Neural Network with Barlow Twins2022

    • Author(s)
      Ramyaa Murugan, Jonathan Mojoo and Takio Kurita
    • Organizer
      Artificial Neural Networks and Machine Learning (ICANN 2022)
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Additional Learning for Joint Probability Distribution Matching in BiGAN2022

    • Author(s)
      Jiazhou Zheng, Hiroaki Aizawa and Takio Kurita
    • Organizer
      The 29th International Conference on Neural Information Processing (ICONIP)
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] PatchNet: Patching Trained Model by Additional Neural Network2022

    • Author(s)
      Motoshi Abe and Takio Kurita
    • Organizer
      The 28th International Workshop on Frontiers of Computer Vision (IW-FCV)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Optimization of Re-ranking based on k-reciprocal for Vehicle Re-identification2022

    • Author(s)
      Simin Liu, Yuta Konishi, Junichi Miyao and Takio Kurita
    • Organizer
      The 28th International Workshop on Frontiers of Computer Vision (IW-FCV)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Decomposition of Invariant and Variant Features by using Convolutional Autoencoder2022

    • Author(s)
      Hidenori Ide, Hiromu Fujishige, Junichi Miyao and Takio Kurita
    • Organizer
      The 28th International Workshop on Frontiers of Computer Vision (IW-FCV)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] q-Softplus Function: Extensions of Activation Function and Loss Function by using q-Space2021

    • Author(s)
      Motoshi Abe and Takio Kurita
    • Organizer
      the 6th Asian Conference on Pattern Recognition (ACPR2021)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Parametric q-Gaussian distributed stochastic neighbor embedding with Convolutional Neural Network2021

    • Author(s)
      Motoshi Abe, Junichi Miyao and Takio Kurita
    • Organizer
      2021 International Joint Conference on Neural Networks (IJCNN)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Invariant Feature Extraction for CNN Classifier by using Gradient Reversal Layer2021

    • Author(s)
      Michiaki Ueda, Keijiro Kanda, Junichi Miyao, Shogo Miyamoto, Yukiko Nakano and Takio Kurita
    • Organizer
      2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Single-Image Super-Resolution Reconstruction based on the Differences of Neighboring Pixels2021

    • Author(s)
      Huipeng Zheng, Lukman Hakim, Takio Kurita and Junichi Miyao
    • Organizer
      Neural Information Processing. ICONIP 2021. Communications in Computer and Information Science
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2021-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi