• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Learning Internal Representations Robust against Adversarial Attacks

Research Project

Project/Area Number 20K19824
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 61010:Perceptual information processing-related
Research InstitutionKyushu University

Principal Investigator

Vargas Danilo  九州大学, システム情報科学研究院, 准教授 (00795536)

Project Period (FY) 2020-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥2,470,000 (Direct Cost: ¥1,900,000、Indirect Cost: ¥570,000)
Fiscal Year 2021: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2020: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
KeywordsRobust AI / Robust Machine Learning / Adversarial ML / Robust Representations / 敵対的機械学習 / Deep Neural Networks / 深層学習 / One pixel attack / GAN / ロバスト人工知能 / 敵対的学習
Outline of Research at the Start

Current DNNs are known to possess many vulnerabilities which make their applications unsafe. In our last investigations, it was understood that the problem lies in the fact that DNNs focus on the texture rather than the shape in their representation. GANs, however, learn to encode, decode as well as transform images and are known to learn internally complex models of the input that goes beyond texture. Here, I propose to tackle the robustness of DNNs by using the internal representation learned by GANs to create DNNs capable of classifying based on features that go beyond texture.

Outline of Final Research Achievements

Here, I proposed to tackle the robustness of DNNs by evaluating and improving the internal representation learned by DNNs. Regarding the evaluation of the internal representation of DNNs, we discovered that the transferability of features links to robustness to adversarial attacks. In other words, the better the transfer of features the better the robustness to adversarial attacks. We also proposed K-spectrum which can evaluate and visualize multiple layers of DNNs together in a graph, allowing for easy inspection of how their shapes are in multi-dimensional space. Regarding the improvement of the internal representation of DNNs, we have developed as described in the proposition a GAN based system to improve the network robustness. The system outperformed the state-of-the-art and is being submitted to a journal now.
Results of this research were published in journals and proceedings, more than 13 articles in total.

Academic Significance and Societal Importance of the Research Achievements

Critical systems such as autonomous driving and medical applications require robust machine learning algorithms. This research paves the way to better algorithms that will allow for such applications to become a reality.

Report

(3 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Research-status Report
  • Research Products

    (22 results)

All 2022 2021 2020

All Journal Article (8 results) (of which Int'l Joint Research: 7 results,  Peer Reviewed: 7 results,  Open Access: 7 results) Presentation (13 results) (of which Int'l Joint Research: 9 results,  Invited: 2 results) Book (1 results)

  • [Journal Article] Adversarial Robustness Assessment: Why both L0 and L∞ Attacks Are Necessary2022

    • Author(s)
      S. Kotyan and D. V. Vargas
    • Journal Title

      PLOS ONE

      Volume: --- Issue: 4 Pages: 265723-265723

    • DOI

      10.1371/journal.pone.0265723

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Setting the space for deliberation in decision-making2021

    • Author(s)
      J. Lauwereyns and D. V. Vargas
    • Journal Title

      Cognitive Neurodynamics

      Volume: 15 Issue: 5 Pages: 743-755

    • DOI

      10.1007/s11571-021-09681-2

    • Related Report
      2021 Annual Research Report
  • [Journal Article] Continual General Chunking Problem and SyncMap2021

    • Author(s)
      D. V. Vargas and T. Asabuki
    • Journal Title

      Proceedings of the AAAI21

      Volume: in press

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Preliminary study of applied binary neural networks for neural cryptography2020

    • Author(s)
      Tenorio Raul Horacio Valencia、Sham Chiu Wing、Vargas Danilo Vasconcellos
    • Journal Title

      Proceedings of the GECCO 2020 Companion

      Volume: 1 Pages: 291-292

    • DOI

      10.1145/3377929.3389933

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Towards Evolving Robust Neural Architectures to Defend from Adversarial Attacks2020

    • Author(s)
      Kotyan, S. and D. V. Vargas
    • Journal Title

      Proceedings of the GECCO 2020 Companion

      Volume: 1 Pages: 290-291

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Towards improvement of SUNA in Multiplexers with preliminary results of2020

    • Author(s)
      Anh Duc Ta and D. V. Vargas
    • Journal Title

      Proceedings of the GECCO 2020 Companion

      Volume: 1 Pages: 289-290

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Understanding the one-pixel attack: Propagation maps and locality analysis2020

    • Author(s)
      D. V. Vargas and Su
    • Journal Title

      CEUR Workshop Proceedings

      Volume: 1 Pages: 1-8

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Evolving Robust Neural Architectures to Defend from Adversarial Attacks2020

    • Author(s)
      Kotyan, S. and D. V. Vargas
    • Journal Title

      CEUR Workshop Proceedings

      Volume: 1 Pages: 1-8

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] 過去の情報を用いたQ-learning2022

    • Author(s)
      大石 幸斗, Vargas Danilo Vasconcellos
    • Organizer
      第40回計測自動制御学会九州支部学術講演会
    • Related Report
      2021 Annual Research Report
  • [Presentation] On the deeper secrets of deep neural networks and path forward2021

    • Author(s)
      ヴァルガス ダニロ,
    • Organizer
      BEYOND AI" SUMMER SCHOOL 2021
    • Related Report
      2021 Annual Research Report
    • Invited
  • [Presentation] owards Evaluating the Representation Learned by Variational AutoEncoders2021

    • Author(s)
      T. Ueda and D. V. Vargas
    • Organizer
      SICE Annual Conference (SICE 2021)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Preliminary results on Chunking with Recurrent Neural Networks2021

    • Author(s)
      Po-Yuan Mao and Danilo Vasconcellos Vargas
    • Organizer
      SICE Annual Conference (SICE 2021)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Deep neural network loses attention to adversarial images2021

    • Author(s)
      S. Kotyan and D. V. Vargas
    • Organizer
      AISafety Workshop (AISafety 2021)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Towards Understanding The Space of Unrobust Features of Neural Networks2021

    • Author(s)
      L. Bingli, T. Kanzaki and D. V. Vargas
    • Organizer
      IEEE CYBCONF 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Towards learning Hierarchical Structures with SyncMap2021

    • Author(s)
      Y. F. Tham and D. V. Vargas
    • Organizer
      IEEE CYBCONF 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Parameter Optimization via CMA-ES for Implementation in the Active Control of Magnetic Pillar Arrays2021

    • Author(s)
      S. Gaysornkaew, D. V. Vargas and F. Tsumori
    • Organizer
      IEEE CYBCONF 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Preliminary Results for Subpopulation Algorithm Based on Novelty (SAN) Compared with the State of the Art2021

    • Author(s)
      Y. Jiang (South China University of Technology) and D. V. Vargas
    • Organizer
      IEEE CYBCONF 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 一ピクセルで誤魔化される人工知能が人間を超えた?2020

    • Author(s)
      D. V. Vargas
    • Organizer
      第7回AI Optics研究会
    • Related Report
      2020 Research-status Report
    • Invited
  • [Presentation] On The Deeper Secrets of Deep Learning2020

    • Author(s)
      D. V. Vargas
    • Organizer
      IJCAI20
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] On The Deeper Secrets of Deep Learning2020

    • Author(s)
      D. V. Vargas
    • Organizer
      WCCI20
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Is Neural Architecture Search A Way Forward to Develop Robust Neural Networks?2020

    • Author(s)
      Kotyan, S. and D. V. Vargas
    • Organizer
      JSAI2020
    • Related Report
      2020 Research-status Report
  • [Book] Autonomous Vehicles: Business, Technology and Law2021

    • Author(s)
      Van Uytsel, S. and D. V. Vargas
    • Total Pages
      228
    • Publisher
      Springer
    • ISBN
      9789811592546
    • Related Report
      2020 Research-status Report

URL: 

Published: 2020-04-28   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi