• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Prevention from Automated Analysis Services with Object-Level Adversarial Examples

Research Project

Project/Area Number 21K18023
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 90020:Library and information science, humanistic and social informatics-related
Research InstitutionNational Institute of Informatics

Principal Investigator

レ チュンギア  国立情報学研究所, 情報社会相関研究系, 特任研究員 (00884404)

Project Period (FY) 2021-04-01 – 2023-03-31
Project Status Discontinued (Fiscal Year 2022)
Budget Amount *help
¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
Fiscal Year 2023: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2022: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2021: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
KeywordsPrivacy protection / Adversarial examples / Adversarial Examples / Privacy Protection
Outline of Research at the Start

Users of social networks need solutions to protect privacy when sharing images which must be robust against data transformation and compression. This research investigates digital content protection using object-level adversarial examples against automated crawling and data analysis services.

Outline of Annual Research Achievements

We proposed two protection systems based on adversarial examples. In the first system, we protect people from human instance segmentation networks by automatically identifying protectable regions to minimize the effect on image quality and synthesizing inconspicuous and natural adversarial textures. This system was published at CVPR Workshops 2021. In the second system, we protect location privacy against landmark recognition systems. In particular, we introduce mask-guided multimodal projected gradient descent (MM-PGD) to improve the protection against various deep models. We also investigated different protectable region identification strategies to defend against black-box landmark recognition systems without the need for much image manipulation. This work was accepted to WIFS 2022.

We also analyzed class-aware transferability of adversarial examples to show the strong connection between non-targeted transferability of adversarial examples and same mistakes. We demonstrated that non-robust features can comprehensively explain the difference between a different mistake and a same mistake by extending the framework of Ilyas et al. In particular, we showed that when the manipulated nonrobust features in an adversarial examples are differently used by multiple models, those models may classify the adversarial examples differently. This work was accepted to WACV 2023.

Report

(2 results)
  • 2022 Annual Research Report
  • 2021 Research-status Report
  • Research Products

    (10 results)

All 2023 2022 2021

All Journal Article (10 results) (of which Int'l Joint Research: 9 results,  Peer Reviewed: 9 results)

  • [Journal Article] Closer Look at the Transferability of Adversarial Examples: How They Fool Different Models Differently2023

    • Author(s)
      Futa Waseda, Sosuke Nishikawa, Trung-Nghia Le, Huy H. Nguyen, Isao Echizen
    • Journal Title

      Winter Conference on Applications of Computer Vision

      Volume: 0 Pages: 1-9

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Analysis of Master Vein Attacks on Finger Vein Recognition Systems2023

    • Author(s)
      Huy H. Nguyen, Trung-Nghia Le, Junichi Yamagishi, Isao Echizen
    • Journal Title

      Winter Conference on Applications of Computer Vision

      Volume: 0 Pages: 1-9

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Contextual Guided Segmentation Framework for Semi-supervised Video Instance Segmentation2022

    • Author(s)
      Trung-Nghia Le, Tam V. Nguyen, Minh-Triet Tran
    • Journal Title

      Machine Vision and Applications

      Volume: 33 Issue: 2 Pages: 1-19

    • DOI

      10.1007/s00138-022-01278-x

    • Related Report
      2022 Annual Research Report 2021 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Deepfakeの生成と検出の現状2022

    • Author(s)
      Trung-Nghia Le, Huy H. Nguyen, Junichi Yamagishi, Isao Echizen
    • Journal Title

      The Journal of The Institute of Image Information and Television Engineers

      Volume: 76 Pages: 1-6

    • Related Report
      2022 Annual Research Report
  • [Journal Article] GUNNEL: Guided Mixup Augmentation and Multi-View Fusion for Aquatic Animal Segmentation2022

    • Author(s)
      Minh-Quan Le, Trung-Nghia Le, Tam V. Nguyen, Isao Echizen, Minh-Triet Tran
    • Journal Title

      CVPR Workshops

      Volume: 0 Pages: 1-15

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Rethinking Adversarial Examples for Location Privacy Protection2022

    • Author(s)
      Trung-Nghia Le, Ta Gu, Huy H. Nguyen, Isao Echizen
    • Journal Title

      International Workshop on Information Forensics and Security

      Volume: 0 Pages: 1-6

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Fashion-Guided Adversarial Attack on Person Segmentation2021

    • Author(s)
      Marc Treu, Trung-Nghia Le, Huy H. Nguyen, Junichi Yamagishi, Isao Echizen
    • Journal Title

      IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops

      Volume: 1 Pages: 943-952

    • DOI

      10.1109/cvprw53098.2021.00105

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wild2021

    • Author(s)
      Trung-Nghia Le, Huy H. Nguyen, Junichi Yamagishi, Isao Echizen
    • Journal Title

      IEEE/CVF International Conference on Computer Vision

      Volume: 1 Pages: 10117-10127

    • DOI

      10.1109/iccv48922.2021.00996

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Effectiveness of Detection-based and Regression-based Approaches for Estimating Mask-Wearing Ratio2021

    • Author(s)
      Khanh-Duy Nguyen, Huy H. Nguyen, Trung-Nghia Le, Junichi Yamagishi, Isao Echizen
    • Journal Title

      IEEE International Conference on Automatic Face and Gesture Recognition Workshops

      Volume: 1 Pages: 1-8

    • DOI

      10.1109/fg52635.2021.9667046

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Camouflaged Instance Segmentation In-The-Wild: Dataset, Method, and Benchmark Suite2021

    • Author(s)
      Trung-Nghia Le, Yubo Cao, Tan-Cong Nguyen, Minh-Quan Le, Khanh-Duy Nguyen, Thanh-Toan Do, Minh-Triet Tran, Tam V. Nguyen
    • Journal Title

      IEEE Transactions on Image Processing

      Volume: 31 Pages: 287-300

    • DOI

      10.1109/tip.2021.3130490

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Int'l Joint Research

URL: 

Published: 2021-04-28   Modified: 2023-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi