• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Automated Testing of Deep Learning Systems

Research Project

Project/Area Number 19H04086
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 60050:Software-related
Research InstitutionKyushu University

Principal Investigator

Zhao Jianjun  九州大学, システム情報科学研究院, 教授 (20299580)

Co-Investigator(Kenkyū-buntansha) 鵜林 尚靖  九州大学, システム情報科学研究院, 教授 (80372762)
亀井 靖高  九州大学, システム情報科学研究院, 准教授 (10610222)
馮 尭楷  九州大学, システム情報科学研究院, 助教 (60363389)
馬 雷  九州大学, システム情報科学研究院, 准教授 (70842061)
Project Period (FY) 2019-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥17,160,000 (Direct Cost: ¥13,200,000、Indirect Cost: ¥3,960,000)
Fiscal Year 2021: ¥4,940,000 (Direct Cost: ¥3,800,000、Indirect Cost: ¥1,140,000)
Fiscal Year 2020: ¥5,070,000 (Direct Cost: ¥3,900,000、Indirect Cost: ¥1,170,000)
Fiscal Year 2019: ¥7,150,000 (Direct Cost: ¥5,500,000、Indirect Cost: ¥1,650,000)
Keywordsソフトウエアテスト / 深層学習システム / 安全性と信頼性 / ソフトウェアテスト / 信頼性と安全性 / プログラムデバッグ
Outline of Research at the Start

深層学習は画像処理、音声認識などの応用面で華々しい成功をおさめ、自動運転車や知能ロボットなど、社会基盤に関わる重要な分野での成果が益々期待されている。それと同時に、深層学習システムにおける障害が発生する場合、社会と自然に巨大な災害をもたらす可能性があるため、その信頼性に対する要求が益々高くなっている。本研究では、深層学習システムに対する自動テスト技術を確立することを目的としている。本研究の進展により、深層学習システムに対する系統的な自動テスト技術とそのテスト支援環境が整い、信頼性の高い深層学習システムを構築することが期待できる。

Outline of Final Research Achievements

In this research, our objective is to establish systematic automated testing techniques for deep learning systems. The specific research accomplishments are as follows: (1) We designed and developed comprehensive test coverage criteria for deep learning systems.(2) We constructed a framework for the automatic test generation of defects in deep learning systems.(3) We developed techniques for automated defect correction and performance improvement in deep learning systems.(4) We validated the effectiveness of the proposed methods by applying them to practical deep learning systems.

The progress of this research is expected to lead to the establishment of systematic automated testing techniques and supporting environments for deep learning systems, thereby enabling the construction of reliable deep learning systems.

Academic Significance and Societal Importance of the Research Achievements

【学術意義】本研究では、深層学習システムのテストカバレッジ基準設計、不具合の自動テスト生成フレームワーク構築、不具合の自動修正と性能向上技術の開発を行った。提案手法は実用的なシステムへの適用によって検証され、深層学習システムの評価と検証手段の整備に貢献した。

【社会意義】本研究の進展により、深層学習システムにおける系統的な自動テスト技術と支援環境が整備され、信頼性の高いシステム構築が期待される。これにより、深層学習技術は医療、交通、金融など多様な領域において高品質かつ安全なシステムとして社会にポジティブな影響を与えることが期待される。

Report

(4 results)
  • 2022 Final Research Report ( PDF )
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • 2019 Annual Research Report
  • Research Products

    (33 results)

All 2023 2021 2020 2019 Other

All Int'l Joint Research (8 results) Journal Article (2 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 2 results,  Open Access: 2 results) Presentation (21 results) (of which Int'l Joint Research: 21 results,  Invited: 1 results) Funded Workshop (2 results)

  • [Int'l Joint Research] University of Alberta(カナダ)

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] Tianjin University/Zhejiang Sci-Tech University(中国)

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] Alibaba (USA)(米国)

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] Nanyang Technological University(シンガポール)

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] Nanyang Technological University/A*Star(シンガポール)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] Tianjin University/Univ. of Science and Technology of China/Shanghai Jiao Tong University(中国)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] Nanyang Technological University(シンガポール)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] Shanghai Jiao Tong University/Tianjin University(中国)

    • Related Report
      2019 Annual Research Report
  • [Journal Article] FalsifAI: Falsification of AI-Enabled Hybrid Control Systems Guided by Time-Aware Coverage Criteria2023

    • Author(s)
      Zhang Zhenya、Lyu Deyun、Arcaini Paolo、Ma Lei、Hasuo Ichiro、Zhao Jianjun
    • Journal Title

      IEEE Transactions on Software Engineering

      Volume: 49 Issue: 4 Pages: 1842-1859

    • DOI

      10.1109/tse.2022.3194640

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] DeepRepair: Style-Guided Repairing for Deep Neural Networks in the Real-World Operational Environment2021

    • Author(s)
      Yu Bing、Qi Hua、Qing Guo、Juefei-Xu Felix、Xie Xiaofei、Ma Lei、Zhao Jianjun
    • Journal Title

      IEEE Transactions on Reliability

      Volume: - Issue: 4 Pages: 1-16

    • DOI

      10.1109/tr.2021.3096332

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Learning to adversarially blur visual object tracking2021

    • Author(s)
      Qing Guo, Ziyi Cheng, Felix Juefei-Xu, Lei Ma, Xiaofei Xie, Yang Liu, Jianjun Zhao
    • Organizer
      Proceedings of the IEEE/CVF International Conference on Computer Vision
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Efficientderain: Learning pixel-wise dilation filtering for high-efficiency single-image deraining2021

    • Author(s)
      Qing Guo, Jingyang Sun, Felix Juefei-Xu, Lei Ma, Xiaofei Xie, Wei Feng, Yang Liu, Jianjun Zhao
    • Organizer
      Proceedings of the AAAI Conference on Artificial Intelligence (AAAI 2021)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] On the effectiveness of signal rescaling in hybrid system falsification2021

    • Author(s)
      Zhenya Zhang, Deyun Lyu, Paolo Arcaini, Lei Ma, Ichiro Hasuo, Jianjun Zhao
    • Organizer
      NASA Formal Methods: 13th International Symposium, NFM 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Deepmix: Online auto data augmentation for robust visual object tracking2021

    • Author(s)
      Ziyi Cheng, Xuhong Ren, Felix Juefei-Xu, Wanli Xue, Qing Guo, Lei Ma, Jianjun Zhao
    • Organizer
      2021 IEEE International Conference on Multimedia and Expo (ICME)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Effective hybrid system falsification using monte carlo tree search guided by QB-robustness2021

    • Author(s)
      Zhenya Zhang, Deyun Lyu, Paolo Arcaini, Lei Ma, Ichiro Hasuo, Jianjun Zhao
    • Organizer
      Computer Aided Verification: 33rd International Conference, CAV 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] EfficientDeRain: Learning Pixel-wise Dilation Filtering for High-Efficiency Single-Image Deraining2021

    • Author(s)
      Qing Guo, Jingyang Sun, Felix Juefei-Xu, Lei Ma, Xiaofei Xie, Wei Feng, Yang Liu, and Jianjun Zhao
    • Organizer
      The 35th AAAI Conference on Artificial Intelligence (AAAI 2021)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Parallelizing Flow-Sensitive Demand-Driven Points-to Analysis2020

    • Author(s)
      Haibo Yu, Qiang Sun, Kejun Xiao, Yuting Chen, Tsunenori Mine, Jianjun Zhao
    • Organizer
      2020 IEEE 20th International Conference on Software Quality, Reliability and Security Companion (QRS-C)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Marble: Model-Based Robustness Analysis of Stateful Deep Learning Systems2020

    • Author(s)
      Xiaoning Du, Yi Li, Xiaofei Xie, Lei Ma, Yang Liu, Jianjun Zhao
    • Organizer
      The 35th IEEE/ACM International Conference on Automated Software Engineering (ASE 2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Cats Are Not Fish: Deep Learning Testing Calls for Out-Of-Distribution Awareness2020

    • Author(s)
      David Berend, Xiaofei Xie, Lei Ma, Lingjun Zhou, Yang Liu, Chi Xu, and Jianjun Zhao
    • Organizer
      The 35th IEEE/ACM International Conference on Automated Software Engineering (ASE 2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Few-Shot Guided Mix for DNN Repairing2020

    • Author(s)
      Xuhong Ren, Bing Yu, Hua Qi, Felix Juefei-Xu, Zhuo Li, Wanli Xue, Lei Ma, and Jianjun Zhao
    • Organizer
      Proc. 36th IEEE International Conference on Software Maintenance and Evolution (ICSME 2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythms2020

    • Author(s)
      Hua Qi, Qing Guo, Felix Juefei-Xu, Xiaofei Xie, Lei Ma, Wei Feng, Yang Liu, and Jianjun Zhao
    • Organizer
      The 28th ACM International Conference on Multimedia (ACM MM 2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Towards Characterizing Adversarial Defects of Deep Learning Software from the Lens of Uncertainty2020

    • Author(s)
      Xiyue Zhang, Xiaofei Xie, Lei Ma, Xiaoning Du, Qiang Hu, Yang Liu, Jianjun Zhao, and Meng Sun
    • Organizer
      The 42nd International Conference on Software Engineering (ICSE 2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] How are Deep Learning Models Similar? An Empirical Study on Clone Analysis of Deep Learning Software2020

    • Author(s)
      Xiongfei Wu, Liangyu Qin, Bing Yu, Xiaofei Xie, Lei Ma, Yinxing Xue, Yang Liu, and Jianjun Zhao
    • Organizer
      The 28th International Conference on Program Comprehension (ICPC 2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Secure Deep Learning Engineering: A Road towards Quality Assurance of Intelligent Systems2019

    • Author(s)
      Yang Liu, Lei Ma, and Jianjun Zhao
    • Organizer
      Proc. 21st International Conference on Formal Engineering Methods (ICFEM 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] DeepMutation++: a Mutation Testing Framework for Deep Learning Systems2019

    • Author(s)
      Qiang Hu, Lei Ma, Xiaofei Xie, Bing Yu, Yang Liu, and Jianjun Zhao
    • Organizer
      Proc. 34th IEEE/ACM Conference on Automated Software Engineering (ASE 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Quantitative Analysis Framework for Recurrent Neural Network2019

    • Author(s)
      Xiaoning Du, Xiaofei Xie, Yi Li, Lei Ma, Yang Liu, and Jianjun Zhao
    • Organizer
      Proc. 34th IEEE/ACM Conference on Automated Software Engineering (ASE 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] DeepHunter: A Coverage-Guided Fuzzer for Deep Neural Networks2019

    • Author(s)
      Xiaofei Xie, Hongxu Chen, Yi Li, Lei Ma, Yang Liu, and Jianjun Zhao
    • Organizer
      Proc. 34th IEEE/ACM Conference on Automated Software Engineering (ASE 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] An Empirical Study towards Characterizing Deep Learning Development and Deployment across Different Frameworks and Platforms2019

    • Author(s)
      Qianyu Guo, Sen Chen, Xiaofei Xie, Lei Ma, Qiang Hu, Hongtao Liu, Yang Liu, Jianjun Zhao, Xiaohong Li
    • Organizer
      Proc. 34th IEEE/ACM Conference on Automated Software Engineering (ASE 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] DeepStellar: Model-Based Quantitative Analysis of Stateful Deep Learning Systems2019

    • Author(s)
      Xiaoning Du, Xiaofei Xie, Yi Li, Lei Ma, Yang Liu and Jianjun Zhao
    • Organizer
      Proc. 27th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] DeepHunter:A Coverage-Guided Fuzz Testing Framework for Deep Neural Networks2019

    • Author(s)
      Xiaofei Xie, Lei Ma, Felix Juefei-Xu, Minhui Xue, Hongxu Chen, Yang Liu, Jianjun Zhao, Bo Li, Jianxiong Yin, and Simon See
    • Organizer
      Proc. 28th ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] DeepVisual: A Visual Programming Tool for Deep Learning Systems2019

    • Author(s)
      Chao Xie, Hua Qi, Lei Ma, and Jianjun Zhao
    • Organizer
      Proc. 27th IEEE/ACM International Conference on Program Comprehension (ICPC 2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Funded Workshop] The 11th Asia-Pacific Symposium on Internetware (Intertware 2019)2019

    • Related Report
      2019 Annual Research Report
  • [Funded Workshop] The 8th Asian-Pacific Workshop on Advanced Software Engineering (AWASE 2019)2019

    • Related Report
      2019 Annual Research Report

URL: 

Published: 2019-04-18   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi