• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2022 Fiscal Year Annual Research Report

Comprehensive Analysis and Repairing Techniques for Stateful Deep Learning Systems

Research Project

Project/Area Number 20H04168
Research InstitutionKyushu University

Principal Investigator

馬 雷  九州大学, システム情報科学研究院, 准教授 (70842061)

Co-Investigator(Kenkyū-buntansha) 佐藤 周行  東京大学, 情報基盤センター, 准教授 (20225999)
趙 建軍  九州大学, システム情報科学研究院, 教授 (20299580)
石川 冬樹  国立情報学研究所, アーキテクチャ科学研究系, 准教授 (50455193)
鵜林 尚靖  九州大学, システム情報科学研究院, 教授 (80372762)
Project Period (FY) 2020-04-01 – 2023-03-31
Keywordsソフトウェア工学 / 知能ソフトウェア解析 / 深層学習 / 機械学習工学 / 回帰型ニューラルネットワーク解析 / 機械学習品質保証
Outline of Annual Research Achievements

今年度は最終年度として、昨年度の研究に基づいて、さらなる主要な開発、実験、及び評価を行いました。具体的には、以下の研究内容を行いました。(1)カバレッジに基づくテストフレームワークの実験と実用性の評価。(2)AIソフトウェアに対する分析方法と修正技術の評価(3)AIソフトウェアの解析誘導オフライン修正技術の開発完成及び評価。(4)提出された技術が実際のAIソフトウェアに対して実用性を評価。(5)今までのそれぞれの研究結果がまとめて国際会議と雑誌に投稿され、採択されました。
近年では、音声認識や自然言語処理などの産業応用に効果的な状態を保持するステートフルAIモデルである回帰型ニューラルネットワーク(RNN)が注目されており、産業分野でもよく使用されています。しかしながら、実際に広く応用されている RNN は、複雑な設計、状態の持続性、そしてブラックボックスの特性により、その解析、解釈やテストなどが非常に困難であることが多いです。品質保証や信頼性について、実際に応用する際には、大きな懸念やリスクが招く可能性があります。
この研究は3年間にわたって、ステートフル深層学習ソフトウェアに対する解析、理解、及び修正技術などを研究し、一連の技術方法などを提出し、有効性を評価しました。それぞれの技術については、国際会議や論文投稿などで発表されました。当初の計画内容が完成でき、最後の研究成果が当初の計画よりも優れていました。この課題に関する一連の研究成果により、信頼性の高いAIソフトウェアの構築に向けた基礎や土台が早期に築かれました。今後は、より深い関連研究が展開や応用されることが期待されます。

Research Progress Status

令和4年度が最終年度であるため、記入しない。

Strategy for Future Research Activity

令和4年度が最終年度であるため、記入しない。

  • Research Products

    (22 results)

All 2023 2022 Other

All Int'l Joint Research (5 results) Journal Article (8 results) (of which Int'l Joint Research: 7 results,  Peer Reviewed: 8 results) Presentation (9 results) (of which Int'l Joint Research: 9 results)

  • [Int'l Joint Research] Nanyang Technological University(シンガポール)

    • Country Name
      SINGAPORE
    • Counterpart Institution
      Nanyang Technological University
  • [Int'l Joint Research] University of Luxembourg(ルクセンブルク)

    • Country Name
      LUXEMBOURG
    • Counterpart Institution
      University of Luxembourg
  • [Int'l Joint Research] Purdue University(米国)

    • Country Name
      U.S.A.
    • Counterpart Institution
      Purdue University
  • [Int'l Joint Research] University of Alberta(カナダ)

    • Country Name
      CANADA
    • Counterpart Institution
      University of Alberta
  • [Int'l Joint Research] Tsinghua University(中国)

    • Country Name
      CHINA
    • Counterpart Institution
      Tsinghua University
  • [Journal Article] ArchRepair: Block-Level Architecture-Oriented Repairing for Deep Neural Networks2023

    • Author(s)
      Hua Qi, Zhijie Wang, Qing Guo, Jianlang Chen, Felix Juefei-Xu, Fuyuan Zhang, Lei Ma, Jianjun Zhao
    • Journal Title

      ACM Transactions on Software Engineering and Methodology (TOSEM 2023, CORE Rank A*, Impact Factor 3.685)

      Volume: n.a. Pages: n.a.

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] PatchCensor: Patch Robustness Certification for Transformers via Exhaustive Testing.2023

    • Author(s)
      Yuheng Huang, Lei Ma, Yuanchun Li
    • Journal Title

      ACM Transactions on Software Engineering and Methodology (TOSEM 2023, CORE Rank A*, Impact Factor 3.685)

      Volume: n.a. Pages: n.a.

    • DOI

      10.1145/3591870

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] NPC: Neuron Path Coverage via Characterizing Decision Logic of Deep Neural Networks.2023

    • Author(s)
      Xiaofei Xie, Tianlin Li, Jian Wang, Lei Ma, Qing Guo, Felix Juefei-Xu, Yang Liu.
    • Journal Title

      ACM Transactions on Software Engineering and Methodology (TOSEM 2023, CORE Rank A*, impact factor 3.685)

      Volume: 47 Pages: 1-27

    • DOI

      10.1145/3490489

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] PAFL: Probabilistic Automaton-based Fault Localization for Recurrent Neural Networks2023

    • Author(s)
      Yuta Ishimoto, Masanari Kondo, Naoyasu Ubayashi, Yasutaka Kamei
    • Journal Title

      Information and Software Technology, Volume 155, Article number: 107117, 2023. (Impact factor 3.862).

      Volume: 155 Pages: 107117

    • DOI

      10.1016/j.infsof.2022.107117

    • Peer Reviewed
  • [Journal Article] A Survey on Automated Driving System Testing: Landscapes and Trends.2023

    • Author(s)
      Shuncheng Tang, Zhenya Zhang, Yi Zhang, Jixiang Zhou, Yan Guo, Shuang Liu, Shengjian Guo, Yan-Fu Li, Lei Ma, Yinxing Xue, Yang Liu
    • Journal Title

      ACM Transactions on Software Engineering and Methodology (TOSEM 2023, CORE Rank A*, impact factor 3.685)

      Volume: n.a. Pages: n.a.

    • DOI

      10.1145/3579642

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] FalsifAI: Falsification of AI-Enabled Hybrid Control Systems Guided by Time-Aware Coverage Criteria2022

    • Author(s)
      Zhenya Zhang, Deyun Lyu, Paolo Arcaini, Lei Ma, Ichiro Hasuo, Jianjun Zhao
    • Journal Title

      IEEE Transactions on Software Engineering (TSE 2022, CORE Rank A*, Impact Factor 9.322)

      Volume: 49 Pages: 1842-1859

    • DOI

      10.1109/TSE.2022.3194640

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] DARTSRepair: Core-failure-set guided DARTS for network robustness to common corruptions.2022

    • Author(s)
      Xuhong Ren, Jianlang Chen, Felix Juefei-Xu, Wanli Xue, Qing Guo, Lei Ma, Jianjun Zhao, Shengyong Chen.
    • Journal Title

      Pattern Recognition, Elsevier, 2022 (Impact Factor 8.544)

      Volume: 131 Pages: 108864

    • DOI

      10.1016/j.patcog.2022.108864

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] On the usage and development of deep learning compilers: an empirical study on TVM2022

    • Author(s)
      Xiongfei Wu, Jinqiu Yang, Lei Ma, Yinxing Xue, and Jianjun Zhao
    • Journal Title

      Empirical Software Engineering volume 27, 172, Sep. 2022 (EMSE 2022, Impact Factor 3.762)

      Volume: 27 Pages: n.a.

    • DOI

      10.1007/s10664-022-10221

    • Peer Reviewed / Int'l Joint Research
  • [Presentation] DeepSeer: Interactive RNN Explanation and Debugging via State Abstraction2023

    • Author(s)
      Zhijie Wang, Yuheng Huang, Da Song, Lei Ma, Tianyi Zhang
    • Organizer
      The ACM CHI Conference on Human Factors in Computing Systems (CHI 2023, CORE Rank A*)
    • Int'l Joint Research
  • [Presentation] DeepLens: Interactive Out-of-Distribution Data Detection in NLP Models2023

    • Author(s)
      Da Song, Zhijie Wang, Yuheng Huang, Lei Ma, Tianyi Zhang
    • Organizer
      The ACM CHI Conference on Human Factors in Computing Systems (CHI 2023, CORE Rank A*)
    • Int'l Joint Research
  • [Presentation] Aries: Efficient Testing of Deep Neural Networks via Labeling-Free Accuracy Estimation2023

    • Author(s)
      Qiang Hu, Yuejun Guo, Xiaofei Xie, Maxime Cordy, Lei Ma, Mike Papadakis, Yves Le Traon
    • Organizer
      The 45th International Conference on Software Engineering (ICSE 2023, CORE Rank A*)
    • Int'l Joint Research
  • [Presentation] CodeS: Towards Code Model Generalization Under Distribution Shift2023

    • Author(s)
      Qiang Hu, Yuejun Guo, Xiaofei Xie, Maxime Cordy, Lei Ma, Mike Papadakis, Yves Le Traon
    • Organizer
      The 45th International Conference on Software Engineering, NIER Track (ICSE 2023, CORE Rank A* )
    • Int'l Joint Research
  • [Presentation] DeepGemini: Verifying Dependency Fairness for Deep Neural Network2023

    • Author(s)
      Xuan Xie, Fuyuan Zhang, Xinwen Hu, Lei Ma
    • Organizer
      The Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI 2023, CORE Rank A*)
    • Int'l Joint Research
  • [Presentation] Traceable In-Air Signature 3D Restoration Record Structure and In-Air Dominant Hand Biometric Based on Dynamic Time Warping Algorithm2023

    • Author(s)
      Yuheng Guo, Hiroyuki Sato
    • Organizer
      The 6th International Conference on Artificial Intelligence and Big Data (ICAIBD 2023) , 2023.
    • Int'l Joint Research
  • [Presentation] An Initial Analysis of Repair and Side-effect Prediction for Neural Networks2023

    • Author(s)
      Yuta Ishimoto, Ken Matsui, Masanari Kondo, Naoyasu Ubayashi, Yasutaka Kamei
    • Organizer
      The 2nd International Conference on AI Engineering - Software Engineering for AI (CAIN 2023)
    • Int'l Joint Research
  • [Presentation] 3D Segmenter: 3D Transformer based Semantic Segmentation via 2D Panoramic Distillation2023

    • Author(s)
      Zhennan Wu, Yang Li, Yifei Huang, Lin Gu, Tatsuya Harada, Hiroyuki Sato
    • Organizer
      The 11th Int'l Conference on Learning Representations (ICLR Core rank A*), 2023.
    • Int'l Joint Research
  • [Presentation] When Cyber-Physical Systems Meet AI: A Benchmark, an Evaluation, and a Way Forward2022

    • Author(s)
      Jiayang Song, Deyun Lyu, Zhenya Zhang, Zhijie Wang, Tianyi Zhang, Lei Ma
    • Organizer
      The 44th International Conference on Software Engineering, SEIP Track (ICSE 2022, CORE Rank A*)
    • Int'l Joint Research

URL: 

Published: 2023-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi