• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Testing, Analysis, and Repair of AI-enabled Cyber-Physical Systems

Research Project

Project/Area Number 23K28062
Project/Area Number (Other) 23H03372 (2023)
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeMulti-year Fund (2024)
Single-year Grants (2023)
Section一般
Review Section Basic Section 60050:Software-related
Research InstitutionKyushu University

Principal Investigator

趙 建軍  九州大学, システム情報科学研究院, 教授 (20299580)

Co-Investigator(Kenkyū-buntansha) 鵜林 尚靖  早稲田大学, 理工学術院, 教授(任期付) (80372762)
蓮尾 一郎  国立情報学研究所, アーキテクチャ科学研究系, 教授 (60456762)
石川 冬樹  国立情報学研究所, アーキテクチャ科学研究系, 准教授 (50455193)
馬 雷  東京大学, 大学院情報理工学系研究科, 准教授 (70842061)
張 振亜  九州大学, システム情報科学研究院, 助教 (10971228)
Project Period (FY) 2024-04-01 – 2026-03-31
Project Status Granted (Fiscal Year 2024)
Budget Amount *help
¥18,850,000 (Direct Cost: ¥14,500,000、Indirect Cost: ¥4,350,000)
Fiscal Year 2025: ¥5,460,000 (Direct Cost: ¥4,200,000、Indirect Cost: ¥1,260,000)
Fiscal Year 2024: ¥5,720,000 (Direct Cost: ¥4,400,000、Indirect Cost: ¥1,320,000)
Fiscal Year 2023: ¥7,670,000 (Direct Cost: ¥5,900,000、Indirect Cost: ¥1,770,000)
KeywordsAI品質保証 / サイバーフィジカルシステム / テスト / 自動修正 / プログラム修正
Outline of Research at the Start

近年、複雑な制御、工業製造などは自動化から知能化にアップグレードの急速的な変革を伴い、データ駆動型AIをコントローラとして用いるサイバーフィジカルシステム(AI-CPS)が、産業界で急速に発展と応用している。AI-CPS は、安全性を重視する多くの産業領域で採用されるため、その品質保証は非常に重要である。本研究では、AI-CPSに対する新しい体系的な品質保証技術を確立することを目的としている。本研究の進展により、AI-CPSにおける系統的な品質保証技術及びその支援環境が整い、より信頼性の高いAI-CPSの構築が期待できる。

Outline of Annual Research Achievements

本研究は、AIを活用したサイバーフィジカルシステム(AI-CPS)の品質保証手法を構築することを目的とする。2024年度は、テスト、デバッグ、修復の各技術の具体的実装と構築を行った。
まず、time-awareカバレッジ基準に基づき、AI-CPSに対するテストケース自動生成アルゴリズムを設計し、テストケース生成ツールの実装を開始した。カバレッジに基づく検証が可能となる基盤を整備した。ツールは、典型的なAI-CPS制御シナリオに対応可能な形式で実装されており、ベンチマークへの適用に向けた機能検証も一部実施した。
次に、抽象モデル(MDP)にセマンティクス情報を付与し、状態遷移における不具合原因の追跡が可能な因果関係推論アルゴリズムを設計した。これにより、入力信号とシステム異常の因果的関係を抽出できるデバッグ支援の枠組みを構築した。具体的には、セマンティクス付き状態系列とイベント系列を対応付け、因果関係を構造的に分析可能とした。
また、オフライン修復手法として、失敗時の信号データ拡張および再学習によるモデル修正手法の設計を行った。オンライン修復については、入力信号のリアルタイム補正に向けたアルゴリズムの検討を開始した。複数のモデル出力の比較による異常検出と入力補正の戦略についても検討を進めた。
さらに、以上の成果に基づき、次年度における各ツールの統合およびAI-CPSベンチマークを用いた評価実験に向けた準備作業(対象システムの選定、評価項目の整理)も進めた。

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

2024年度は、当初計画したRO1~RO3に基づき、AI-CPS向けのテスト生成、因果関係に基づくデバッグ、および修復技術に関する作業を進めた。time-awareカバレッジ基準に基づくテストケース生成アルゴリズムを設計し、実装を開始した。MDPモデルにセマンティクス情報を付与し、因果パス抽出手法を構築した。また、信号データ拡張と再学習によるオフライン修正、ならびにオンライン入力補正手法の検討を行った。以上の実施により、研究計画はおおむね順調に進展している。

Strategy for Future Research Activity

2025年度は、2023年度および2024年度に設計・構築した各種技術を統合し、AI-CPSベンチマークを用いた実証的評価を実施する。RO1では、実装済のテスト生成ツールをベンチマークに適用し、time-awareカバレッジに基づくテストの有効性を検証する。RO2では、因果パス抽出手法を用いて不具合原因の自動分析を行う。RO3では、オフラインおよびオンライン修正手法を実ベンチマークに適用し、修正の効果を検証する。RO4では、各技術を統合し、品質保証支援環境としての有効性を評価する。

Report

(2 results)
  • 2024 Research-status Report
  • 2023 Annual Research Report
  • Research Products

    (33 results)

All 2025 2024 2023 Other

All Int'l Joint Research (9 results) Journal Article (11 results) (of which Int'l Joint Research: 11 results,  Peer Reviewed: 11 results,  Open Access: 5 results) Presentation (13 results) (of which Int'l Joint Research: 13 results)

  • [Int'l Joint Research] Trinity College Dublin(アイルランド)

    • Related Report
      2024 Research-status Report
  • [Int'l Joint Research] Luxembourg Institute of Sci and Tech/University of Luxembourg(ルクセンブルク)

    • Related Report
      2024 Research-status Report
  • [Int'l Joint Research] The University of Sci. and Tec. Beijing(中国)

    • Related Report
      2024 Research-status Report
  • [Int'l Joint Research] New York Univeristy(米国)

    • Related Report
      2024 Research-status Report
  • [Int'l Joint Research] The University of Alberta(カナダ)

    • Related Report
      2024 Research-status Report
  • [Int'l Joint Research]

    • Related Report
      2024 Research-status Report
  • [Int'l Joint Research] 上海交通大学/中国科学技術大学(中国)

    • Related Report
      2023 Annual Research Report
  • [Int'l Joint Research] Singapore Management University(シンガポール)

    • Related Report
      2023 Annual Research Report
  • [Int'l Joint Research] ルクセンブルク大学(マダガスカル)

    • Related Report
      2023 Annual Research Report
  • [Journal Article] Boosting source code learning with text-oriented data augmentation: an empirical study2025

    • Author(s)
      Dong Zeming、Hu Qiang、Guo Yuejun、Zhang Zhenya、Cordy Maxime、Papadakis Mike、Le Traon Yves、Zhao Jianjun
    • Journal Title

      Empirical Software Engineering

      Volume: 30 Issue: 3 Pages: 1-1

    • DOI

      10.1007/s10664-025-10624-2

    • Related Report
      2024 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Automated Generation of Benchmarks for Falsification of STL Specifications2025

    • Author(s)
      Yan Yipei、Lyu Deyun、Zhang Zhenya、Arcaini Paolo、Zhao Jianjun
    • Journal Title

      IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems

      Volume: 0 Issue: 10 Pages: 1-1

    • DOI

      10.1109/tcad.2025.3550410

    • Related Report
      2024 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Look Before You Leap: An Exploratory Study of Uncertainty Analysis for Large Language Models2025

    • Author(s)
      Huang Yuheng、Song Jiayang、Wang Zhijie、Zhao Shengming、Chen Huaming、Juefei-Xu Felix、Ma Lei
    • Journal Title

      IEEE Transactions on Software Engineering

      Volume: 51 Issue: 2 Pages: 413-429

    • DOI

      10.1109/tse.2024.3519464

    • Related Report
      2024 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] SpectAcle: Fault Localisation of AI-Enabled CPS by Exploiting Sequences of DNN Controller Inferences2024

    • Author(s)
      Lyu Deyun、Zhang Zhenya、Arcaini Paolo、Zhang Xiao-Yi、Ishikawa Fuyuki、Zhao Jianjun
    • Journal Title

      ACM Transactions on Software Engineering and Methodology

      Volume: - Issue: 4 Pages: 1-35

    • DOI

      10.1145/3705307

    • Related Report
      2024 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] On the effectiveness of hybrid pooling in mixup-based graph learning for language processing2024

    • Author(s)
      Dong Zeming、Hu Qiang、Zhang Zhenya、Guo Yuejun、Cordy Maxime、Papadakis Mike、Traon Yves Le、Zhao Jianjun
    • Journal Title

      Journal of Systems and Software

      Volume: 216 Pages: 112139-112139

    • DOI

      10.1016/j.jss.2024.112139

    • Related Report
      2024 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] GenSafe: A Generalizable Safety Enhancer for Safe Reinforcement Learning Algorithms Based on Reduced Order Markov Decision Process Model2024

    • Author(s)
      Zhou Zhehua、Xie Xuan、Song Jiayang、Shu Zhan、Ma Lei
    • Journal Title

      IEEE Transactions on Neural Networks and Learning Systems

      Volume: 0 Issue: 6 Pages: 1-15

    • DOI

      10.1109/tnnls.2024.3496492

    • Related Report
      2024 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Benchmarking Object Detection Robustness against Real-World Corruptions2024

    • Author(s)
      Liu Jiawei、Wang Zhijie、Ma Lei、Fang Chunrong、Bai Tongtong、Zhang Xufan、Liu Jia、Chen Zhenyu
    • Journal Title

      International Journal of Computer Vision

      Volume: 132 Issue: 10 Pages: 4398-4416

    • DOI

      10.1007/s11263-024-02096-6

    • Related Report
      2024 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] LUNA: A Model-Based Universal Analysis Framework for Large Language Models2024

    • Author(s)
      Song Da、Xie Xuan、Song Jiayang、Zhu Derui、Huang Yuheng、Juefei-Xu Felix、Ma Lei
    • Journal Title

      IEEE Transactions on Software Engineering

      Volume: 50 Issue: 7 Pages: 1921-1948

    • DOI

      10.1109/tse.2024.3411928

    • Related Report
      2024 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] EfficientDeRain+: Learning Uncertainty-Aware Filtering via RainMix Augmentation for High-Efficiency Deraining2024

    • Author(s)
      Guo Qing、Qi Hua、Sun Jingyang、Juefei-Xu Felix、Ma Lei、Lin Di、Feng Wei、Wang Song
    • Journal Title

      International Journal of Computer Vision

      Volume: 133 Issue: 4 Pages: 2111-2135

    • DOI

      10.1007/s11263-024-02281-7

    • Related Report
      2024 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] On the effectiveness of graph data augmentation for source code learning2024

    • Author(s)
      Dong Zeming、Hu Qiang、Zhang Zhenya、Zhao Jianjun
    • Journal Title

      Knowledge-Based Systems

      Volume: 285 Pages: 111328-111328

    • DOI

      10.1016/j.knosys.2023.111328

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] TAT: Targeted backdoor attacks against visual object tracking2023

    • Author(s)
      Cheng Ziyi、Wu Baoyuan、Zhang Zhenya、Zhao Jianjun
    • Journal Title

      Pattern Recognition

      Volume: 142 Pages: 109629-109629

    • DOI

      10.1016/j.patcog.2023.109629

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Search-Based Repair of DNN Controllers of AI-Enabled Cyber-Physical Systems Guided by System-Level Specifications2024

    • Author(s)
      Lyu Deyun、Zhang Zhenya、Arcaini Paolo、Ishikawa Fuyuki、Laurent Thomas、Zhao Jianjun
    • Organizer
      Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2024)
    • Related Report
      2024 Research-status Report
    • Int'l Joint Research
  • [Presentation] LeGEND: A Top-Down Approach to Scenario Generation of Autonomous Driving Systems Assisted by Large Language Models2024

    • Author(s)
      Tang Shuncheng、Zhang Zhenya、Zhou Jixiang、Lei Lei、Zhou Yuan、Xue Yinxing
    • Organizer
      Proceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering (ASE 2024)
    • Related Report
      2024 Research-status Report
    • Int'l Joint Research
  • [Presentation] MetaRepair: Learning to Repair Deep Neural Networks from Repairing Experiences2024

    • Author(s)
      Xing Yun、Guo Qing、Cao Xiaofeng、Tsang Ivor W.、Ma Lei
    • Organizer
      Proceedings of the 32nd ACM International Conference on Multimedia (ACM MM 2024)
    • Related Report
      2024 Research-status Report
    • Int'l Joint Research
  • [Presentation] Optimization-Based Model Checking and?Trace Synthesis for Complex STL Specifications2024

    • Author(s)
      Sato Sota、An Jie、Zhang Zhenya、Hasuo Ichiro
    • Organizer
      Gurfinkel, A., Ganesh, V. (eds) Computer Aided Verification. CAV 2024. Lecture Notes in Computer Science
    • Related Report
      2024 Research-status Report
    • Int'l Joint Research
  • [Presentation] CauMon: An Informative Online Monitor for Signal Temporal Logic2024

    • Author(s)
      Zhang Zhenya、An Jie、Arcaini Paolo、Hasuo Ichiro
    • Organizer
      Platzer, A., Rozier, K.Y., Pradella, M., Rossi, M. (eds) Formal Methods. FM 2024, Lecture Note in Computer Science
    • Related Report
      2024 Research-status Report
    • Int'l Joint Research
  • [Presentation] Towards Building AI-CPS with NVIDIA Isaac Sim: An Industrial Benchmark and Case Study for Robotics Manipulation2024

    • Author(s)
      Zhehua Zhou, Jiayang Song, Xuan Xie, Zhan Shu, Lei Ma, Dikai Liu, Jianxiong Yin, Simon See
    • Organizer
      Proceedings of the 46th international conference on software engineering: software engineering in practice (ICSE 2024)
    • Related Report
      2024 Research-status Report
    • Int'l Joint Research
  • [Presentation] MetaRepair: Learning to Repair Deep Neural Networks from Repairing Experiences2024

    • Author(s)
      Yun Xing, Qing Guo, Xiaofeng Cao, Ivor W Tsang, Lei Ma
    • Organizer
      Proceedings of the 32nd ACM International Conference on Multimedia (ACM MM 2024)
    • Related Report
      2024 Research-status Report
    • Int'l Joint Research
  • [Presentation] ISR-LLM: Iterative Self-Refined Large Language Model for Long-Horizon Sequential Task Planning2024

    • Author(s)
      Zhehua Zhou, Jiayang Song, Kunpeng Yao, Zhan Shu, Lei Ma
    • Organizer
      2024 IEEE International Conference on Robotics and Automation (ICRA 2024)
    • Related Report
      2024 Research-status Report
    • Int'l Joint Research
  • [Presentation] DeepRover: A Query-efficient Blackbox Attack for Deep Neural Networks2023

    • Author(s)
      Fuyuan Zhang, Xinwen Hu, Lei Ma, Jianjun Zhao
    • Organizer
      The 31st ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Generative Model-Based Testing on Decision-Making Policies2023

    • Author(s)
      Zhuo Li, Xiongfei Wu, Derui Zhu, Mingfei Cheng, Siyuan Chen, Fuyuan Zhang, Xiaofei Xie, Lei Ma, Jianjun Zhao
    • Organizer
      The 38th IEEE/ACM International Conference on Automated Software Engineering (ASE 2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] GenCoG: A DSL-Based Approach to Generating Computation Graphs for TVM Testing2023

    • Author(s)
      Zihan Wang, Pengbo Nie, Xinyuan Miao, Yuting Chen, Chengcheng Wan, Lei Bu, and Jianjun Zhao
    • Organizer
      The 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] EvoScenario: Integrating Road Structures into Critical Scenario Generation for Autonomous Driving System Testing2023

    • Author(s)
      Shuncheng Tang, Zhenya Zhang, Jixiang Zhou, Yuan Zhou, Yan-Fu Li and Yinxing Xue
    • Organizer
      The 34rd International Symposium on Software Reliability Engineering (ISSRE 2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Online Causation Monitoring of Signal Temporal Logic2023

    • Author(s)
      Zhenya Zhang, Jie An, Paolo Arcaini, Ichiro Hasuo
    • Organizer
      The 35th International Conference on Computer-Aided Verification (CAV 2023)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research

URL: 

Published: 2023-04-18   Modified: 2025-12-26  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi