• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Fine-Grained Monitoring of Signal Temporal Logic and Its Applications in Quality Assurance of Cyber Physical Systems

Research Project

Project/Area Number 23K16865
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 60050:Software-related
Research InstitutionKyushu University

Principal Investigator

Zhang Zhenya  九州大学, システム情報科学研究院, 助教 (10971228)

Project Period (FY) 2023-04-01 – 2025-03-31
Project Status Completed (Fiscal Year 2024)
Budget Amount *help
¥3,250,000 (Direct Cost: ¥2,500,000、Indirect Cost: ¥750,000)
Fiscal Year 2024: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2023: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
KeywordsMonitoring / Signal temporal logic / Cyber-physical systems / Formal methods / Quality assurance / Formal verification / Signal Temporal Logic / Testing / Cyber Physical Systems / Runtime verification
Outline of Research at the Start

Cyber-Physical Systems are safety-critical and their quality assurance is important. First, we refine the semantics of Signal Temporal Logic such that it delivers more information about system evolution. Moreover, we apply the refined semantics to develop more effective quality assurance techniques.

Outline of Final Research Achievements

By the outcome of this research, we establish the theoretical foundation of causation monitoring, and apply this new monitoring paradigm in quality assurance of cyber-physical systems (CPS). First, in CAV'23, we propose the causation semantics of signal temporal logic (STL), which can also be seen as a novel online monitoring approach. Compared to existing approach, causation monitoring can report more information regarding system evolution, solving the information masking problem in existing monitoring approach.
Based on this result, in FM'24 we propose an efficient monitoring algorithm that makes causation monitoring applicable to real systems. We apply related techniques to CPS quality assurance, including trace synthesis (CAV'24), benchmark synthesis (TCAD'25), fault analysis of AI-enabled CPS (TOSEM'24, GECCO'24), etc. Moreover, we also explore testing of autonomous driving systems in ASE'24, which wins the ACM SIGSOFT Distinguished Paper Award.

Academic Significance and Societal Importance of the Research Achievements

本研究は、物理情報システム(CPS)の品質保証に対する新たなアプローチを提供した。本手法は、CPSの実行をランタイムにおいて信号時相論理に基づいて自動的にモニタリングすることができ、従来手法と比較すると、仕様違反の因果関係を報告できるため、システムの故障解析や修復を容易にした。
軽量的な形式手法として、我々のアプローチはCPSの振る舞いを厳密かつ実用的に評価する方法を提供した。現在、CPSはセーフティクリティカルな分野で急速に導入が進んでおり、自動運転システムなどのAIベースのシステムも増加し、このような状況を踏まえると、我々の手法は現実環境におけるCPSの安全保証に対し極めて重要である。

Report

(3 results)
  • 2024 Annual Research Report   Final Research Report ( PDF )
  • 2023 Research-status Report
  • Research Products

    (28 results)

All 2025 2024 2023

All Journal Article (16 results) (of which Int'l Joint Research: 11 results,  Peer Reviewed: 15 results,  Open Access: 5 results) Presentation (12 results) (of which Int'l Joint Research: 9 results,  Invited: 2 results)

  • [Journal Article] Automated Generation of Benchmarks for Falsification of STL Specifications2025

    • Author(s)
      Yan Yipei、Lyu Deyun、Zhang Zhenya、Arcaini Paolo、Zhao Jianjun
    • Journal Title

      IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems

      Volume: N/A

    • Related Report
      2024 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Adaptive Branch-and-Bound Tree Exploration for Neural Network Verification2025

    • Author(s)
      Fukuda Kota、Zhang Guanqin、Zhang Zhenya, Sui Yulei、Zhao Jianjun
    • Journal Title

      Design, Automation and Test in Europe Conference

      Volume: N/A

    • Related Report
      2024 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Search-Based Repair of DNN Controllers of AI-Enabled Cyber-Physical Systems Guided by System-Level Specifications2024

    • Author(s)
      Lyu Deyun、Zhang Zhenya、Arcaini Paolo、Ishikawa Fuyuki、Laurent Thomas、Zhao Jianjun
    • Journal Title

      Proceedings of the Genetic and Evolutionary Computation Conference

      Volume: N/A Pages: 1435-1444

    • DOI

      10.1145/3638529.3654078

    • Related Report
      2024 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Optimization-Based Model Checking and Trace Synthesis for Complex STL Specifications2024

    • Author(s)
      Sato Sota、An Jie、Zhang Zhenya、Hasuo Ichiro
    • Journal Title

      International Conference on Computer Aided Verification

      Volume: 14683 Pages: 282-306

    • DOI

      10.1007/978-3-031-65633-0_13

    • ISBN
      9783031656323, 9783031656330
    • Related Report
      2024 Annual Research Report
    • Peer Reviewed
  • [Journal Article] CauMon: An Informative Online Monitor for Signal Temporal Logic2024

    • Author(s)
      Zhang Zhenya、An Jie、Arcaini Paolo、Hasuo Ichiro
    • Journal Title

      International Symposium on Formal Methods

      Volume: 14934 Pages: 286-304

    • DOI

      10.1007/978-3-031-71177-0_18

    • ISBN
      9783031711763, 9783031711770
    • Related Report
      2024 Annual Research Report
    • Peer Reviewed
  • [Journal Article] LeGEND: A Top-Down Approach to Scenario Generation of Autonomous Driving Systems Assisted by Large Language Models2024

    • Author(s)
      Tang Shuncheng、Zhang Zhenya、Zhou Jixiang、Lei Lei、Zhou Yuan、Xue Yinxing
    • Journal Title

      Proceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering

      Volume: N/A Pages: 1497-1508

    • DOI

      10.1145/3691620.3695520

    • Related Report
      2024 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Impact of V2V Communication on Robustness of Autonomous Driving Systems2024

    • Author(s)
      Li Lejin、Zhang Xiao-Yi、Tang Shuncheng、Zhang Zhenya、Zhao Jianjun
    • Journal Title

      2024 IEEE 35th International Symposium on Software Reliability Engineering Workshops

      Volume: N/A Pages: 151-154

    • DOI

      10.1109/issrew63542.2024.00073

    • Related Report
      2024 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] SpectAcle: Fault Localisation of AI-Enabled CPS by Exploiting Sequences of DNN Controller Inferences2024

    • Author(s)
      Lyu Deyun、Zhang Zhenya、Arcaini Paolo、Zhang Xiao-Yi、Ishikawa Fuyuki、Zhao Jianjun
    • Journal Title

      ACM Transactions on Software Engineering and Methodology

      Volume: - Issue: 4 Pages: 1-35

    • DOI

      10.1145/3705307

    • Related Report
      2024 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] On the effectiveness of graph data augmentation for source code learning2024

    • Author(s)
      Dong Zeming、Hu Qiang、Zhang Zhenya、Zhao Jianjun
    • Journal Title

      Knowledge-Based Systems

      Volume: 285 Pages: 111328-111328

    • DOI

      10.1016/j.knosys.2023.111328

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Search-Based Repair of DNN Controllers of AI-Enabled Cyber-Physical Systems Guided by System-Level Specifications2024

    • Author(s)
      Lyu Deyun、 Zhang Zhenya、Arcaini Paolo、 Ishikawa Fuyuki、Laurent Thomas、Zhao Jianjun
    • Journal Title

      The Genetic and Evolutionary Computation Conference (GECCO 2024)

      Volume: -

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Optimization-Based Model Checking for Complex STL Specifications2024

    • Author(s)
      Sato Sota、An Jie、Zhang Zhenya、Hasuo Ichiro
    • Journal Title

      36th International Conference on Computer-Aided Verification. (CAV 2024)

      Volume: -

    • Related Report
      2023 Research-status Report
    • Peer Reviewed
  • [Journal Article] TUMB at the SBFT 2024 Tool Competition - CPS-UAV Test Case Generation Track2024

    • Author(s)
      Tang Shuncheng、Zhang Zhenya、Cetinkaya Ahmet、Arcaini Paolo
    • Journal Title

      The 17th International Workshop on Search-Based and Fuzz Testing

      Volume: -

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] ARCH-COMP23 Category Report: Falsification2023

    • Author(s)
      Menghi Claudio、Arcaini Paolo、Baptista Walstan、Ernst Gidon、Fainekos Georgios、Formica Federico、Gon Sauvik、Khandait Tanmay、Kundu Atanu、Pedrielli Giulia、Peltom?ki Jarkko、Porres Ivan、Ray Rajarshi、Waga Masaki、Zhang Zhenya
    • Journal Title

      EPiC Series in Computing

      Volume: 96 Pages: 151-169

    • DOI

      10.29007/6nqs

    • Related Report
      2023 Research-status Report
    • Open Access / Int'l Joint Research
  • [Journal Article] Online Causation Monitoring of Signal Temporal Logic2023

    • Author(s)
      Zhang Zhenya、An Jie、Arcaini Paolo、Hasuo Ichiro
    • Journal Title

      35th International Conference on Computer-Aided Verification. (CAV 2023)

      Volume: 13964 Pages: 62-84

    • DOI

      10.1007/978-3-031-37706-8_4

    • ISBN
      9783031377051, 9783031377068
    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] TAT: Targeted backdoor attacks against visual object tracking2023

    • Author(s)
      Cheng Ziyi、Wu Baoyuan、Zhang Zhenya、Zhao Jianjun
    • Journal Title

      Pattern Recognition

      Volume: 142 Pages: 109629-109629

    • DOI

      10.1016/j.patcog.2023.109629

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] EvoScenario: Integrating Road Structures into Critical Scenario Generation for Autonomous Driving System Testing2023

    • Author(s)
      Tang Shuncheng、Zhang Zhenya、Zhou Jixiang、Zhou Yuan、Li Yan-Fu、Xue Yinxing
    • Journal Title

      2023 IEEE 34th International Symposium on Software Reliability Engineering (ISSRE)

      Volume: - Pages: 309-320

    • DOI

      10.1109/issre59848.2023.00054

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Presentation] Adaptive Branch-and-Bound Tree Exploration for Neural Network Verification2025

    • Author(s)
      Fukuda Kota
    • Organizer
      Design, Automation and Test in Europe Conference
    • Related Report
      2024 Annual Research Report
    • Int'l Joint Research
  • [Presentation] CauMon: An Informative Online Monitor for Signal Temporal Logic2024

    • Author(s)
      Zhang Zhenya
    • Organizer
      International Symposium on Formal Methods
    • Related Report
      2024 Annual Research Report
    • Int'l Joint Research
  • [Presentation] LeGEND: A Top-Down Approach to Scenario Generation of Autonomous Driving Systems Assisted by Large Language Models2024

    • Author(s)
      Tang Shuncheng
    • Organizer
      39th IEEE/ACM International Conference on Automated Software Engineering
    • Related Report
      2024 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Impact of V2V Communication on Robustness of Autonomous Driving Systems2024

    • Author(s)
      Li Lejin
    • Organizer
      International Workshop on Advanced Intelligent Software Applications
    • Related Report
      2024 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Search-Based Repair of DNN Controllers of AI-Enabled Cyber-Physical Systems Guided by System-Level Specifications2024

    • Author(s)
      Lyu Deyun
    • Organizer
      日本ソフトウェア科学会第41回大会
    • Related Report
      2024 Annual Research Report
    • Invited
  • [Presentation] Search-Based Repair of DNN Controllers of AI-Enabled Cyber-Physical Systems Guided by System-Level Specifications2024

    • Author(s)
      Deyun Lyu
    • Organizer
      The Genetic and Evolutionary Computation Conference (GECCO 2024)
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] Optimization-Based Model Checking for Complex STL Specifications2024

    • Author(s)
      Sota Sato
    • Organizer
      36th International Conference on Computer-Aided Verification. (CAV 2024)
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] TUMB at the SBFT 2024 Tool Competition - CPS-UAV Test Case Generation Track2024

    • Author(s)
      Paolo Arcaini
    • Organizer
      The 17th International Workshop on Search-Based and Fuzz Testing
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] Online Causation Monitoring of Signal Temporal Logic2023

    • Author(s)
      Zhenya Zhang
    • Organizer
      35th International Conference on Computer-Aided Verification. (CAV 2023)
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] EvoScenario: Integrating Road Structures into Critical Scenario Generation for Autonomous Driving System Testing2023

    • Author(s)
      Shuncheng Tang
    • Organizer
      2023 IEEE 34th International Symposium on Software Reliability Engineering (ISSRE)
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] Online Causation Monitoring of Signal Temporal Logic2023

    • Author(s)
      Jie An
    • Organizer
      日本ソフトウェア科学会第40回大会
    • Related Report
      2023 Research-status Report
  • [Presentation] Falsification of AI-Enabled Hybrid Systems2023

    • Author(s)
      Zhenya Zhang
    • Organizer
      Shonan meeting No. 204 DevOps for CPS
    • Related Report
      2023 Research-status Report
    • Invited

URL: 

Published: 2023-04-13   Modified: 2026-01-16  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi