• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Fine-Grained Monitoring of Signal Temporal Logic and Its Applications in Quality Assurance of Cyber Physical Systems

Research Project

Project/Area Number 23K16865
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 60050:Software-related
Research InstitutionKyushu University

Principal Investigator

張 振亜  九州大学, システム情報科学研究院, 助教 (10971228)

Project Period (FY) 2023-04-01 – 2025-03-31
Project Status Granted (Fiscal Year 2023)
Budget Amount *help
¥3,250,000 (Direct Cost: ¥2,500,000、Indirect Cost: ¥750,000)
Fiscal Year 2024: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2023: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
KeywordsMonitoring / Signal Temporal Logic / Cyber-physical systems / Formal methods / Testing / Cyber Physical Systems / Runtime verification / Quality assurance
Outline of Research at the Start

Cyber-Physical Systems are safety-critical and their quality assurance is important. First, we refine the semantics of Signal Temporal Logic such that it delivers more information about system evolution. Moreover, we apply the refined semantics to develop more effective quality assurance techniques.

Outline of Annual Research Achievements

The project is going smoothly with a number of scientific research outcomes. There are 8 research papers published or accepted, and there are also a number of papers under submission to international conferences or journals.
First, we published a work in CAV’23 (CORE A*, top-most conference), in which we propose causation monitoring, that can report more information about system evolution than existing monitors. This work builds the theoretical foundation of this project, namely, fine-grained monitoring of Signal Temporal Logic that aims to deliver more information. Based on this work, we do several related applications of signal monitoring, including testing of autonomous driving systems (ISSRE’23, CORE A), object tracking (PR’23, CORE A*), repair of DNN controllers (GECCO’24, CORE A), model checking with complex STL specifications (CAV’24 CORE A*), testing of unmanned aerial vehicles (SBFT’24) etc.
Our ongoing works involve several applications of our fine-grained monitoring technique in different directions. One line is the fault localization and repair of AI-enabled CPS, which requires our causation monitor to provide useful information. Another line is the use of our new semantics in optimal control synthesis, and specifically, we are exploring its application in reinforcement learning for CPS.
We continue our contribution to the ARCH friendly competition, and we co-author the report of falsification tool competition published in ARCH’24.

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

The project is going smoothly with a number of scientific research outcomes. We have papers accepted or published in top international conferences or journals, including conferences such as CAV (CORE A*), ISSRE (CORE A), GECCO (CORE A).
By these research outcomes, we have established the theoretical foundation of our project, and now we are moving to the applications of our novel monitoring techniques and STL semantics. Moreover, recently we also come up with an implementation of our causation monitor that is much more efficient than the direct implementation from definition, which allows the application of our causation semantics.
Some of our ongoing works have got preliminary or complete results and are under submission. For instance, our fault localization work extends the classic spectrum-based fault localization in traditional software analysis by leveraging the information provided by our monitoring techniques. We believe these research outcomes will be recognized by the research community.
We also actively participated competitions in community. Notably, we participated in the SBFT'24 tool competition, UAV testing track. Our tool named TUMB wins the 2nd rank among 8 participants, which signifies the effectiveness of our approach.

Strategy for Future Research Activity

Our ongoing works involve several applications of our fine-grained monitoring technique in different directions.
One line is the fault localization and repair of AI-enabled CPS, which requires our causation monitor to provide useful information. In this research, we extend the spectrum-based fault localization framework to CPS, and our monitoring technique helps in diagnosing faulty intervals during system execution. With this information, we can reduce the potentially suspicious space of fault localization significantly, thereby improving the precision of fault localization.
With results from fault localization, we can perform repair to CPS components. Our preliminary research has been accepted by GECCO'24 (CORE A). We plan to extend this research to explore more effective repair approaches.
Another line is the use of our new semantics in optimal control synthesis, and specifically, we are exploring its application in reinforcement learning for CPS. Preliminary experiments have shown the superiority of our causation semantics over the classic robust semantics of STL in characterizing the states of execution traces. By this, we can devise better reward functions to assist reinforcement learning for optimal control policies.

Report

(1 results)
  • 2023 Research-status Report
  • Research Products

    (15 results)

All 2024 2023

All Journal Article (8 results) (of which Int'l Joint Research: 6 results,  Open Access: 4 results,  Peer Reviewed: 7 results) Presentation (7 results) (of which Int'l Joint Research: 5 results,  Invited: 1 results)

  • [Journal Article] On the effectiveness of graph data augmentation for source code learning2024

    • Author(s)
      Dong Zeming、Hu Qiang、Zhang Zhenya、Zhao Jianjun
    • Journal Title

      Knowledge-Based Systems

      Volume: 285 Pages: 111328-111328

    • DOI

      10.1016/j.knosys.2023.111328

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Search-Based Repair of DNN Controllers of AI-Enabled Cyber-Physical Systems Guided by System-Level Specifications2024

    • Author(s)
      Lyu Deyun、 Zhang Zhenya、Arcaini Paolo、 Ishikawa Fuyuki、Laurent Thomas、Zhao Jianjun
    • Journal Title

      The Genetic and Evolutionary Computation Conference (GECCO 2024)

      Volume: -

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Optimization-Based Model Checking for Complex STL Specifications2024

    • Author(s)
      Sato Sota、An Jie、Zhang Zhenya、Hasuo Ichiro
    • Journal Title

      36th International Conference on Computer-Aided Verification. (CAV 2024)

      Volume: -

    • Related Report
      2023 Research-status Report
    • Peer Reviewed
  • [Journal Article] TUMB at the SBFT 2024 Tool Competition - CPS-UAV Test Case Generation Track2024

    • Author(s)
      Tang Shuncheng、Zhang Zhenya、Cetinkaya Ahmet、Arcaini Paolo
    • Journal Title

      The 17th International Workshop on Search-Based and Fuzz Testing

      Volume: -

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] ARCH-COMP23 Category Report: Falsification2023

    • Author(s)
      Menghi Claudio、Arcaini Paolo、Baptista Walstan、Ernst Gidon、Fainekos Georgios、Formica Federico、Gon Sauvik、Khandait Tanmay、Kundu Atanu、Pedrielli Giulia、Peltom?ki Jarkko、Porres Ivan、Ray Rajarshi、Waga Masaki、Zhang Zhenya
    • Journal Title

      EPiC Series in Computing

      Volume: 96 Pages: 151-169

    • DOI

      10.29007/6nqs

    • Related Report
      2023 Research-status Report
    • Open Access / Int'l Joint Research
  • [Journal Article] Online Causation Monitoring of Signal Temporal Logic2023

    • Author(s)
      Zhang Zhenya、An Jie、Arcaini Paolo、Hasuo Ichiro
    • Journal Title

      35th International Conference on Computer-Aided Verification. (CAV 2023)

      Volume: 13964 Pages: 62-84

    • DOI

      10.1007/978-3-031-37706-8_4

    • ISBN
      9783031377051, 9783031377068
    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] TAT: Targeted backdoor attacks against visual object tracking2023

    • Author(s)
      Cheng Ziyi、Wu Baoyuan、Zhang Zhenya、Zhao Jianjun
    • Journal Title

      Pattern Recognition

      Volume: 142 Pages: 109629-109629

    • DOI

      10.1016/j.patcog.2023.109629

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] EvoScenario: Integrating Road Structures into Critical Scenario Generation for Autonomous Driving System Testing2023

    • Author(s)
      Tang Shuncheng、Zhang Zhenya、Zhou Jixiang、Zhou Yuan、Li Yan-Fu、Xue Yinxing
    • Journal Title

      2023 IEEE 34th International Symposium on Software Reliability Engineering (ISSRE)

      Volume: - Pages: 309-320

    • DOI

      10.1109/issre59848.2023.00054

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Presentation] Search-Based Repair of DNN Controllers of AI-Enabled Cyber-Physical Systems Guided by System-Level Specifications2024

    • Author(s)
      Deyun Lyu
    • Organizer
      The Genetic and Evolutionary Computation Conference (GECCO 2024)
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] Optimization-Based Model Checking for Complex STL Specifications2024

    • Author(s)
      Sota Sato
    • Organizer
      36th International Conference on Computer-Aided Verification. (CAV 2024)
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] TUMB at the SBFT 2024 Tool Competition - CPS-UAV Test Case Generation Track2024

    • Author(s)
      Paolo Arcaini
    • Organizer
      The 17th International Workshop on Search-Based and Fuzz Testing
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] Online Causation Monitoring of Signal Temporal Logic2023

    • Author(s)
      Zhenya Zhang
    • Organizer
      35th International Conference on Computer-Aided Verification. (CAV 2023)
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] EvoScenario: Integrating Road Structures into Critical Scenario Generation for Autonomous Driving System Testing2023

    • Author(s)
      Shuncheng Tang
    • Organizer
      2023 IEEE 34th International Symposium on Software Reliability Engineering (ISSRE)
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] Online Causation Monitoring of Signal Temporal Logic2023

    • Author(s)
      Jie An
    • Organizer
      日本ソフトウェア科学会第40回大会
    • Related Report
      2023 Research-status Report
  • [Presentation] Falsification of AI-Enabled Hybrid Systems2023

    • Author(s)
      Zhenya Zhang
    • Organizer
      Shonan meeting No. 204 DevOps for CPS
    • Related Report
      2023 Research-status Report
    • Invited

URL: 

Published: 2023-04-13   Modified: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi