• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Surrogate Model-based Integration Testing of CPS with Complex Black Box Components

Research Project

Project/Area Number 20K23334
Research Category

Grant-in-Aid for Research Activity Start-up

Allocation TypeMulti-year Fund
Review Section 1001:Information science, computer engineering, and related fields
Research InstitutionNational Institute of Informatics

Principal Investigator

KLIKOVITS Stefan  国立情報学研究所, アーキテクチャ科学研究系, 特任研究員 (10875983)

Project Period (FY) 2020-09-11 – 2023-03-31
Project Status Discontinued (Fiscal Year 2022)
Budget Amount *help
¥2,860,000 (Direct Cost: ¥2,200,000、Indirect Cost: ¥660,000)
Fiscal Year 2021: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2020: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
KeywordsAutomated driving / Search-based testing / Genetic algorithms / noisy systems / scenario generation / Automated Driving / Search-Based Testing / Genetic Algorithms / Noisy Systems / Scenario Generation / verification / cyber-physical systems / modeling / testing
Outline of Research at the Start

The use of "black-box" components (e.g. AI modules) adds new, unprecedented difficulties to the verification of cyber-physical systems (CPSs). Nonetheless, their use in modern applications such as autonomous vehicles demands rigorous system testing and verification. Existing verification techniques do not scale well and rather focus on verifying individual components in isolation. This project describes aims to develop an efficient approach to lifting existing verification methods to the integration level and thereby coming one step closer to CPS verification at the full system level.

Outline of Annual Research Achievements

In the course of the project, I primarily investigated scenario generation for ADS. Specifically, I identified a major issue with noisy/non-deterministic simulators such as Autonomoose. To overcome, I developped kNN-Averaging, a search-based algorithm that improves current scenario heuristics.
Furthermore, I investigated the complexity of scenario generation and managed to proposed a hierarchical scenario definition framework, formalising the this complexity.
Next, together with colleagues, we participated in two editions of the SBST CPS challenge, where we developed and submitted Frenetic, one of the top-performing competitors.
We are in preparation of a empirical study of scenario/road diversity and its impact on ADS behaviour diversity.

Report

(3 results)
  • 2022 Annual Research Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • Research Products

    (6 results)

All 2021 Other

All Int'l Joint Research (3 results) Presentation (3 results)

  • [Int'l Joint Research] University of Waterloo(カナダ)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] University of Waterloo(カナダ)

    • Related Report
      2021 Research-status Report
  • [Int'l Joint Research] University of Waterloo(カナダ)

    • Related Report
      2020 Research-status Report
  • [Presentation] Handling Noise in Search-Based Scenario Generation for Autonomous Driving Systems2021

    • Author(s)
      Stefan Klikovits
    • Organizer
      26th IEEE Pacific Rim International Symposium on Dependable Computing (PRDC 2021).
    • Related Report
      2021 Research-status Report
  • [Presentation] On the Need for Multi-Level ADS Scenarios.2021

    • Author(s)
      Stefan Klikovits
    • Organizer
      3rd International Workshop on Multi-Paradigm Modelling for Cyber-Physical Systems (MPM4CPS'21)
    • Related Report
      2021 Research-status Report
  • [Presentation] KNN-Averaging for Noisy Multi-objective Optimisation.2021

    • Author(s)
      Stefan Klikovits
    • Organizer
      Quality of Information and Communications Technology. QUATIC 2021
    • Related Report
      2021 Research-status Report

URL: 

Published: 2020-09-29   Modified: 2023-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi