SS07 - Evaluation Methods for Autonomous Cyber-Physical Systems’ Behavior

Special Session Organized by

Luis Alberto Cruiz Salazar, Universidad Antonio Nariño, Cartagena, Colombia, Felix Gehlhoff, Helmut Schmidt University Hamburg, Germany, Christoph Legat, Technical University of Applied Sciences, Augsburg, Germany, Artan Markaj, Helmut Schmidt University Hamburg, Germany, Mehmet Mercangöz, Imperial College London, United Kingdom, and André Scholz, Siemens AG, Germany.

Download Call for Papers

Click here to download the special session cfp.

Focus

Global competition, shorter product life cycles, and volatile markets are straining manufacturing, logistics, and energy operations. Workforce shortages further threaten the production of essential goods and system operations. To address this, increasing autonomy in cyber-physical systems (CPS) is key. Autonomous CPS make decisions without human intervention, systematically execute processes, adapt to environmental changes, and self-govern resources. However, their behavior is often complex and unpredictable, making evaluation crucial. This includes testing, verification,diagnostics, and performance analysis using data-driven (e.g., Generative AI), knowledge-driven, and simulation-based methods. Potential use cases range from simulation-based goal selection to explaining CPS actions to operators.

Topics under this session include:

  • Simulation-based evaluation of autonomous CPS’ behaviour
  • Verification of system goals and requirements
  • Testing intelligent control algorithms (MAS, reinforcement learning or model-predictive control) for autonomous CPS
  • Data-driven methods for autonomous CPS’ identification and adaption
  • Real-time diagnosis and decision making in autonomous CPS’ operation
  • Integration of Explainable AI (XAI) for enhanced autonomous CPS’ transparency
  • Real-time decision support approaches for autonomous CPS’ supervision
  • Evaluation methodologies for autonomous CPS leveraging Digital Twins and Asset Ad-ministration Shells (AAS)
  • Evaluation of human-autonomy interaction in remote and autonomous operation
  • (Real-time) Safety and regulatory compliance evaluation of autonomous CPS
  • Performance, metrics and test-beds for the evaluation of autonomous CPS
  • Evaluation of degrees of autonomy in autonomous CPS
  • Standards for quality and conformity assessment of autonomous CPS' behaviour