Assuring the safety and trustworthiness of autonomous systems is particularly difficult when learning enabled components and open environments are involved. Formal methods provide strong guarantees but depend on complete models and static assumptions. Runtime verification (RV) complements them by monitoring executions at run time and, in its predictive variants, by anticipating potential violations. Large language models (LLMs), meanwhile, excel at translating natural language into formal artefacts and recognising patterns in data, yet they remain error-prone and lack formal guarantees. This vision paper argues for a symbiotic integration of RV and LLMs. RV can serve as a guardrail for LLM-driven autonomy, while LLMs can extend RV by assisting specification capture, supporting anticipatory reasoning, and helping to handle uncertainty. We outline how this mutual reinforcement differs from existing surveys and roadmaps, discuss challenges and certification implications, and identify future research directions towards dependable autonomy.

Watchdogs and Oracles: Runtime Verification Meets Large Language Models for Autonomous Systems / Ferrando, A.. - In: ELECTRONIC PROCEEDINGS IN THEORETICAL COMPUTER SCIENCE. - ISSN 2075-2180. - 436:436(2025), pp. 80-87. (7th International Workshop on Formal Methods for Autonomous Systems, FMAS 2025, was co-located with the 20th International Conference on integrated Formal Methods, iFM 2025 fra 2025) [10.4204/EPTCS.436.8].

Watchdogs and Oracles: Runtime Verification Meets Large Language Models for Autonomous Systems

Ferrando A.
2025

Abstract

Assuring the safety and trustworthiness of autonomous systems is particularly difficult when learning enabled components and open environments are involved. Formal methods provide strong guarantees but depend on complete models and static assumptions. Runtime verification (RV) complements them by monitoring executions at run time and, in its predictive variants, by anticipating potential violations. Large language models (LLMs), meanwhile, excel at translating natural language into formal artefacts and recognising patterns in data, yet they remain error-prone and lack formal guarantees. This vision paper argues for a symbiotic integration of RV and LLMs. RV can serve as a guardrail for LLM-driven autonomy, while LLMs can extend RV by assisting specification capture, supporting anticipatory reasoning, and helping to handle uncertainty. We outline how this mutual reinforcement differs from existing surveys and roadmaps, discuss challenges and certification implications, and identify future research directions towards dependable autonomy.
2025
7th International Workshop on Formal Methods for Autonomous Systems, FMAS 2025, was co-located with the 20th International Conference on integrated Formal Methods, iFM 2025
fra
2025
436
80
87
Ferrando, A.
Watchdogs and Oracles: Runtime Verification Meets Large Language Models for Autonomous Systems / Ferrando, A.. - In: ELECTRONIC PROCEEDINGS IN THEORETICAL COMPUTER SCIENCE. - ISSN 2075-2180. - 436:436(2025), pp. 80-87. (7th International Workshop on Formal Methods for Autonomous Systems, FMAS 2025, was co-located with the 20th International Conference on integrated Formal Methods, iFM 2025 fra 2025) [10.4204/EPTCS.436.8].
File in questo prodotto:
File Dimensione Formato  
unpaywall-bitstream-1439402982.pdf

Open access

Tipologia: VOR - Versione pubblicata dall'editore
Licenza: [IR] creative-commons
Dimensione 116.09 kB
Formato Adobe PDF
116.09 kB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/1413457
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 1
  • OpenAlex ND
social impact