This is the JuliaReach repeatability evaluation (RE) package for the ARCH-COMP 2024 category report: Artificial intelligence and neural network control systems (AINNCS) for continuous and hybrid systems plants of the 8th International Competition on Verifying Continuous and Hybrid Systems (ARCH-COMP '24).
Note: Running the full benchmark suite should take no more than two hours with a reasonable internet connection.
There are two ways to install and run this RE: either using the Julia script or using the Docker script. In both cases, first clone this repository.
Using the Julia script. First install the Julia compiler following the instructions here. Once you have installed Julia, execute
$ julia startup.jlto run all the benchmarks.
Using the Docker container.
To build the container, you need the program docker.
For installation instructions on different platforms, consult
the Docker documentation.
For general information about Docker, see
this guide.
Once you have installed Docker, start the submit.sh script:
$ ./submit.shThe Docker container can also be run interactively:
$ docker run -it juliareach bash
$ julia
julia> include("startup.jl")The results will be stored in the folder result.
julia> ]
(@v1.10) pkg> activate .
Activating new environment at `.../ARCH2024_AINNCS/Project.toml`
pkg> add ClosedLoopReachability
pkg> add LinearAlgebra
pkg> add MAT
pkg> add OrdinaryDiffEq
pkg> add Plots
pkg> add ReachabilityBase
pkg> add YAML