INSPIRE testing framework - Requirements

ID Target

Component

(cross-cutting, data set,

network service, metadata, SDS)

Requirement Proposed by
FW-1  Testing framework cross-cutting

The testing framework should (at least) accept single requests to test the conformity of

  • a metadata record
  • a network service endpoint
  • a data set
  • a spatial data service endpoint
JRC
FW-2 Testing framework cross-cutting

The framework should be based on a generic test engine that can process executable tests specified in an ETS language/format

JRC
EN-1 Test engine cross-cutting The test engine should be open source JRC
LA-1 Test language cross-cutting ETS language/format should be open source JRC
FW-3 Testing framework cross-cutting

It should be possible to update or add rules without needing to recompile, rebuild or redeploy the test engine

JRC
LA-2 Test language cross-cutting

The ETS language/format should allow easy modification of rules and documentation of a version history

JRC
FW-4 Testing framework data set

The framework should support the testing of large data sets (e.g. orthoimagery)

JRC
RU-1 Rules cross-cutting

It should be possible to select / define modules at individual rule level

JRC
RU-2 Rules cross-cutting It should be possible to test against specific versions of the rule JRC
RU-3 Rules data set, network service (?) It should be possible to validate against specific schema versions (this may require parameterisable rules) JRC
RU-4 Rules cross-cutting It should be possible to indicate the severity or weight of individual rules JRC
RU-5 Rules cross-cutting ETS rules should have links to the ATS rules they implement and requirements they test JRC
EN-2 Test engine cross-cutting

It should be possible to interact with the test engine through a GUI and through an API

JRC
EN-3 Test engine cross-cutting

The test engine shall return a detailed test report in human-readable (e.g. HTML) and machine-readable (e.g. XML, JSON, …) formats

JRC
  Testing framework cross-cutting The testing framework should allow a user or a machine to test INSPIRE ressources (metadata, services, data sets) against recent implementing rules and technical guidance documents. The testing framework includes a test engine that is able to process executable tests specified in an ETS. The ETS are based on ATS endorsed by MIG and NCPs. Daniela
  Testing framework cross-cutting It should be possible to combine different tests into a chain to support interoperability testing. See #2448 for possible scenarios. Daniela
  Testing framwork cross-cutting The user should be able to configure and run individual tests (see RU-1, RU-2, ...), receive notifications for completing the executed tests and receive the validation results. He should be able to find results of previously executed tests and re-run the tests. Daniela