Action 2017.4 on validation and conformity testing

The aims of the action are to

  • coordinate the maintenance of the existing framework, ATS and ETS and the development of the missing ATS and ETS, including coordination of funding and release planning and clear communication of changes between releases,
  • discuss how the maturity level concept can be reflected in the common validator,
  • coordinate the funding of the maintenance and further developments,
  • promote the usage of the validator in the MS,
  • advise the EC on different scenarios for the long-term sustainability of the test framework

For the managing feedback on the common validator, ATS and ETS, the following governance framework is proposed:

  • All issues should be submitted via a common helpdesk, ideally as part of the INSPIRE Knowledge Base.
  • An initial assessment and classification (triage) will be carried out by JRC, potentially supported by contractors
  • Minor issues/bugs will be fixed directly.
  • Notable issues will be discussed in a MIG sub-group on validation (see organisational set-up below) and either fixed directly or submitted to MIG.
  • Any changes with major impacts on the validator, or impacting on the TGs, will be discussed with the MIG.

The full action mandate is attached: 2017.4_Validation_and_conformity_testing_Action_mandate_endorsed.pdf

Meetings

Upcoming web meetings

  • 19 July, 15:00-16:30 CEST

Usage and deployment of the ETF validator

On this wiki page we are tracking where the ETF software is currently being used. Please update the information regularly.

Background & context

As INSPIRE is coming into a practical implementation phase there is a great need of tools for validation of INSPIRE metadata, network services and data. To meet this need and to overcome issues with different interpretations in existing validator implementations at EU level, in MS or projects (e.g. in the EU geoportal, the Netherlands, Germany and the eENVplus project), common Abstract and Executable Test Suites (ATS and ETS) and a common validator (the INSPIRE test framework) have been developed under action MIWP-5/2016.3 of the MIWP 2014-2016.
The work under this action resulted in the following ATS and ETS for the following TGs:

  • Metadata (v1.3) (ATS, ETS)
  • Download services (Atom, WFS) (ATS , ETS)
  • View services (ATS)
  • Discovery Services (ATS)
  • Data specifications (common requirements and theme-specific requirements for Annex I themes) (ATS, ETS)
  • Spatial data services (ATS)

In order to provide a complete test framework, the following components would still need to be added to the INSPIRE validator:

  • Metadata v2.0 (ATS and ETS)
  • Annex II data specifications (ATS, ETS)
  • Annex III data specifications (ATS, ETS)
  • View Services, WMS (ETS)
  • View Services, WMTS (ETS)
  • Download Services, SOS (ATS, ETS)
  • Download Services, WCS (ATS, ETS)
  • Discovery Services (ETS)

Some budget is foreseen in the 2017 work programme of the ELISE ISA2 action for further developments on the validator. However, this will likely have to be complemented with additional contributions from Member States (either through funding or experts) and/or the Commission. It should be discussed how to coordinate the further development and its funding between all parties interested to contribute.

Furthermore, with increasing use, it is expected that there will also be an increasing number of change proposals and bug reports for the software and the implemented tests. These may also affect the underlying Abstract Test Suites or even lead to change proposals to the requirements in the TGs.

Finally, also the discussions around the maturity level concept in action 2016.1 may have an impact on the structure, implementation and/or presentation of the tests in the common validator.

Organisational set-up

This action will be carried out by JRC, with support from

  • external contractors (and potentially MS experts) for the development and maintenance of the test framework, ATS and ETS, and
  • a temporary MIG sub-group including MIG representatives and experts from the pool of experts (see members here), that will
    • support the resolution of notable comments received on the validator, ETS and ATS and, where relevant, the formulation of change requests to TGs and/or IRs,
    • discuss and provide recommendations of how the maturity level concept can be reflected in the common validator,
    • promote the usage of the validator in the MS (see a list of known instances in the MS here),
    • advise the EC on different scenarios for the long-term sustainability of the test framework.

2017.4_Validation_and_conformity_testing_Action_mandate_endorsed.pdf (527 KB) Michael Lutz, 15 Dec 2017 10:02 am