Workshop on validation of metadata and network services

2-3 December 2014, Ispra (Italy)
Building 26a, Michelangelo meeting room

DRAFT Agenda

Tuesday, 2 December 2014

09:00 - 09:15 Welcome & round-table (Michael Lutz, Freddy Fierens, all)

09:15 - 09:30 Introduction and Scope of the workshop (Ilkka Rinne)

09:30 - 09:45 MIWP-5 overview (Carlo Cipolloni)

09:45 - 10:15 Agreeing on the syntax of ATS rules for INSPIRE Metadata & Network Service requirements based on proposals by Sven Böhme

10:15 - 10:30 COFFEE BREAK

10:30 - 12:30 Analysis and discussion of TG requirements and tests for metadata (Ilkka Rinne, all)

12:30 - 13:30 LUNCH

13:30 - 14:30 Analysis and discussion of TG requirements and tests for WMS View Services (Ilkka Rinne, all)

14:30 - 14:45 COFFEE BREAK

14:45 - 15:45 Analysis and discussion of TG requirements and tests for WMS View Services (Ilkka Rinne, all)

15:45 - 16:00 BREAK

16:00 - 17:30 Analysis and discussion of TG requirements and tests for WMS View Services (Ilkka Rinne, all)

20:00 SOCIAL DINNER

Wednesday, 3 December 2014

09:00 - 09:30 Quick review and thoughts on the day 1 (metadata / WMS) (Ilkka Rinne, all)

09:30 - 10:30 Analysis and discussion of TG requirements and tests for Atom Download Services (Ilkka Rinne, all)

10:30 - 10:45 COFFEE BREAK

10:45 - 12:30 Analysis and discussion of TG requirements and tests for Atom Download Services (Ilkka Rinne, all)

12:30 - 13:30 LUNCH

13:30 - 15:00 Review and categorisation of the identified problematic requirements (metadata, WMS, Atom) (Ilkka Rinne, all)

15:00 - 15:30 COFFEE BREAK

15:30 - 16:30 Wrap-up workshop and next steps (Ilkka Rinne, all)

DRAFT Minutes

Preface

The workshop was held as planned in JRC/Ispra on 2nd and 3rd December 2014.

The following people were present:

  • Thijs Brentjens (by teleconference)
  • Sven Böhme,
  • Carlo Cipolloni,
  • Freddy Fierens,
  • Sebastian Goerke,
  • Michael Lutz,
  • Angelo Quaglia,
  • Ilkka Rinne (facilitator),
  • Antonio Rotundo (Tuesday only),
  • Marcus Sen,
  • Etienne Taffoureau (up-to lunch on Wednesday),
  • Paul Van Genuchten,

The minutes are based on the notes taken by the scribes by Ilkka Rinne. The notes for going through the TG Requirements form the majority of the minute contents. These notes are written in the separate documents linked from the notes below.

Tuesday: the meeting started at 9:15.

1. Welcome & round-table

The meeting attendants presented themselves.

2. Introduction and Scope of the workshop

Ilkka Rinne presented the some of the essential terms for conformance testing and the scope of the workshop.

Presentation: https://ies-svn.jrc.ec.europa.eu/attachments/download/800/rinne-workshop-scope.pdf

3. MIWP-5 overview

Carlo Cipolloni presented an overview of the MIWP-5 and it's relations to other MIG work packages.

Presentation: https://ies-svn.jrc.ec.europa.eu/attachments/download/803/MIWP5_EXWS_dec14.pdf

Syntax of ATS rules for INSPIRE Metadata & Network Service requirements

Sven Böhme presented a discussion paper for choosing the ATS syntax. Angelo Quaglia also presented a more formal domain specific language for writing the Abstract Tests. It was decided that the members should try to write a few ATs and after that we would make the final decision on the syntax to use.

Paul Van Genuchten noted that it's not always clear to which TG or conformance class a test should belong to. This is especially true for requirements which handle the use of metadata elements within the View or Download Service Guidance documents. It would be better to make a separation between the integration tests testing the functionality of the SDI (interoperability between several linked services) and the test which can be tested in isolation within one service.

Presentation: https://ies-svn.jrc.ec.europa.eu/attachments/download/802/MIWP5_Workshop_Writing_ATS.pdf (Sven Böhme)

Analysis and discussion of TG requirements and tests for metadata

The group discussed about tests for Requirements 1-3 in the TG Metadata document. The detailed notes are available at https://github.com/inspire-eu-validation/ats-metadata/blob/master/dec-workshop-notes.md

As a general issue it was noted that the TG Metadata document does not currently contain an explicit requirement to use the ISO 19139 XML Schema for the metadata records. Also it was noted that the elements and their required multiplicities mentioned in the tables are not formatted as requirements. These issues should be fixed in the TG document.

Lunch break (12:30 - 13:30)

Analysis and discussion of TG requirements and tests for metadata (continued)

The group discussed about tests for Requirements 4-7 in the TG Metadata document. The detailed notes are available at https://github.com/inspire-eu-validation/ats-metadata/blob/master/dec-workshop-notes.md

Analysis and discussion of TG requirements and tests for WMS

The group discussed about tests for WMS-specific Requirements 1-17 in the TG View Services document. The detailed notes are available at https://github.com/inspire-eu-validation/ats-view-wms/blob/master/dec-workshop-notes.md

General remarks:

  • For requirements for ISO 19128 conformance, the ATS should refer to the tests defined by the OGC for WMS 1.3.0
  • There is no conformance profile for WMS 1.1.1 even though it is mentioned as an option the implementing an INSPIRE View Service. This should be added to the TG or it should not be mentioned at all in the TG document.
  • The current presentation of the two scenarios for giving the mandatory INSPIRE metadata element values (inline or by reference to the external metadata document) is confusing: It's not clear which of the requirements apply to which scenarios. The requirements considering these elements should be clearly organised in two alternative general requirements each referring explicitly to the sub-requirements that need to be fulfilled in these scenarios.
  • It's not clear how the services containing a mix of INSPIRE and non-INSPIRE layers should be presented.

End of the discussions for day 1 (17:30)

Wednesday

Overview of the results of the day 1

Ilkka presented a quick overview of the work done on Tuesday.

Analysis and discussion of TG requirements and tests for metadata (continued)

The group discussed about tests for Requirements 16-18 in the TG Metadata document. The detailed notes are available at https://github.com/inspire-eu-validation/ats-metadata/blob/master/dec-workshop-notes.md

General remarks:

  • It would be better to require to use resolvable URL/URIs for referring to a specific thesauri for keywords. The plain name "GEMET" for example is not resolvable by itself.
  • It would be very useful to have an explicit mapping table between the IR paragraphs and the TG Requirements.
  • Some of the Requirements cannot be automatically tested. An example would be a requirement to include a reference to a controlled vocabulary if the used keyword originates from one: Only the data provider can know if a keyword has been used in the sense defined by a specific controlled vocabulary. These tests should still be included in the ATS but they should be separated by automatically executable tests.

Lunch break (12:50 - 14:00)

The goals, expert contracts and the dead-lines for finishing the work

Freddy Fierens gave an update about the expert contracts for the group member's work. Due to the administrative delays the contract were not ready yet. The total work amount are still as listed in the original tender documents (11 working days per expert).

The TG for Discovery Service had not been included in the work programme of the group. It was decided that it's was requirements are within the scope of the work, but they have lower priority than the Metadata, View and Download Service TGs.

It was decided that the deadline for finishing the work is the 15th of February 2015.

Syntax of ATS rules for INSPIRE Metadata & Network Service requirements (continued)

It was decided that the abstract tests should follow the OGC / INSPIRE Data Specification general syntax:

  • Unique test identification
  • Test purpose
  • Test method
  • Reference(s)
  • Test type

It was agreed that the Test type will be used for indicating whether the test can be run automatically or if it needs information from the data provider (manual). The References should point both to the TG Requirements and to the IR text if applicable.

Analysis and discussion of TG requirements and tests for Atom Download Services

The group discussed about tests for Atom-specific Requirements 1-26 in the TG Download Services document. The detailed notes are available at https://github.com/inspire-eu-validation/ats-download-atom/blob/master/dec-workshop-notes.md

Task assignment and next steps

  • It was decided that Github (https://github.com) would be used as the version control and issue management platform for the ATS drafting work.
  • Ilkka Rinne will create the Github repositories and invite the group members to contribute.
  • The license for the abstract tests will be Creative Commons CC0 (Public Domain)
  • Ilkka Rinne will setup a Doodle poll for the status meeting to be held during week 51
  • Based on the current phase of the INSPIRE Geoportal the relative priorities of the ATSes for the different guidance documents were decided to be as follows:
    • 1. Download Services,
    • 2. Metadata,
    • 3. View Services
    • 4. Discovery Services (if time allows)
  • The initial assignment of drafting the ATS texts:
    • Marcus Sen, Michael Schultz and Thijs Brentjens: the Download Services
    • Paul Van Genuchten and Etienne Taffoureau: the Metadata
    • Sven Böhme and Ilkka Rinne: the View Services

End of the day 2 (16:30)

MIWP5_EXWS_dec14.pdf - MIWP-5 overview (2.73 MB) Carlo Cipolloni, 02 Dec 2014 09:59 am