Task #2466

Test the automated calculation of indicators from harvested metadata

Added by Paul Hasenohr about 5 years ago. Updated over 4 years ago.

Status:ClosedStart date:01 Jul 2015
Priority:NormalDue date:
Assignee:Francois Prunayre% Done:

100%

Category:-
Proposed change or action:

Description

Dear colleagues,

As you know, the dashboard has two functionalities:

  1. Display the official monitoring information as charts and maps easily understandable
  2. Compute monitoring variables and indicators (and display them) and generate the INSPIRE monitoring XML file out of the metadata harvested from national nodes (or from the geoportal for MS preferring this option)

Everyone is familiar with the first functionality while fewer people are familiar with the second one. It has been used by (at least) two Member States in order to produce the official monitoring information reported on 15/05/2015. The benefits of such an automated approach are time savings and quality increase.

As every national profile is different, it can happen that the indicators calculated from harvested metadata are not correct because the relevant pieces of information for monitoring are not correctly extracted from the metadata (although they are INSPIRE conformant). I would like to invite any of you who is interested in this automated generation of INSPIRE monitoring indicators to use the summer break to test it and to liaise with your INSPIRE national reporter (the list can be found at http://www.eionet.europa.eu/ldap-roles/?role_id=extranet-inspire-reporter). François, whom you all know as being the developer of the dashboard, is funded by the EEA to work on this until 31 August 2015 (the contract ends on that date therefore this is a hard deadline which cannot be expanded).

A screencast showing how to compute monitoring indicators and variables out of metadata harvested from national node is available at http://inspire-dashboard.eea.europa.eu/ (scroll down to the bottom of the page). Other screencasts on the same page show how to display an INSPIRE monitoring XML file, edit it and print it.

Please try to spend a little bit of this (in theory quiter) time of the year on testing the automated generation of indicators. The catalogues have been harvested mostly on 19/05/2015. To provide feedback, flag issues, request a new harvesting, simply reply to this ticket. As I will be on leave, it is better to reply to this ticket than to write me emails.

Best regards,

Paul

History

#1 Updated by Marc Leobet about 5 years ago

I will be happy to test the automated generation of indicators from the national node. We have developped some home-made tools for our own needs and we could compare the results.

Best regards

Marc Leobet

#2 Updated by Nico Bonora about 5 years ago

Hi Paul!
just for information, Italy generated the xml through the dashboard.
Best regards
Nico

 

Paul Hasenohr ha scritto:

Dear colleagues, As you know, the dashboard has two functionalities: Display the official monitoring information as charts and maps easily understandable Compute monitoring variables and indicators (and display them) and generate the INSPIRE monitoring XML file out of the metadata harvested from national nodes (or from the geoportal for MS preferring this option) Everyone is familiar with the first functionality while fewer people are familiar with the second one. It has been used by (at least) two Member States in order to produce the official monitoring information reported on 15/05/2015. The benefits of such an automated approach are time savings and quality increase. As every national profile is different, it can happen that the indicators calculated from harvested metadata are not correct because the relevant pieces of information for monitoring are not correctly extracted from the metadata (although they are INSPIRE conformant). I would like to invite any of you who is interested in this automated generation of INSPIRE monitoring indicators to use the summer break to test it and to liaise with your INSPIRE national reporter (the list can be found at http://www.eionet.europa.eu/ldap-roles/?role_id=extranet-inspire-reporter). François, whom you all know as being the developer of the dashboard, is funded by the EEA to work on this until 31 August 2015 (the contract ends on that date therefore this is a hard deadline which cannot be expanded). A screencast showing how to compute monitoring indicators and variables out of metadata harvested from national node is available at http://inspire-dashboard.eea.europa.eu/ (scroll down to the bottom of the page). Other screencasts on the same page show how to display an INSPIRE monitoring XML file, edit it and print it. Please try to spend a little bit of this (in theory quiter) time of the year on testing the automated generation of indicators. The catalogues have been harvested mostly on 19/05/2015. To provide feedback, flag issues, request a new harvesting, simply reply to this ticket. As I will be on leave, it is better to reply to this ticket than to write me emails. Best regards, Paul

 

#3 Updated by Daniela Hogrebe about 5 years ago

I would like to test the calculation of indicators through the dashboard and compare the results with our official results. It seems to be a very good opportunity to check the quality of our metadata. Unfortunately, I am only available from 17 to 20 August.

#4 Updated by Kai Koistinen about 5 years ago

I would be happy to be part of the testing group also.

Best regards,

Kai Koistinen

NLS Finland

#5 Updated by Ewa Surma about 5 years ago

I tried to generate indicators through the dashboard but unfortunately those metadata that are located within the CSW services that are federated with our national node were not visible in output xml file - so this is maybe for checking... (although metadata of the CSW services were visible....)

Having this  in mind I can also be a part of a testing group....

Kind regards,

Ewa (PL)

#6 Updated by Marc Leobet about 5 years ago

Bad luck : the video "How to compute monitoring indicators and variables out of metadata harvested from national node." is declared "corrupted" and not fully readable.

#7 Updated by Marc Leobet about 5 years ago

I had the luck to get indicators only selecting my country, and to download them, but I never get something usable under OpenOffice. A .csv could be easier to manage. I just cut and pasted the html page to OoO to be able to work.

I checked them with internal indicators we extracted with our tools the 22.05 for datasets and the 31.05 for services. The various dates could explain some tiny gaps between the two references.

I give under the results, but first some comments :

Up to now we use the method (count a dataset once if having many INSPIRE themes). It could change.

Analysis of the results shows a big gap for counting datasets, conformant datasets, existence of services (FR Nsi2 is 100 % higher). It is not little.

I wonder if the dashboard counts direct services AND download services.

Less important, for SDSv_Num, SDS are not NS. We think they have to be counted separately.

DSv21 Number of conformant spatial data sets for Annex I that have conformant metadata 37 105
DSv23 Number of conformant spatial data sets for Annex II that have conformant metadata 253 34
DSv23Old Number of conformant spatial data sets for Annex III that have conformant metadata 210 376
DSv_Num Number of spatial data sets for all Annexes 15760 17012
DSv_Num1 Number of spatial data sets for Annex I 2179 2575
DSv_Num2 Number of spatial data sets for Annex II 752 1253
DSv_Num3 Number of spatial data sets for Annex III 12829 14927
MDi2 %age of spatial data sets and services with conformant metadata .94 0,98
MDi21 %age of spatial data sets for Annex I with conformant metadata .98 0,86
MDi22 %age of spatial data sets for Annex II with conformant metadata .97 0,85
MDi23 %age of spatial data sets for Annex III with conformant metadata .98 0,91
MDi24 %age of spatial data services with conformant metadata .75 0,92
MDv11 Number of spatial data sets for Annex I that have metadata 2179 2575
MDv12 Number of spatial data sets for Annex II that have metadata 752 1253
MDv13 Number of spatial data sets for Annex III that have metadata 12829 14927
MDv14 Number of spatial data services that have metadata 3282 3358
MDv1_DS Number of spatial data sets that have metadata 15760 17012
MDv21 Number of spatial data sets for Annex I that have conformant metadata 2130 2203
MDv22 Number of spatial data sets for Annex II that have conformant metadata 730 1063
MDv23 Number of spatial data sets for Annex III that have conformant metadata 12627 13639
NSi2 %age of spatial data sets for which a view and download service exists .28 0,57
NSi21 %age of spatial data sets for which a view service exists .36 0,65
NSi22 %age of spatial data sets for which a download service exists .41 0,62
NSi4 %age of conformant services .00 We do not know how to test conformity of services
NSi41 %age of conformant discovery services .00 We do not know how to test conformity of services
NSi42 %age of conformant view services .00 We do not know how to test conformity of services
NSi43 %age of conformant download services .00 We do not know how to test conformity of services
NSi45 %age of conformant invoke services .00 0
NSv11 Number of spatial data sets with metadata for which a discovery service exists (count a dataset as many time as its INSPIRE themes) 15760 We do not count following that way
NSv11Old Number of spatial data sets with metadata for which a discovery service exists (count a dataset once if having many INSPIRE themes) 14183 17012
NSv12 Number of spatial data services with metadata for which a discovery service exists 3282 ?
NSv21 Number of spatial data sets for which a view service exists 5701 11058
NSv23Old Number of spatial data sets for which a view and download service exists 4172 9697
NSv4 Number of all conformant network services 0 We do not know how to test conformity of services
NSv41 Number of conformant discovery network services 0 We do not know how to test conformity of services
NSv42 Number of conformant view network services 0 We do not know how to test conformity of services
NSv43 Number of conformant download network services 0 We do not know how to test conformity of services
NSv44 Number of conformant transformation network services 0 We do not know how to test conformity of services
NSv45 Number of conformant discovery invoke services 0 We do not know how to test conformity of services
NSv_NumAllServ Number of all services 3073 3358
NSv_NumDiscServ Number of discovery services 5 7
NSv_NumDownlServ Number of download services 1184 1784
NSv_NumInvkServ Number of invoke services 719 14
NSv_NumTransfServ Number of transformation services 0 0
NSv_NumViewServ Number of view services 1165 1555
SDSv_Num Number of spatial data services 3282 1

 

 

#8 Updated by Paul Hasenohr over 4 years ago

  • Status changed from New to Closed
  • % Done changed from 0 to 100

Also available in: Atom PDF