Support #3760

DE: feedback to harvest console + calculation of indicators

Added by Anja Litka 9 months ago. Updated about 1 month ago.

Status:ClosedStart date:21 Nov 2019
Priority:NormalDue date:
Assignee:Davide Artasensi% Done:

0%

Category:Harvesting results
Target version:-
Submitting Organisation:DE Knowledge-Base relevant?:No
Proactive:No Keyword #1:indicators
Country:DE - Germany Keyword #2:
Originating UI:Discovery Keyword #3:

Description

Dear INSPIRE team,

Since we are still not able to complete a successfull harvesting of our national catalogue, we could only test a small subset of resources for the indicator calculation. Here is some feedback on what we could  test under these restricted conditions so far. 

  1. to the calculation of the indicators:
  • indicator DSi1.3
    • It seems, that the indicator doesn’t count the unique metadata record, which is tagged with at least one Priority data set keyword in the metadata “Keyword” element. Right now, it looks like, that the calculation is based on the number of Priority data set keywords, which were found in every single metadata record. Our result for this indicator was too high, because our small subset only include 17 metadata dataset records tagged with one or more Priority data set keyword/s.
  • indicator DSi1.5
    • It seems, that the calculation still isn’t proper working. Our result for this indicator was too low, because our small subset include 25 metadata dataset records tagged with the keyword „National“.
  • indicator DSi2 (include DSi2.1, DSi2.2 & DSi2.3)
    • It seems, that the calculation still isn’t proper working, because our small subset include 8 metadata dataset records of annex II, all non-conformant to the interoperability regulation. Thus, the indicator should be 0%, but in fact the indicator is 11,1%.
    • Is there any possibility to provide a list or file with the metadata records, which are used for the calculation?
  • indicator NSi2 (include NSi2.1 & NSi2.2)
    • Which xml-element do you use for calculation of these indicators in the metadata dataset records?
    • Could you provide us the specific XPath?
  • indicator NSi4 (include NSi4.1, NSi4.2, NSi4.3 & NSi4.4)
    • Is there any possibility to provide a list or file with the metadata records, which are used for the calculation?

However we would appreciate, if you could provide us the concrete calculation formular of all indicators (the slides you have provided are not detailed enough) or at least a list (raw data) with the actually used metadata records. Only on this basis we are able to analyse the result, and as a next step to analyse, update and improve our metadata entries.

to the handling oft he harvest console:

  • regarding the download function for "resources for which linkage issues were found"
    • Only a maximum of 100 records can be downloaded, but it should be unlimited.
    • The download information should include linkage to the detailed views.

Kind regards,

Anja

History

#1 Updated by Daniele Francioli 3 months ago

  • Subject changed from feedback to harvest console + calculation of indicators to DE: feedback to harvest console + calculation of indicators
  • Status changed from New to Feedback

Hi Anja,

We would like to understand if this issue is still valid for you. Can we close it?

Thank you in advance,

Daniele on behalf of the JRC INSPIRE Support team

#2 Updated by Anja Litka 3 months ago

  • Assignee changed from Vlado Cetl to Daniele Francioli

Dear Daniele,

I apologise for my late response to this issue. Please find hereafter our answers to the calculation of the indicators:

indicator DSi1.3

  • It seems, that the indicator doesn’t check the correct entry of the thesaurus name. We did a cross check of the provided JRC results for this indicator and realise, that metadata records with the thesaurus name “INSPIRE priorty data set" also counted. Therefore we would appreciate, if you would adjust the calculation for DSi1.3 for the next monitoing process.

indicator DSi1.5

  • We did a cross check of the provided JRC results for this indicator and everything was correct.

indicator DSi2 (include DSi2.1, DSi2.2 & DSi2.3)

  • Due to the change of the Commission Decision 2009/442/EC, we couldn’t do a proper cross check of the provided JRC results for this indicator. Nevertheless is there any possibility to provide a list or file with the metadata records, which are used for the calculation?

indicator NSi2 (include NSi2.1 & NSi2.2)

  • We tried to cross check the provided JRC results for this indicator, but we were only able to check the linkage between a dataset (MD_Identifier) and a service (operatesOn). We couldn’t check, if the response of the “linkage” is correct. So we would appreciate, if you would tell us, which xml-element do you use for calculation of these indicators in the metadata dataset records or could you provide us the specific XPath?

indicator NSi4 (include NSi4.1, NSi4.2, NSi4.3 & NSi4.4)

  • Due to the change of the Commission Decision 2009/442/EC, we couldn’t do a proper cross check of the provided JRC results for this indicator. Nevertheless is there any possibility to provide a list or file with the metadata records, which are used for the calculation?

Over all we would appreciate, if you could provide us the concrete calculation formular of all indicators (the slides you have provided are not detailed enough) or at least a list (raw data) with the actually used metadata records. Only on this basis we are able to do a proper analyse of the provided (indicator) results, and as a next step to update and improve our metadata entries for the next monitoring process.

Anja (on behalf of Coordination Office SDI Germany)

#3 Updated by Davide Artasensi 2 months ago

  • Assignee changed from Daniele Francioli to Davide Artasensi

#4 Updated by Davide Artasensi 2 months ago

Dear Anja,

apologies for my late reply.

See my replies in line with your list points.

indicator DSi1.3

  • It seems, that the indicator doesn’t check the correct entry of the thesaurus name. We did a cross check of the provided JRC results for this indicator and realise, that metadata records with the thesaurus name “INSPIRE priorty data set" also counted. Therefore we would appreciate, if you would adjust the calculation for DSi1.3 for the next monitoing process.

We relaxed these types of check (in your example, a potential typo) in order to be flexible as much as possible with the recognition of keywords. In particular, we rely only on the exact URI (ie. codelist elements starting with https://inspire.ec.europa.eu/metadata-codelist/PriorityDataset), or the exact name. But your point is clear, and I'm currently improving the checks on the use of a specific thesaurus.

indicator DSi1.5

  • We did a cross check of the provided JRC results for this indicator and everything was correct.

Thanks for the double check.

indicator DSi2 (include DSi2.1, DSi2.2 & DSi2.3)

  • Due to the change of the Commission Decision 2009/442/EC, we couldn’t do a proper cross check of the provided JRC results for this indicator. Nevertheless is there any possibility to provide a list or file with the metadata records, which are used for the calculation?

At the moment, we cannot provide you what you're asking for. We will consider your suggestion to be included in the next software release.

indicator NSi2 (include NSi2.1 & NSi2.2)

  • We tried to cross check the provided JRC results for this indicator, but we were only able to check the linkage between a dataset (MD_Identifier) and a service (operatesOn). We couldn’t check, if the response of the “linkage” is correct. So we would appreciate, if you would tell us, which xml-element do you use for calculation of these indicators in the metadata dataset records or could you provide us the specific XPath?

Please, refer to the documentation available here, where it explains the path and checks in order to assess a proper resource linkage.

https://inspire-geoportal.ec.europa.eu/files/INSPIRE_Geoportal_process_for_data-service_linking_v1.0.pdf

indicator NSi4 (include NSi4.1, NSi4.2, NSi4.3 & NSi4.4)

  • Due to the change of the Commission Decision 2009/442/EC, we couldn’t do a proper cross check of the provided JRC results for this indicator. Nevertheless is there any possibility to provide a list or file with the metadata records, which are used for the calculation?

At the moment, we cannot provide you what you're asking for. We will consider your suggestion to be included in the next software release.

Over all we would appreciate, if you could provide us the concrete calculation formular of all indicators (the slides you have provided are not detailed enough) or at least a list (raw data) with the actually used metadata records. Only on this basis we are able to do a proper analyse of the provided (indicator) results, and as a next step to update and improve our metadata entries for the next monitoring process.

At the moment, we cannot provide you the list of the metadata records. We can provide a detailed documentation with the workflow and formula for the calculation of indicator.

 

Best regards,

Davide on behalf of JRC INSPIRE Support

#5 Updated by Emanuela Epure about 1 month ago

  • Status changed from Feedback to Closed

Dear Anja,

 

We have completed the implementation regarding the thesaurus. The modifications will be online in production with our next release.

 

Thank you for reporting it

Best regards,

Emanuela on behalf of JRC INSPIRE Support

Also available in: Atom PDF