Support #3529

RO - Harvesting request

Added by Simona Bunea over 1 year ago. Updated about 1 year ago.

Status:FeedbackStart date:20 Mar 2019
Priority:NormalDue date:
Assignee:Angelo Quaglia% Done:

0%

Category:Harvesting process
Target version:-
Submitting Organisation:ANCPI Knowledge-Base relevant?:No
Proactive:No Keyword #1:
Country:RO - Romania Keyword #2:
Originating UI: Keyword #3:

Description

Dear Angelo,

Can you please start a new harvesting from Romanian Geoportal? We did some changes and we want to see the outcome.

Thank you in advance for your help.

 

Best Regards,

Simona Bunea

 


Related issues

Related to Geoportal Helpdesk - Support #3619: RO: Question related to harvest results with id INSPIRE-7... Feedback 10 Jun 2019

History

#1 Updated by Angelo Quaglia over 1 year ago

  • Status changed from New to Feedback

Der Simona,

sure it is running.

Best regards,

Angelo

#2 Updated by Angelo Quaglia over 1 year ago

Dear Simona,

there was a technical problem during the harvesting, due to a Download Service offering more than 2,000 entries:

https://portal.geomil.ro/arcgis/rest/directories/arcgisforinspire/INSPIRE/MNT_Download_Part_1_MapServer/Main_MNT.xml

Each entry in the top feed is supposed represent a different dataset and considering that Romania has less 200 metadata documents, I inspected the top feed.

Already in the first two entries I see that they refer to the same dataset:

 

    <entry>
		<!-- title for "Dataset Feed" for pre-defined dataset -->
		<title>z1_5M_N43d30m0s_E25d15m0s.zip</title>
		<!--Spatial Dataset Unique Resource Identifier for this dataset-->
		<inspire_dls:spatial_dataset_identifier_code>EL.DTED2</inspire_dls:spatial_dataset_identifier_code>
		<inspire_dls:spatial_dataset_identifier_namespace>RO.DTM</inspire_dls:spatial_dataset_identifier_namespace>
		<!-- link to dataset metadata record -->
		<link href="http://geoportal.gov.ro/Geoportal_INIS/csw202/discovery?service=CSW&amp;Request=GetRecordById&amp;version=2.0.2&amp;id=%7BCF03472B-D450-4E22-A804-5C9A4D709F40%7D&amp;outputSchema=http://www.isotc211.org/2005/gmd&amp;elementSetName=full" rel="describedby" type="application/xml"/>
		<!-- link to "Dataset Feed" for pre-defined dataset -->
		<link rel="alternate" href="z1_5M_N43d30m0s_E25d15m0s.xml" type="application/atom+xml" hreflang="en" title="Feed containing the pre-defined dataset (in one or more downloadable formats)"/>
		<!-- identifier for "Dataset Feed" for pre-defined dataset -->
		<id>z1_5M_N43d30m0s_E25d15m0s.xml</id>
		<!-- rights, access info for pre-defined dataset -->
		<rights>no conditions apply</rights>
		<!-- last date/time this entry was updated -->
		<updated>2019-03-18T11:49:46.498000</updated>
		<!-- summary -->
		<summary>Dataset MNT detinut de Agenția de Informații Geospațiale a Apărării "General de Divizie Constantin Barozzi"</summary>
		<georss:polygon>43.4998611111111 25.16652777777773 43.4998611111111 25.250138888889012 43.58347222222221 25.250138888889012 43.58347222222221 25.16652777777773 43.4998611111111 25.16652777777773</georss:polygon>
		<!-- CRSs in which the pre-defined Dataset is available -->
		<category term="http://www.opengis.net/def/crs/EPSG/0/4258" label="Europe - ETRS89"/>
	</entry>     <entry>
		<!-- title for "Dataset Feed" for pre-defined dataset -->
		<title>z1_5M_N43d30m0s_E25d20m0s.zip</title>
		<!--Spatial Dataset Unique Resource Identifier for this dataset-->
		<inspire_dls:spatial_dataset_identifier_code>EL.DTED2</inspire_dls:spatial_dataset_identifier_code>
		<inspire_dls:spatial_dataset_identifier_namespace>RO.DTM</inspire_dls:spatial_dataset_identifier_namespace>
		<!-- link to dataset metadata record -->
		<link href="http://geoportal.gov.ro/Geoportal_INIS/csw202/discovery?service=CSW&amp;Request=GetRecordById&amp;version=2.0.2&amp;id=%7BCF03472B-D450-4E22-A804-5C9A4D709F40%7D&amp;outputSchema=http://www.isotc211.org/2005/gmd&amp;elementSetName=full" rel="describedby" type="application/xml"/>
		<!-- link to "Dataset Feed" for pre-defined dataset -->
		<link rel="alternate" href="z1_5M_N43d30m0s_E25d20m0s.xml" type="application/atom+xml" hreflang="en" title="Feed containing the pre-defined dataset (in one or more downloadable formats)"/>
		<!-- identifier for "Dataset Feed" for pre-defined dataset -->
		<id>z1_5M_N43d30m0s_E25d20m0s.xml</id>
		<!-- rights, access info for pre-defined dataset -->
		<rights>no conditions apply</rights>
		<!-- last date/time this entry was updated -->
		<updated>2019-03-18T11:49:46.498000</updated>
		<!-- summary -->
		<summary>Dataset MNT detinut de Agenția de Informații Geospațiale a Apărării "General de Divizie Constantin Barozzi"</summary>
		<georss:polygon>43.4998611111111 25.24986111111116 43.4998611111111 25.33347222222227 43.58347222222221 25.33347222222227 43.58347222222221 25.24986111111116 43.4998611111111 25.24986111111116</georss:polygon>
		<!-- CRSs in which the pre-defined Dataset is available -->
		<category term="http://www.opengis.net/def/crs/EPSG/0/4258" label="Europe - ETRS89"/>
	</entry> 

 

Would it be possible for you to ask the Service Provider to describe the approach used in the Download Service?

I have adjusted some system parameters and restarted the harvesting. It should complete correctly this time so that I will be able to upload the results.

 

Best regards,

Angelo

 

#3 Updated by Angelo Quaglia over 1 year ago

Dear Simona,

the new harvesting is online but please have a look at that Atom Download Service because I saw other ones with the same issue.

Best regards,

Angelo

#4 Updated by Simona Bunea over 1 year ago

 

Dear Angelo,

Thanks a lot!

Sorry if I don't response in time. I am not a office today an tomorrow, but I contacted the Service Provider.

I espected their answer.

I saw, there are three Atom services with this problem, many entries in Atom Feed, refer to the same metadata document.

All of them have the same service and data provider.

 

Best regards,

Simona Bunea

#5 Updated by Simona Bunea over 1 year ago

Dear Angelo,

please fiind bellow the approach using in download service from service provider:

The ATOM download service on Elevation theme was created by following the INSPIRE Technical Guidelines Document. Thus, the imagery data was organized using a tiling scheme, as described in the section 5.3.1.2.
In the Elevation theme we have are a total of 4381 datasets (zip files). Due to technical constraints, we created two ATOM download services for these datasets:
	- https://portal.geomil.ro/arcgis/rest/services/INSPIRE/MNT_Download_Part_1/MapServer, which has 2600 datasets;
	- https://portal.geomil.ro/arcgis/rest/services/INSPIRE/MNT_Download_Part_2/MapServer, which has 1781 datasets; The two ATOM download services refer to the same metadata document located at: http://geoportal.gov.ro/Geoportal_INIS/csw202/discovery?service=CSW&Request=GetRecordById&version=2.0.2&id=%7BCF03472B-D450-4E22-A804-5C9A4D709F40%7D&outputSchema=http://www.isotc211.org/2005/gmd&elementSetName=full.

The same workflow was done for the Orthoimagery theme, where there are 2627 unique datasets. All the datasets here refer to the metadata document: 
http://geoportal.gov.ro/Geoportal_INIS/csw202/discovery?service=CSW&Request=GetRecordById&version=2.0.2&id=%7BE198833A-351B-43A6-BA09-14BD2B39A6B0%7D&outputSchema=http://www.isotc211.org/2005/gmd&elementSetName=full.
A tiling scheme was used here as well, described in the INSPIRE Technical Guidlines for Orthoimagery, on section 5.5.1.1.2.

Please tell us it is ok this approach?

Best regards,

Simona Bunea

The link for Atom service on the Orthoimagery theme is:

https://portal.geomil.ro/arcgis/rest/directories/arcgisforinspire/INSPIRE/OI_Download_MapServer/Main_Orto.xml

#6 Updated by Angelo Quaglia about 1 year ago

Dear Simona,

Could you please ask the provider why they decided not to use the section links in the dataset feeds?

In each section link you can specify a bounding box.

Each entry should of the top feed refer to a different dataset and each dataset feed should offer all possible available download files for that dataset.

Angelo

#7 Updated by Angelo Quaglia about 1 year ago

Dear Simona,

while I inspect the validation logic, I have enabled an option to limit the number of entries that are processed.

In this way the harvesting has been successfully completed:

http://inspire-geoportal.ec.europa.eu/sandbox/resources/INSPIRE-7edbed58-ddbc-11e4-b469-52540004b857_20190611-142554/services/1/PullResults/

Best regards,

Angelo

#8 Updated by Simona Bunea about 1 year ago

Dear Angelo,

Thank you a lot! We publish now.

Best regards,

Simona

 

Also available in: Atom PDF