Support #2889

IS - National Land Survey of Iceland: National Discovery Service not responding

Added by Angelo Quaglia over 3 years ago. Updated over 3 years ago.

Status:FeedbackStart date:22 Dec 2015
Priority:UrgentDue date:
Assignee:Angelo Quaglia% Done:

0%

Category:Harvesting results
Target version:-
Submitting Organisation:IS - National Land Survey of Iceland Knowledge-Base relevant?:
Proactive:Yes Keyword #1:
Country:IS - Iceland Keyword #2:
Originating UI: Keyword #3:

Description

Dear Ana, Hafliði ,

The National Discovery Service (CSW) of Iceland is not responding any more.

redirects me to an HTML page:

Have you perhaps updated GeoNetwork?

 

The endpoint  http://gatt.lmi.is/geoportal122/csw?request=GetCapabilities&service=CSW&version=2.0.2

is the one registered on the INSPIRE Geoportal:

 

You can choose to update the URL or to restore the functionality of the original URL.

 

Best regards,

Angelo


Related issues

Copied from Geoportal Helpdesk - Support #2813: IS - National Land Survey of Iceland: National Discovery ... Feedback 22 Dec 2015
Copied to Geoportal Helpdesk - Support #2913: IS - National Land Survey of Iceland: View Service with c... Feedback 22 Dec 2015

History

#1 Updated by Angelo Quaglia over 3 years ago

  • Description updated (diff)

#2 Updated by Angelo Quaglia over 3 years ago

  • Status changed from New to Feedback

#3 Updated by Angelo Quaglia over 3 years ago

From: Hafliði Sigtryggur Magnússon [mailto:haflidi@lmi.is]
Sent: 16 December 2016 14:56
To: Angelo Quaglia <angelo.quaglia@ext.jrc.ec.europa.eu>; Anna Guðrún Ahlbrecht <anna@lmi.is>
Cc: Sgirurjón eftir að hann hætti <sigurjon@lmi.is>
Subject: Re: IS - National Land Survey of Iceland: National Discovery Service not responding

 

Hi Angelo,

 

We just upgraded to GeoNetwork as you mentioned in the issue, I will look at this issue next week.

 

With best regards,

Hafliði

#4 Updated by Angelo Quaglia over 3 years ago

  • Description updated (diff)

#5 Updated by Angelo Quaglia over 3 years ago

From: Angelo Quaglia [mailto:angelo.quaglia@ext.jrc.ec.europa.eu]
Sent: 16 December 2016 17:54
To: 'Hafliði Sigtryggur Magnússon' <haflidi@lmi.is>; 'Anna Guðrún Ahlbrecht' <anna@lmi.is>
Cc: 'Sgirurjón eftir að hann hætti' <sigurjon@lmi.is>
Subject: RE: IS - National Land Survey of Iceland: National Discovery Service not responding

 

Many thanks Hafliði.

 

By the way, at https://ies-svn.jrc.ec.europa.eu/issues/2869

I am collecting here a list of OGC CSW 2.0.2 Catalogue software implementation in use in National Geoportals

I would appreciate if you could update that issue or simply tell me what version you have upgrade GeoNetwork to.

 

 

Best regards,
Angelo

#6 Updated by Angelo Quaglia over 3 years ago

Dear Anna, 

I confirm you that the endpoint: 

http://gatt.lmi.is/geoportal122/csw?request=GetCapabilities&service=CSW&version=2.0.2

is not more responding as an OGC CSW.

 

#7 Updated by Angelo Quaglia over 3 years ago

The harvesting has been disabled waiting for an update from the service provider or NCP.

#8 Updated by Angelo Quaglia over 3 years ago

From: Angelo Quaglia [mailto:angelo.quaglia@ext.jrc.ec.europa.eu]
Sent: 30 January 2017 11:35
To: 'Hafliði Sigtryggur Magnússon' <haflidi@lmi.is>; 'Anna Guðrún Ahlbrecht' <anna@lmi.is>
Cc: 'Sgirurjón eftir að hann hætti' <sigurjon@lmi.is>
Subject: RE: IS - National Land Survey of Iceland: National Discovery Service not responding
Importance: High

 

Dear Hafliði 

 

I have not heard back from you.

Since long, the INSPIRE Geoportal cannot harvest from Iceland endpoint.

 

Kind regards,

Angelo

 

#9 Updated by Hafliði Magnússon over 3 years ago

Hi,

The URL has changed, we are now using GeoNetwork instead of ESRI. You should change the request to the standard GeoNetwork URL

Look at: https://gatt.lmi.is/geonetwork/srv/eng/csw?request=GetCapabilities&service=CSW&acceptVersions=2.0.2

 

#10 Updated by Angelo Quaglia over 3 years ago

Dear Hafliði,

1) that is fine, but the new endpoint must be registered in the INSPIRE Geoportal Discovery Service Register at 

http://inspire-geoportal.ec.europa.eu/INSPIRERegistry/

Sigurjon JONSSON did it back in 2013:

 

2) Good to know you have switched to GeoNetwork: which version, exactly?

I am keeping a list if implementations around Europe in the following issue:

https://ies-svn.jrc.ec.europa.eu/issues/2869

 

Best regards,

Angelo

 

#11 Updated by Hafliði Magnússon over 3 years ago

When I try to use http://inspire-geoportal.ec.europa.eu/INSPIRERegistry I get error "404 Not Found"

The version of GeoNetwork is 3.2.1

Regards,
Hafliði

#12 Updated by Angelo Quaglia over 3 years ago

There is actually a trailing slash, sorry:

http://inspire-geoportal.ec.europa.eu/INSPIRERegistry/

#13 Updated by Angelo Quaglia over 3 years ago

Dear Hafliði,

do you have the credentials for making the modifications?

Best regards,

Angelo

#14 Updated by Angelo Quaglia over 3 years ago

Dear Hafliði,

when do you think you will be able to update the endpoint?

Best regards,

Angelo

#15 Updated by Hafliði Magnússon over 3 years ago

It looks like I only have a view access.

#16 Updated by Angelo Quaglia over 3 years ago

Dear Hafliði,

that is correct, your account is read-only, only Sigurjon can modify that:

Your National Contact Point for INSPIRE (National Land Survey of Iceland magnus@lmi.is )

needs to send to:

Michael.LUTZ@ec.europa.eu
 
an e- mail requesting your account to be authorised.
 
Best regards,
Angelo

 

 

#17 Updated by Hafliði Magnússon over 3 years ago

I have asked Magnús to send that e-mail.

Regards,
Hafliði

#18 Updated by Angelo Quaglia over 3 years ago

Dear Hafliði,

do you know if the email has been sent?

Best regards,

Angelo

#19 Updated by Hafliði Magnússon over 3 years ago

Eydis sent an email to michael.lutz@jrc.ec.europa.eu 2017-02-01 10:19, she is the Director General today while Magnús is on a leave for some months.

#20 Updated by Angelo Quaglia over 3 years ago

I will ask Michael to double check, thank you.

 

#21 Updated by Angelo Quaglia over 3 years ago

Dear Hafliði,

Michael told me the email went unnoticed, we are sorry for the delay.

 

You email address has now been enabled.

You can find the instructions to update the endpoint of your Discovery Service here:

https://ies-svn.jrc.ec.europa.eu/projects/mig-inspire/wiki/DiscoveryServiceRegister#Modifying-an-existing-Discovery-Service-registration

 

Best regards,

Angelo

#22 Updated by Angelo Quaglia over 3 years ago

Dear Hafliði,

any chance you will be able to update the endpoint this week?

 

Best regards,

Angelo

#23 Updated by Angelo Quaglia over 3 years ago

  • Priority changed from Normal to Urgent

Dear Hafliði,

any chance you will be able to update the endpoint this week?

The data in the INSPIRE Geoportal dates back to Decemebr 2016.

Best regards,

Angelo

#24 Updated by Hafliði Magnússon over 3 years ago

Hi,

There is still something wrong about my access. I can not select a submission to modify. See image.

#25 Updated by Angelo Quaglia over 3 years ago

I have checked and the email address hafliði@lmi.is is authorised.

Could you please double check that is exactly the email address with which you register your ECAS account?

#26 Updated by Hafliði Magnússon over 3 years ago

Yes, I tried different browser, and logged in as haflidi@lmi.is

Regards,
Hafliði

#27 Updated by Angelo Quaglia over 3 years ago

So, it is

haflidi@lmi.is

and not

hafliði@lmi.is

?

 

Then, that is why.

#28 Updated by Hafliði Magnússon over 3 years ago

A, I am used to read Hafliði as Haflidi. In Iceland we newer use icelandic letters in e-mail addresses.

Regards,
Hafliði

#29 Updated by Angelo Quaglia over 3 years ago

I understand.

I have updated it and now it should really work.

Best regards,

Angelo

 

#30 Updated by Angelo Quaglia over 3 years ago

You will find the registration procedure quite slow but please allow it to complete.

This is because the system is very busy running, in agreement with the French Ministry of Transport, a massive harvesting.

The detailed instructions for updating an existing resgitration are here :

#31 Updated by Angelo Quaglia over 3 years ago

Dear Hafliði,

the system is under normal load, today.

If you would like to proceed with the registration, please go ahead.

Best regards,

Angelo

#32 Updated by Angelo Quaglia over 3 years ago

Dear Hafliði,

please note that at 6pm every day the harvesting operations start.

Best regards,

Angelo

#33 Updated by Hafliði Magnússon over 3 years ago

I did submit changes this morning, it is still waiting.

#34 Updated by Hafliði Magnússon over 3 years ago

After long time, I got:

Proxy Error

The proxy server received an invalid response from an upstream server.
The proxy server could not handle the request POST /INSPIRERegistry/processEditSubmission.do.

Reason: Error reading from remote server

#35 Updated by Angelo Quaglia over 3 years ago

I am sorry for the inconvenience.

I confirm you that the systems are running fine.

I see an error in the server log which is usually due to a timeout during the validation:

2017-03-10 12:55:38,124 [http-nio-8080-exec-286] WARN  eu.inspiregeoportal.registries.ui.form.EditSubmissionForm - (EditSubmissionForm.java:355) -  - Post to WebService failed. Service return error code Bad Gateway

 

I see that the new endpoint is:

https://gatt.lmi.is/geonetwork/srv/eng/csw?SERVICE=CSW&VERSION=2.0.2&REQUEST=GetCapabilities

I also see that 162 records are now available:

<?xml version="1.0" encoding="UTF-8"?>
<csw:GetRecordsResponse xmlns:csw="http://www.opengis.net/cat/csw/2.0.2" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.opengis.net/cat/csw/2.0.2 http://schemas.opengis.net/csw/2.0.2/CSW-discovery.xsd">
    <csw:SearchStatus timestamp="2017-03-10T12:51:40" />
    <csw:SearchResults numberOfRecordsMatched="162" numberOfRecordsReturned="1" elementSet="full" nextRecord="2">

 

In the current registration, the "Value of maxrecords" is 67 which was the total number of records in the old endpoint:

May I ask you to try again but, in addition to changing the endpoint, to input 20 for maxrecords?

That value is the maxrecords parameter for a single GetRecords request.

You might also want to reduce the "Max parallel HTTP requests" from 5 to, say, 3. That is the maximum number of concurrent requests the INSPIRE Geoportal is allowed to fire against your service.

During the validation it tries to one request with that maxrecords to see if it works, so if you input 67 or more it will try with a GetRecords of that size.

#36 Updated by Angelo Quaglia over 3 years ago

I see you have just tried.

I see a different error in the log:

2017-03-10 14:20:58,397 [http-nio-8080-exec-300] INFO  eu.inspiregeoportal.registries.dao.utils.RegistryUtils - (RegistryUtils.java:2225) -  - Create temp resource status: 201
2017-03-10 14:26:29,842 [http-nio-8080-exec-304] ERROR org.apache.struts.taglib.tiles.InsertTag - (InsertTag.java:922) -  - ServletException in '/layouts/classicLayout.jsp': Exception occurred when flushing data
org.apache.jasper.JasperException: java.lang.IllegalStateException: Exception occurred when flushing data
        at org.apache.jasper.servlet.JspServletWrapper.handleJspException(JspServletWrapper.java:555)
        at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:471)
        at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:396)
        at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:340)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)

 

#37 Updated by Angelo Quaglia over 3 years ago

If it keeps failing and you give me the authorisation, I can try the updates on your behalf in order to better diagnose the problem.

#38 Updated by Hafliði Magnússon over 3 years ago

It would be good if you try the updates.

Thnks, hsm

#39 Updated by Angelo Quaglia over 3 years ago

  • Status changed from Feedback to Assigned

Dear Hafliði,

I have been unable to determine the cause of the malfunctioning, yet.

In development it works fine.

I will resume on Monday.

Best regards,

Angelo

#40 Updated by Angelo Quaglia over 3 years ago

  • Status changed from Assigned to Feedback

Dear Hafliði,

 

settings maxrecords equal to 20 eventually worked, on Friday.

The quality of metadata is quite low, though: only 63.34%

I recommend you browse through the validation report:

http://inspire-geoportal.ec.europa.eu/resources/INSPIRE-7ba666ea-05bd-11e7-9a72-52540023a883_20170313-102052/services/1/PullResults/

 

There are validation issues also for the Discovery Service itself:

http://inspire-geoportal.ec.europa.eu/resources/INSPIRE-7ba666ea-05bd-11e7-9a72-52540023a883_20170313-102052/services/1/resourceReport/

 

Best regards,

Angelo

#41 Updated by Hafliði Magnússon over 3 years ago

OK, good that you are now getting data. I will ask Anna to look at the quality result.

Regards,
Hafliði

Also available in: Atom PDF