[cbi-dev] Jenkins web interface seems down

[Denis Roy]

The five servers that serve "ci.eclipse.org" get randomly overloaded
with requests. They are shared with Wiki, so wiki and ci can often
appear Flaky at the same time.

We are looking into this. We think one (or several) individual JIPPs may
be getting overwhelmed with requests, and the five "ci.eclipse.org"
servers are simply queuing the incoming requests (which will never be
fulfilled).

Denis

Yep it’s been acting up all morning but seems to be back for me now too !
Thanks to anyone that made this happen J
 
Quentin
Cheers,
 
part de* Jonah Graham
*Envoyé :* mardi 5 juin 2018 15:04
*Objet :* Re: [cbi-dev] Jenkins web interface seems down
 
Earlier today http://status.eclipse.org/ was reporting JIPP/CI Website
as "Flaky" but it is working for me now. The Wiki is still flaky, I
believe it is due to the current load on the database servers.
~~~
Jonah Graham
Kichwa Coders Ltd.
www.kichwacoders.com <http://www.kichwacoders.com>
 
Hi Everyone,
 
I can't seem to access the web interface for the CI services
(Papyrus - Hipp 9). Even the root https://ci.eclipse.org times out
on me.
I tried to restart the instance but to no avail.
 
Anyone else have this problem ?
 
Thanks,
Quentin
 
_______________________________________________
cbi-dev mailing list
To change your delivery options, retrieve your password, or
unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/cbi-dev
 
_______________________________________________
cbi-dev mailing list
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/cbi-dev

[Jonah Graham]

Hi Denis,

I have received a couple of these error on ci.eclipse.org/cdt, is this the
error you are looking into?

This happened when saving configuration or creating new jenkins items. The
actual operation worked (i.e. the new item was correctly created and/or
saved)

Proxy Error

The proxy server received an invalid response from an upstream server.
The proxy server could not handle the request *POST /cdt/view/Main/createItem
<https://ci.eclipse.org/cdt/view/Main/createItem>*.

Reason: *Error reading from remote server*


~~~
Jonah Graham
Kichwa Coders Ltd.
www.kichwacoders.com

The five servers that serve "ci.eclipse.org" get randomly overloaded with
requests. They are shared with Wiki, so wiki and ci can often appear Flaky
at the same time.
We are looking into this. We think one (or several) individual JIPPs may
be getting overwhelmed with requests, and the five "ci.eclipse.org"
servers are simply queuing the incoming requests (which will never be
fulfilled).
Denis
Yep it’s been acting up all morning but seems to be back for me now too !
Thanks to anyone that made this happen J
Quentin
Cheers,
*Envoyé :* mardi 5 juin 2018 15:04
*Objet :* Re: [cbi-dev] Jenkins web interface seems down
Earlier today http://status.eclipse.org/ was reporting JIPP/CI Website as
"Flaky" but it is working for me now. The Wiki is still flaky, I believe it
is due to the current load on the database servers.
~~~
Jonah Graham
Kichwa Coders Ltd.
www.kichwacoders.com
Hi Everyone,
I can't seem to access the web interface for the CI services (Papyrus -
Hipp 9). Even the root https://ci.eclipse.org times out on me.
I tried to restart the instance but to no avail.
Anyone else have this problem ?
Thanks,
Quentin
_______________________________________________
cbi-dev mailing list
To change your delivery options, retrieve your password, or unsubscribe
from this list, visit
https://dev.eclipse.org/mailman/listinfo/cbi-dev
_______________________________________________
To change your delivery options, retrieve your password, or unsubscribe from this list, visithttps://dev.eclipse.org/mailman/listinfo/cbi-dev
_______________________________________________
cbi-dev mailing list
To change your delivery options, retrieve your password, or unsubscribe
from this list, visit
https://dev.eclipse.org/mailman/listinfo/cbi-dev

[Jonah Graham]

Thanks Denis.

We (CDT folk on HIPP5) have already signed up to be moved onto the new
infra as soon as Photon is out and you and the team are ready. Thanks for
your hard work.

Jonah


~~~
Jonah Graham
Kichwa Coders Ltd.
www.kichwacoders.com

Jonah,
Unrelated to the outage this morning, we're having issues with one
specific host: hipp5.
Our investigations are leading to a dead end, but I do have a hunch. I'm
tempted to move all its hosted instances onto other hosts and allocate that
node to the new CBI infra we're building. I think it will perform better
there.
Anyway -- more to come on that subject. In the meanwhile, I apologize for
the inconvenience and assure you we're working on it.
Denis
Denis, I assume your email had referred to Bug 535543
<https://bugs.eclipse.org/bugs/show_bug.cgi?id=535543> which is now
resolved, so I have raised Bug 535569
<https://bugs.eclipse.org/bugs/show_bug.cgi?id=535569> to cover this new
problem.
~~~
Jonah Graham
Kichwa Coders Ltd.
www.kichwacoders.com

Post by Jonah Graham
Hi Denis,
I have received a couple of these error on ci.eclipse.org/cdt, is this
the error you are looking into?
This happened when saving configuration or creating new jenkins items.
The actual operation worked (i.e. the new item was correctly created and/or
saved)
Proxy Error
The proxy server received an invalid response from an upstream server.
The proxy server could not handle the request *POST /cdt/view/Main/createItem
<https://ci.eclipse.org/cdt/view/Main/createItem>*.
Reason: *Error reading from remote server*
~~~
Jonah Graham
Kichwa Coders Ltd.
www.kichwacoders.com

Post by Denis Roy
The five servers that serve "ci.eclipse.org" get randomly overloaded
with requests. They are shared with Wiki, so wiki and ci can often appear
Flaky at the same time.
We are looking into this. We think one (or several) individual JIPPs may
be getting overwhelmed with requests, and the five "ci.eclipse.org"
servers are simply queuing the incoming requests (which will never be
fulfilled).
Denis
Yep it’s been acting up all morning but seems to be back for me now too !
Thanks to anyone that made this happen J
Quentin
Cheers,
*Envoyé :* mardi 5 juin 2018 15:04
*Objet :* Re: [cbi-dev] Jenkins web interface seems down
Earlier today http://status.eclipse.org/ was reporting JIPP/CI Website
as "Flaky" but it is working for me now. The Wiki is still flaky, I believe
it is due to the current load on the database servers.
~~~
Jonah Graham
Kichwa Coders Ltd.
www.kichwacoders.com
Hi Everyone,
I can't seem to access the web interface for the CI services (Papyrus -
Hipp 9). Even the root https://ci.eclipse.org times out on me.
I tried to restart the instance but to no avail.
Anyone else have this problem ?
Thanks,
Quentin
_______________________________________________
cbi-dev mailing list
To change your delivery options, retrieve your password, or unsubscribe
from this list, visit
https://dev.eclipse.org/mailman/listinfo/cbi-dev
_______________________________________________
To change your delivery options, retrieve your password, or unsubscribe from this list, visithttps://dev.eclipse.org/mailman/listinfo/cbi-dev
_______________________________________________
cbi-dev mailing list
To change your delivery options, retrieve your password, or unsubscribe
from this list, visit
https://dev.eclipse.org/mailman/listinfo/cbi-dev

_______________________________________________
To change your delivery options, retrieve your password, or unsubscribe from this list, visithttps://dev.eclipse.org/mailman/listinfo/cbi-dev
_______________________________________________
cbi-dev mailing list
To change your delivery options, retrieve your password, or unsubscribe
from this list, visit
https://dev.eclipse.org/mailman/listinfo/cbi-dev