Re: Node H23 insufficient memory

2020-01-17 Thread Chris Lambertus
As far as I can tell, H23 is working normally, builds are running normally since the reboot to clear up issues a couple days ago. > On Jan 17, 2020, at 12:34 PM, Marshall Schor wrote: > > Today, my github pull request Jenkins jobs are continually failing with > messages > similar to this -

Re: Node H23 insufficient memory

2020-01-17 Thread Marshall Schor
Today, my github pull request Jenkins jobs are continually failing with messages similar to this - Java can't create threads. For example: [Apache UIMA Java SDK (GitHub PR)] $ /home/jenkins/tools/java/latest1.8/bin/java -Xmx4g -Xms4g -cp /home/jenkins/jenkins-slave/maven33-agent.jar:/home/jenki

Re: Node H23 insufficient memory

2020-01-12 Thread Vladimir Sitnikov
I've filed https://github.com/apache/pulsar/issues/6035 I've killed a couple of those processes, however, they seem to spawn again :( Vladimir

Re: Node H23 insufficient memory

2020-01-12 Thread Martin
Hi Vladimir, I'm fine with this. It looks, as if these processes are running for a very long time, so it does not makes sense to keep them running and blocking the machine. Thank you and regards. Martin Am Sonntag, 12. Januar 2020, 18:08:51 CET schrieb Vladimir Sitnikov: > Hi, > > Apparently,

Re: Node H23 insufficient memory

2020-01-12 Thread Vladimir Sitnikov
Hi, Apparently, Pulsar jobs went wild. There are 14 processes which consume 9000+ threads: 22058 jenkins 20 0 19.514g 2.156g 33960 S 36.8 2.3 2032:55 /usr/local/asfpackages/java/jdk1.8.0_191/jre/bin/java -Xmx1G -XX:+UseG1GC -Dpulsar.allocator.pooled=false -Dpulsar.allocator.leak_detectio

Node H23 insufficient memory

2020-01-12 Thread Martin
Hi, the builds on H23 fail consistently with: # There is insufficient memory for the Java Runtime Environment to continue. # Cannot create GC thread. Out of system resources. Other nodes run fine. Could you please check or restart the node? Regards Martin