After a crash of the server (Ubuntu 18.04) our puppetserver (6.2.1) process refuses to start with the message it can not find the file/directory "concurrent". It looks like this is a JRuby/Java problem.
... Oct 9 09:18:12 foreman puppetserver[32556]: LoadError: no such file to load -- concurrent Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: require at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/thread_local.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: require at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/context.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: require at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59 Oct 9 09:18:12 foreman puppetserver[32556]: <module:(root)> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/context.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: Puppet at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:41 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:38 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: (root) at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: (root) at uri:classloader:/puppetserver-lib/puppet/server.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: Exception in thread "main" java.lang.IllegalStateException: There was a problem adding a JRubyInstance to the pool. ... Anyone any experience with this? Thanks in advance! Sander -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-users/3677619a-8bac-4ca0-811a-0a0ce73d2828%40googlegroups.com.
Oct 9 09:17:44 foreman systemd[1]: Starting puppetserver Service... Oct 9 09:18:12 foreman puppetserver[32556]: LoadError: no such file to load -- concurrent Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: require at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/thread_local.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: require at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/context.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: require at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59 Oct 9 09:18:12 foreman puppetserver[32556]: <module:(root)> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/context.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: Puppet at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:41 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:38 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: (root) at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: (root) at uri:classloader:/puppetserver-lib/puppet/server.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: Exception in thread "main" java.lang.IllegalStateException: There was a problem adding a JRubyInstance to the pool. Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.services.jruby_pool_manager.impl.jruby_agents$fn__32598$prime_pool_BANG___32603$fn__32607.invoke(jruby_agents.clj:75) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.services.jruby_pool_manager.impl.jruby_agents$fn__32598$prime_pool_BANG___32603.invoke(jruby_agents.clj:48) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.services.jruby_pool_manager.impl.jruby_agents$fn__32848$send_prime_pool_BANG___32853$fn__32854$fn__32855.invoke(jruby_agents.clj:233) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.trapperkeeper.internal$shutdown_on_error_STAR_.invokeStatic(internal.clj:389) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.trapperkeeper.internal$shutdown_on_error_STAR_.invoke(internal.clj:364) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.trapperkeeper.internal$shutdown_on_error_STAR_.invokeStatic(internal.clj:374) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.trapperkeeper.internal$shutdown_on_error_STAR_.invoke(internal.clj:364) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.trapperkeeper.internal$fn__14006$shutdown_service__14011$fn$reify__14013$service_fnk__4991__auto___positional$reify__14018.shutdown_on_error(internal.clj:429) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.trapperkeeper.internal$fn__13953$G__13938__13961.invoke(internal.clj:397) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.trapperkeeper.internal$fn__13953$G__13937__13970.invoke(internal.clj:397) Oct 9 09:18:12 foreman puppetserver[32556]: #011at clojure.core$partial$fn__5824.invoke(core.clj:2625) Oct 9 09:18:12 foreman puppetserver[32556]: #011at clojure.core$partial$fn__5824.invoke(core.clj:2624) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.services.jruby_pool_manager.impl.jruby_agents$fn__32573$send_agent__32578$fn__32579$agent_fn__32580.invoke(jruby_agents.clj:42) Oct 9 09:18:12 foreman puppetserver[32556]: #011at clojure.core$binding_conveyor_fn$fn__5739.invoke(core.clj:2033) Oct 9 09:18:12 foreman puppetserver[32556]: #011at clojure.lang.AFn.applyToHelper(AFn.java:154) Oct 9 09:18:12 foreman puppetserver[32556]: #011at clojure.lang.RestFn.applyTo(RestFn.java:132) Oct 9 09:18:12 foreman puppetserver[32556]: #011at clojure.lang.Agent$Action.doRun(Agent.java:114) Oct 9 09:18:12 foreman puppetserver[32556]: #011at clojure.lang.Agent$Action.run(Agent.java:163) Oct 9 09:18:12 foreman puppetserver[32556]: #011at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) Oct 9 09:18:12 foreman puppetserver[32556]: #011at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) Oct 9 09:18:12 foreman puppetserver[32556]: #011at java.lang.Thread.run(Thread.java:748) Oct 9 09:18:12 foreman puppetserver[32556]: Caused by: org.jruby.embed.EvalFailedException: (LoadError) no such file to load -- concurrent Oct 9 09:18:12 foreman puppetserver[32556]: #011at org.jruby.embed.internal.EmbedEvalUnitImpl.run(EmbedEvalUnitImpl.java:131) Oct 9 09:18:12 foreman puppetserver[32556]: #011at org.jruby.embed.ScriptingContainer.runUnit(ScriptingContainer.java:1295) Oct 9 09:18:12 foreman puppetserver[32556]: #011at org.jruby.embed.ScriptingContainer.runScriptlet(ScriptingContainer.java:1288) Oct 9 09:18:12 foreman puppetserver[32556]: #011at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Oct 9 09:18:12 foreman puppetserver[32556]: #011at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Oct 9 09:18:12 foreman puppetserver[32556]: #011at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Oct 9 09:18:12 foreman puppetserver[32556]: #011at java.lang.reflect.Method.invoke(Method.java:498) Oct 9 09:18:12 foreman puppetserver[32556]: #011at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:167) Oct 9 09:18:12 foreman puppetserver[32556]: #011at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:102) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.services.jruby.jruby_puppet_core$fn__34109$get_initialize_pool_instance_fn__34114$fn__34115$fn__34116.invoke(jruby_puppet_core.clj:132) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.services.jruby_pool_manager.impl.jruby_internal$fn__32180$create_pool_instance_BANG___32189$fn__32192.invoke(jruby_internal.clj:211) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.services.jruby_pool_manager.impl.jruby_internal$fn__32180$create_pool_instance_BANG___32189.invoke(jruby_internal.clj:177) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.services.jruby_pool_manager.impl.jruby_agents$fn__32598$prime_pool_BANG___32603$fn__32607.invoke(jruby_agents.clj:65) Oct 9 09:18:12 foreman puppetserver[32556]: #011... 20 more Oct 9 09:18:12 foreman puppetserver[32556]: Caused by: org.jruby.exceptions.LoadError: (LoadError) no such file to load -- concurrent Oct 9 09:18:12 foreman puppetserver[32556]: #011at org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:970) Oct 9 09:18:12 foreman puppetserver[32556]: #011at uri_3a_classloader_3a_.META_minus_INF.jruby_dot_home.lib.ruby.stdlib.rubygems.core_ext.kernel_require.require(uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.<main>(/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/thread_local.rb:1) Oct 9 09:18:12 foreman puppetserver[32556]: #011at org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:970) Oct 9 09:18:12 foreman puppetserver[32556]: #011at uri_3a_classloader_3a_.META_minus_INF.jruby_dot_home.lib.ruby.stdlib.rubygems.core_ext.kernel_require.require(uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.<main>(/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/context.rb:1) Oct 9 09:18:12 foreman puppetserver[32556]: #011at org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:970) Oct 9 09:18:12 foreman puppetserver[32556]: #011at uri_3a_classloader_3a_.META_minus_INF.jruby_dot_home.lib.ruby.stdlib.rubygems.core_ext.kernel_require.require(uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.<module:(root)>(/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/context.rb:1) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.<main>(/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:1) Oct 9 09:18:12 foreman puppetserver[32556]: #011at org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:970) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.Puppet(/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:41) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.<main>(/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:38) Oct 9 09:18:12 foreman puppetserver[32556]: #011at org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:970) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.(root)(uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:1) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.<main>(uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59) Oct 9 09:18:12 foreman puppetserver[32556]: #011at org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:970) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.(root)(uri:classloader:/puppetserver-lib/puppet/server.rb:1) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.<main>(uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:1) Oct 9 09:18:12 foreman puppetserver[32556]: Background process 32572 exited before start had completed Oct 9 09:18:12 foreman systemd[1]: puppetserver.service: Control process exited, code=exited status=1 Oct 9 09:18:12 foreman systemd[1]: puppetserver.service: Failed with result 'exit-code'. Oct 9 09:18:12 foreman systemd[1]: Failed to start puppetserver Service. Oct 9 09:18:13 foreman systemd[1]: puppetserver.service: Service hold-off time over, scheduling restart. Oct 9 09:18:13 foreman systemd[1]: puppetserver.service: Scheduled restart job, restart counter is at 5. Oct 9 09:18:13 foreman systemd[1]: Stopped puppetserver Service.
