I stumbled upon a difference between my puppet clients that are still working fine and those that are not. Those that are hanging all have 'listen =- true' set in their puppet.conf.
My puppet version hasn't change in a while but I do run yum update frequently on Centos. My guess is something updated that is now causing puppet to hang when set to listen. I'll post back if I find more. I'll submit a bug if I can isolate it. -Chip On Fri, Nov 11, 2011 at 11:19 AM, Chip Schweiss <chip.schwe...@gmail.com>wrote: > Yes the lock file is created immediately and never runs. The logs report > "info: Retrieving plugin" as the last thing it tries to do. The puppet > master never shows it makes a connection. > > > On Fri, Nov 11, 2011 at 8:49 AM, Len Rugen <lenru...@gmail.com> wrote: > >> I'm having 2 issues, one like yours, and another where puppet daemon will >> work for awhile, then fail, leaving puppetdlock file. Do you have a >> puppetdlock file left after your daemon has been running long enough to try >> to run? It may be immediately, but we use splay, so have to wait awhile. >> >> >> On Fri, Nov 11, 2011 at 7:22 AM, Chip Schweiss >> <chip.schwe...@gmail.com>wrote: >> >>> I think the symptom is similar. but my my case the daemon run, never >>> happens. It just starts, creates the lock file as sits idle forever. >>> >>> On Thu, Nov 10, 2011 at 6:21 PM, Len Rugen <lenru...@gmail.com> wrote: >>> >>>> I think this is the same problem as one I posted about earlier today. >>>> >>>> On Thu, Nov 10, 2011 at 3:23 PM, Chip Schweiss <chip.schwe...@gmail.com >>>> > wrote: >>>> >>>>> This is on Centos 5.7 with puppet 2.6.9. This installation has been >>>>> running for about a year and now nearly all my hosts are hanging. >>>>> >>>>> Running 'puppetd --test' or 'puppetd --test --debug' executes >>>>> successfully every time. However when the puppet service is started it >>>>> will create the lock file (/var/lib/puppet/state/puppetdlock), but never >>>>> runs. >>>>> >>>>> I turned on debug for the service. Log file below. >>>>> >>>>> How can I determine why it is running fine on the console yet not as a >>>>> service? >>>>> >>>>> From start of service: >>>>> Thu Nov 10 15:10:22 -0600 2011 Puppet (debug): Failed to load library >>>>> 'ldap' for feature 'ldap' >>>>> Thu Nov 10 15:10:22 -0600 2011 Puppet (debug): >>>>> Puppet::Type::User::ProviderLdap: feature ldap is missing >>>>> Thu Nov 10 15:10:22 -0600 2011 Puppet (debug): >>>>> Puppet::Type::User::ProviderUser_role_add: file rolemod does not exist >>>>> Thu Nov 10 15:10:22 -0600 2011 Puppet (debug): >>>>> Puppet::Type::User::ProviderDirectoryservice: file /usr/bin/dscl does not >>>>> exist >>>>> Thu Nov 10 15:10:22 -0600 2011 Puppet (debug): >>>>> Puppet::Type::User::ProviderPw: file pw does not exist >>>>> Thu Nov 10 15:10:22 -0600 2011 Puppet (debug): Failed to load library >>>>> 'rubygems' for feature 'rubygems' >>>>> Thu Nov 10 15:10:22 -0600 2011 Puppet (debug): >>>>> Puppet::Type::File::ProviderMicrosoft_windows: feature microsoft_windows >>>>> is >>>>> missing >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/ssl/crl.pem] >>>>> (debug): Autorequiring File[/var/lib/puppet/ssl] >>>>> Thu Nov 10 15:10:23 -0600 2011 >>>>> /File[/var/lib/puppet/ssl/certificate_requests] (debug): Autorequiring >>>>> File[/var/lib/puppet/ssl] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/log/puppet/http.log] >>>>> (debug): Autorequiring File[/var/log/puppet] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/ssl/public_keys] >>>>> (debug): Autorequiring File[/var/lib/puppet/ssl] >>>>> Thu Nov 10 15:10:23 -0600 2011 >>>>> /File[/var/lib/puppet/ssl/public_keys/puppetclient.domain.local.pem] >>>>> (debug): Autorequiring File[/var/lib/puppet/ssl/public_keys] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/ssl/private] >>>>> (debug): Autorequiring File[/var/lib/puppet/ssl] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/clientbucket] >>>>> (debug): Autorequiring File[/var/lib/puppet] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/state/graphs] >>>>> (debug): Autorequiring File[/var/lib/puppet/state] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/ssl/certs/ca.pem] >>>>> (debug): Autorequiring File[/var/lib/puppet/ssl/certs] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/etc/puppet/namespaceauth.conf] >>>>> (debug): Autorequiring File[/etc/puppet] >>>>> Thu Nov 10 15:10:23 -0600 2011 >>>>> /File[/var/lib/puppet/ssl/private_keys/puppetclient.domain.local.pem] >>>>> (debug): Autorequiring File[/var/lib/puppet/ssl/private_keys] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/ssl/private_keys] >>>>> (debug): Autorequiring File[/var/lib/puppet/ssl] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/state] (debug): >>>>> Autorequiring File[/var/lib/puppet] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/ssl/certs] >>>>> (debug): Autorequiring File[/var/lib/puppet/ssl] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/ssl] (debug): >>>>> Autorequiring File[/var/lib/puppet] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/lib] (debug): >>>>> Autorequiring File[/var/lib/puppet] >>>>> Thu Nov 10 15:10:23 -0600 2011 >>>>> /File[/var/lib/puppet/ssl/certs/puppetclient.domain.local.pem] (debug): >>>>> Autorequiring File[/var/lib/puppet/ssl/certs] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/facts] (debug): >>>>> Autorequiring File[/var/lib/puppet] >>>>> Thu Nov 10 15:10:23 -0600 2011 >>>>> /File[/var/lib/puppet/state/last_run_summary.yaml] (debug): Autorequiring >>>>> File[/var/lib/puppet/state] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/client_data] >>>>> (debug): Autorequiring File[/var/lib/puppet] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/etc/puppet/puppet.conf] (debug): >>>>> Autorequiring File[/etc/puppet] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/client_yaml] >>>>> (debug): Autorequiring File[/var/lib/puppet] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/state/state.yaml] >>>>> (debug): Autorequiring File[/var/lib/puppet/state] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/classes.txt] >>>>> (debug): Autorequiring File[/var/lib/puppet] >>>>> Thu Nov 10 15:10:23 -0600 2011 Puppet (debug): Finishing transaction >>>>> 23879910223180 >>>>> Thu Nov 10 15:10:23 -0600 2011 Puppet (notice): Reopening log files >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/ssl/private_keys] >>>>> (debug): Autorequiring File[/var/lib/puppet/ssl] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/lib] (debug): >>>>> Autorequiring File[/var/lib/puppet] >>>>> Thu Nov 10 15:10:23 -0600 2011 >>>>> /File[/var/lib/puppet/ssl/private_keys/puppetclient.domain.local.pem] >>>>> (debug): Autorequiring File[/var/lib/puppet/ssl/private_keys] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/ssl/public_keys] >>>>> (debug): Autorequiring File[/var/lib/puppet/ssl] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/ssl/certs/ca.pem] >>>>> (debug): Autorequiring File[/var/lib/puppet/ssl/certs] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/ssl/private] >>>>> (debug): Autorequiring File[/var/lib/puppet/ssl] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/facts] (debug): >>>>> Autorequiring File[/var/lib/puppet] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/state] (debug): >>>>> Autorequiring File[/var/lib/puppet] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/ssl] (debug): >>>>> Autorequiring File[/var/lib/puppet] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/log/puppet/http.log] >>>>> (debug): Autorequiring File[/var/log/puppet] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/etc/puppet/namespaceauth.conf] >>>>> (debug): Autorequiring File[/etc/puppet] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/ssl/crl.pem] >>>>> (debug): Autorequiring File[/var/lib/puppet/ssl] >>>>> Thu Nov 10 15:10:23 -0600 2011 /File[/var/lib/puppet/ssl/certs] >>>>> (debug): Autorequiring File[/var/lib/puppet/ssl] >>>>> Thu Nov 10 15:10:23 -0600 2011 >>>>> /File[/var/lib/puppet/ssl/public_keys/puppetclient.domain.local.pem] >>>>> (debug): Autorequiring File[/var/lib/puppet/ssl/public_keys] >>>>> Thu Nov 10 15:10:23 -0600 2011 >>>>> /File[/var/lib/puppet/ssl/certs/puppetclient.domain.local.pem] (debug): >>>>> Autorequiring File[/var/lib/puppet/ssl/certs] >>>>> Thu Nov 10 15:10:23 -0600 2011 >>>>> /File[/var/lib/puppet/ssl/certificate_requests] (debug): Autorequiring >>>>> File[/var/lib/puppet/ssl] >>>>> Thu Nov 10 15:10:23 -0600 2011 Puppet (debug): Finishing transaction >>>>> 23879909309880 >>>>> Thu Nov 10 15:10:23 -0600 2011 Puppet (debug): Using cached >>>>> certificate for ca >>>>> Thu Nov 10 15:10:23 -0600 2011 Puppet (debug): Using cached >>>>> certificate for puppetclient.domain.local >>>>> Thu Nov 10 15:10:23 -0600 2011 Puppet (debug): Finishing transaction >>>>> 23879909856460 >>>>> Thu Nov 10 15:10:23 -0600 2011 Puppet (notice): Starting Puppet client >>>>> version 2.6.9 >>>>> Thu Nov 10 15:10:23 -0600 2011 Puppet (debug): Using cached >>>>> certificate for ca >>>>> Thu Nov 10 15:10:23 -0600 2011 Puppet (debug): Using cached >>>>> certificate for puppetclient.domain.local >>>>> Thu Nov 10 15:10:23 -0600 2011 Puppet (debug): Using cached >>>>> certificate for ca >>>>> Thu Nov 10 15:10:23 -0600 2011 Puppet (debug): Using cached >>>>> certificate_revocation_list for ca >>>>> Thu Nov 10 15:10:23 -0600 2011 Puppet (debug): Loaded state in 0.02 >>>>> seconds >>>>> Thu Nov 10 15:10:23 -0600 2011 Puppet (info): Retrieving plugin >>>>> Thu Nov 10 15:10:23 -0600 2011 Puppet (debug): file_metadata supports >>>>> formats: b64_zlib_yaml marshal pson raw yaml; using pson >>>>> Thu Nov 10 15:10:23 -0600 2011 Puppet (debug): Finishing transaction >>>>> 23879909426000 >>>>> >>>>> -- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "Puppet Users" group. >>>>> To post to this group, send email to puppet-users@googlegroups.com. >>>>> To unsubscribe from this group, send email to >>>>> puppet-users+unsubscr...@googlegroups.com. >>>>> For more options, visit this group at >>>>> http://groups.google.com/group/puppet-users?hl=en. >>>>> >>>> >>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "Puppet Users" group. >>>> To post to this group, send email to puppet-users@googlegroups.com. >>>> To unsubscribe from this group, send email to >>>> puppet-users+unsubscr...@googlegroups.com. >>>> For more options, visit this group at >>>> http://groups.google.com/group/puppet-users?hl=en. >>>> >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "Puppet Users" group. >>> To post to this group, send email to puppet-users@googlegroups.com. >>> To unsubscribe from this group, send email to >>> puppet-users+unsubscr...@googlegroups.com. >>> For more options, visit this group at >>> http://groups.google.com/group/puppet-users?hl=en. >>> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Puppet Users" group. >> To post to this group, send email to puppet-users@googlegroups.com. >> To unsubscribe from this group, send email to >> puppet-users+unsubscr...@googlegroups.com. >> For more options, visit this group at >> http://groups.google.com/group/puppet-users?hl=en. >> > > -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
