On 12/12/2016 10:09 AM, Harish Kothuri wrote: I see that following errors are popping up from puppetdb. There are quite a few of these and also would like to know for which machines it is coming from
2016-12-12 10:08:16,040 ERROR [c.p.p.command] [afe425be-8413-49a8-8086-79ebaa00927a] [store report] Retrying after attempt 13, due to: org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique constraint "reports_pkey" org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique constraint "reports_pkey" This error occurs when a report is submitted to PuppetDB twice -- the first time it will be stored, and the second time this error will occur. It's conflicting on the hash of a report, which includes certname and creation time, so these errors will pretty much only arise in the case a two submissions. We've seen these caused by puppetdb imports on nonempty databases, or sometimes sporadically due to bug in shutdown coordination between PuppetDB and ActiveMQ (these have gotten much better since your version; in fact, AMQ is gone). It's not typically a cause for concern and is IMO unlikely to be the root of your issue, though it could be a symptom of PDB restarts like Matthaus said. At this point if I were you I'd look in the PuppetDB logs to try and correlate a restart with the connection failure you mentioned. In particular, keep an eye out for places where a startup is logged but the preceding shutdown is not, which generally indicates that an OOM occurred. Depending on how your service is configured you may have better ways of detecting this, such as a puppetdb-daemon.log file in the puppetdb log directory. As for knowing which machines the errors originated from, the messages that prompt the failures will become available in your dead letter office after 16 retries, and will contain the certnames. You can read more about that here: https://docs.puppet.com/puppetdb/latest/maintain_and_tune.html#clean-up-the-dead-letter-office Wyatt -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-users/CAJDiH3FU3UEfCZm-TtrMBQ_y%3DHPqYQAdFx2C%3DhvO3RMWMxS_KQ%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
