On 09/28/2015 05:40 AM, Matt Jarvis wrote:
We seem to have hit a bit of an issue with puppetdb garbage
collection. Initial symptoms were exceptions in the puppetdb logs :
Retrying after attempt 6, due to: org.postgresql.util.PSQLException:
This connection has been closed.
And on the postgres side :
LOG: incomplete message from client
Having turned up the logging on postgres, it appears that the query
DELETE FROM fact_paths fp
WHERE fp.id in ( $some_ids ) AND NOT EXISTS (SELECT 1 FROM
facts f
WHERE f.fact_path_id in ( $some_more_ids
) AND f.fact_path_id = fp.id
AND f.factset_id <> $26355)
is the cuplrit. This query is absolutely massive, with over 26000 id's
specified as parameters - as soon as the query is executed, postgres
returns incomplete message from client and drops the connection.
puppetdb is 2.3.7-1puppetlabs1
postgres is 9.3
Does anyone have any clues what's going on here ?
Thanks
Matt
DataCentred Limited registered in England and Wales no. 05611763 --
You received this message because you are subscribed to the Google
Groups "Puppet Users" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to puppet-users+unsubscr...@googlegroups.com
<mailto:puppet-users+unsubscr...@googlegroups.com>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/puppet-users/5fe3bad3-71a7-4348-a9ff-24d8a0284a1c%40googlegroups.com
<https://groups.google.com/d/msgid/puppet-users/5fe3bad3-71a7-4348-a9ff-24d8a0284a1c%40googlegroups.com?utm_medium=email&utm_source=footer>.
For more options, visit https://groups.google.com/d/optout.
Hey Matt,
I can reproduce this by inserting a value at the beginning of an
extremely large array-valued structured fact, but we'll need to know
more about your particular data to confirm whether that's your
particular issue. This could be some large custom fact you're creating
or something generated by a module.
I've created a ticket here around this issue here
https://tickets.puppetlabs.com/browse/PDB-2003
can you connect to the database via psql and share (either here or in
the ticket) the output of
select count(*),name from fact_paths group by name order by count desc;
?
My hope is that that will identify one or more large structured facts
associated with a lot of leaf values, and then we'll need to figure out
where they're coming from.
Wyatt
--
You received this message because you are subscribed to the Google Groups "Puppet
Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to puppet-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/puppet-users/56097B44.6030700%40puppetlabs.com.
For more options, visit https://groups.google.com/d/optout.
