On Wednesday, November 5, 2014 9:47:02 AM UTC-5, jcbollinger wrote: > > On Tuesday, November 4, 2014 9:32:32 AM UTC-6, Georgi Todorov wrote: >> >> On Tuesday, November 4, 2014 9:50:15 AM UTC-5, jcbollinger wrote: >>> >>> By far the biggest difference is is File retrieval time. This will be >>> for File resources where you specify content via a 'source' parameter >>> rather than via a 'content' property. The agent must make a separate >>> request to the master for each such file, and those are collectively taking >>> a long time. Most likely they are backing up behind a bottleneck, so that >>> much of the time consumed per node is actually spent waiting for service. >>> >> >> I agree, there is something odd about File retrieval. We are creating a >> total of 10 autofs maps, however when I run trace, it looks like every >> separate entry creates a concat::fragment (puppetlabs-concat) which is >> later combined into a single file. I'm not too familliar with what >> concat::fragment does, but a quick scan of the code shows a lot of "source" >> references. >> > > The Concat module provides a mechanism for managing a single file as a > collection of separately-managed pieces, or 'fragments'. This has a number > of advantages, mostly deriving from the ability to spread management of a > single target file across multiple manifests, modules, or even separate > nodes. As a practical matter, though, the implementation manages each > fragment as a separate File, and combines them on the client. > > Those fragment files, one per Concat::Fragment resource, can use either > 'content' or 'source', as specified for that fragment. I find it a bit odd > that an autofs module would choose the 'source' option (with a 'puppet://*' > URL as its value), but if it's indeed doing so then perhaps that is > generating large numbers of tiny, 'source'd files. >
You are right, I went through the autofs module code and it is using 'content' and not 'source' for the maps: https://github.com/pdxcat/puppet-module-autofs/blob/master/manifests/mount.pp So far, with hourly checkins there are no issues at all. It is not really a big deal for us. Thanks for your help! -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-users/af54e20b-a6ab-4357-9080-616fc8cc00be%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
