On Mon, Jan 9, 2012 at 20:06, Jo Rhett <jrh...@netconsonance.com> wrote: >> On Jan 9, 2012, at 3:31 PM, Daniel Pittman wrote: >> >>> Is there any reasonable estimate for what amount of space you expect one >>> system to use? I realize this likely varies with the report size, but the >>> rate of growth seems high enough that I'm surprised it wasn't mentioned in >>> the installation docs. I mean, it's grown half a gigabyte in the last 6 >>> hours. With that kind of growth rate, you'd expect a warning to provide >>> enough space for it and how to estimate your needs. >> >> That growth rate seems ... excessive. Ultimately, the size of the >> stored data is pretty directly related to the size of your YAML >> reports; can you capture one of those and see how big it is on disk? > > FYI, in 10 hours the database has grown slightly more than 1G. That's an > extensive growth rate. > > Looking at the yaml files, I'm seeing 410k per file * 400 nodes = 160Mb per > 30 minutes. > > Is there really no optimization that is performed on the data stored in the > database?
Sadly, it is true that there is no optimization that is performed on the data store in the database. > Coming up with a few hundred gigabytes of file storage is one > thing. Trying to make mysql perform well with 100Gb database is an entirely > different matter. Yes. It sounds like the current storage of reports isn't going to work well for you, at least if you want to retain history. This is absolutely unfortunate, and is one of the serious shortfalls we are aware of around the Dashboard and StoreConfigs databases. We are working on improving these, but there isn't anything presently public available. Daniel -- ⎋ Puppet Labs Developer – http://puppetlabs.com ♲ Made with 100 percent post-consumer electrons -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-users@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
