Re: [GENERAL] Storing files: 2.3TBytes, 17M file count

2016-11-29 Thread Jacob Bunk Nielsen
Thomas Güttler writes: > I have 2.3TBytes of files. File count is 17M > > Up to now we use rsync (via rsnapshot) to backup our data. Isn't putting those files into your database going to make any sort of maintanance on your database cumbersome? How big is your database currently? Is it worth gro

Re: [GENERAL] Next steps in debugging database storage problems?

2014-12-11 Thread Jacob Bunk Nielsen
Hi A final followup from my side to this post for anyone who may find this thread in archives in the future. On the 15th of August Jacob Bunk Nielsen wrote: > On the 1st of July 2014 Jacob Bunk Nielsen wrote: > >> We have a PostgreSQL 9.3.4 running in an LXC container on Debian &g

Re: [GENERAL] Postgres 9.1 issues running data directory from VMware shared folder

2014-08-29 Thread Jacob Bunk Nielsen
"Arze, Cesar" writes: > creating template1 database in /mnt/pg_data/base/1 ... FATAL: could > not open file "pg_xlog/00010001" (log file 0, segment > 1): No such file or directory We've seen something slightly similar when running PostgreSQL in a Linux container. See this thread

Re: [GENERAL] Next steps in debugging database storage problems?

2014-08-15 Thread Jacob Bunk Nielsen
Hi On the 1st of July 2014 Jacob Bunk Nielsen wrote: > We have a PostgreSQL 9.3.4 running in an LXC container on Debian > Wheezy on a Linux 3.10.43 kernel on a Dell R620 server. Data are > stored on a XFS file system. We are seeing problems such as: > > unexpected data beyond EO

Re: [GENERAL] Track changes to function code

2014-07-21 Thread Jacob Bunk Nielsen
Rebecca Clarke writes: > At present when a function is being edited we keep note of when and > by who within comments in the function's code. That sounds cumbersome. > Is there, or can anyone recommend, any open source software that > tracks function activity when it comes to edits (not executi

Re: [GENERAL] pg_dump slower than pg_restore

2014-07-03 Thread Jacob Bunk Nielsen
David Wall writes: > A pg_dump backup -- with most of the data stored as large objects -- > takes about 5 hours. > > But restoring that dump takes about 2 hours. So it's taking 2.5 times > longer to back it up than to restore it. Does top(1) reveal any bottlenecks? Is the backup constrained b

Re: [GENERAL] Next steps in debugging database storage problems?

2014-07-03 Thread Jacob Bunk Nielsen
Hi Jacob Bunk Nielsen writes: > We have a PostgreSQL 9.3.4 running in an LXC container on Debian > Wheezy on a Linux 3.10.43 kernel on a Dell R620 server. Data are > stored on a XFS file system. We are seeing problems such as: > > unexpected data beyond EOF in block 2 of relation

Re: [GENERAL] Two-way encryption

2014-07-01 Thread Jacob Bunk Nielsen
Patrick Simcoe writes: > Does anyone have a technique or recommendation for two-way encryption > which somehow obfuscates the decrypt key so that it isn't easily > retrievable from the database or the application source code? We've > already considered (a) letting users hold the decrypt key and (

[GENERAL] Help debugging database storage problems

2014-07-01 Thread Jacob Bunk Nielsen
Hi We have a PostgreSQL 9.3.4 running in an LXC container on Debian Wheezy on a Linux 3.10.43 kernel on a Dell R620 server. Data are stored on a XFS file system. We are seeing problems such as: unexpected data beyond EOF in block 2 of relation base/805208133/1238511128 and could not read block

[GENERAL] Next steps in debugging database storage problems?

2014-07-01 Thread Jacob Bunk Nielsen
Hi We have a PostgreSQL 9.3.4 running in an LXC container on Debian Wheezy on a Linux 3.10.43 kernel on a Dell R620 server. Data are stored on a XFS file system. We are seeing problems such as: unexpected data beyond EOF in block 2 of relation base/805208133/1238511128 and could not read block