Re: [GENERAL] Considering Solid State Drives

2010-11-11 Thread Joachim Worringen
Am 11.11.2010 16:40, schrieb David Siebert: ZFS has an option to use an SSD as cache for the spinning drives. ZFS under Solaris has turned in some really good IO numbers. The problem is with the new Sun I am not feeling so good about the open nature of Solaris. ZFS performance under BSD I have re

Re: [GENERAL] coping with failing disks

2010-09-02 Thread Joachim Worringen
Am 02.09.2010 16:32, schrieb Vick Khera: On Thu, Sep 2, 2010 at 8:16 AM, Joachim Worringen wrote: Would the consistency of the database be affected if all indices are suddenly gone? The unique constraint is implemented as a unique index. So I'd say "yeah, you could break your c

[GENERAL] coping with failing disks

2010-09-02 Thread Joachim Worringen
Greetings, we are setting up a new database server with quite some disks for our inhouse Postgresql-based "data warehouse". We are considering to use separate sets of disks for indices (index space on SSDs in this case) and a table space for tables which are used as temporary tables (but for

Re: [GENERAL] INSERTing lots of data

2010-06-01 Thread Joachim Worringen
On 06/01/2010 05:45 AM, Greg Smith wrote: Two thoughts. First, build a test performance case assuming it will fail to scale upwards, looking for problems. If you get lucky, great, but don't assume this will work--it's proven more difficult than is obvious in the past for others. Second, if you d

Re: [GENERAL] INSERTing lots of data

2010-05-28 Thread Joachim Worringen
On 05/28/2010 02:55 PM, Craig Ringer wrote: On 28/05/10 17:41, Joachim Worringen wrote: Greetings, my Python application (http://perfbase.tigris.org) repeatedly needs to insert lots of data into an exsting, non-empty, potentially large table. Currently, the bottleneck is with the Python

Re: [GENERAL] INSERTing lots of data

2010-05-28 Thread Joachim Worringen
On 05/28/2010 11:48 AM, Szymon Guz wrote: Remember about Python's GIL in some Python implementations so those threads could be serialized at the Python level. My multi-threaded queries scale nicely with Python 2.6 on Linux, so this is not an issue here. But the queries do not perform concurren

[GENERAL] INSERTing lots of data

2010-05-28 Thread Joachim Worringen
Greetings, my Python application (http://perfbase.tigris.org) repeatedly needs to insert lots of data into an exsting, non-empty, potentially large table. Currently, the bottleneck is with the Python application, so I intend to multi-thread it. Each thread should work on a part of the input fi