Re: [GENERAL] Postgres and data warehouses

2015-03-11 Thread Brent Tubbs
The logical replication features in 9.4 look very promising as an alternative to the binary replication that requires an identical schema on both ends. There's no reason that the thing you're replicating to couldn't be something like RabbitMQ or Storm. I've been playing with a JSON-based decoder p

Re: [GENERAL] Postgres and data warehouses

2015-03-10 Thread Jim Nasby
On 3/8/15 11:02 PM, Rob Sargent wrote: I expected the latter but … some proprietors like to brag :) Standing down. On Mar 8, 2015, at 9:56 PM, John R Pierce wrote: On 3/8/2015 8:24 PM, Rob Sargent wrote: I strongly suspect many would like further details on your implementation. A user conf

Re: [GENERAL] Postgres and data warehouses

2015-03-09 Thread Jerry Sievers
Nigel Gardiner writes: > I'm looking at making a data warehouse to address our rapidly spiralling > report query times against the OLTP. I'm looking first at what it would take > to make this a > real-time data warehouse, as opposed to batch-driven. > > One approach I've seen used to achieve re

Re: [GENERAL] Postgres and data warehouses

2015-03-08 Thread Rob Sargent
I expected the latter but … some proprietors like to brag :) Standing down. > On Mar 8, 2015, at 9:56 PM, John R Pierce wrote: > > On 3/8/2015 8:24 PM, Rob Sargent wrote: >> I strongly suspect many would like further details on your implementation. A >> user conference session well recorded pe

Re: [GENERAL] Postgres and data warehouses

2015-03-08 Thread John R Pierce
On 3/8/2015 8:24 PM, Rob Sargent wrote: I strongly suspect many would like further details on your implementation. A user conference session well recorded perhaps? the details are proprietary and quite specific to our workload and requirements. -- john r pierce

Re: [GENERAL] Postgres and data warehouses

2015-03-08 Thread Rob Sargent
I strongly suspect many would like further details on your implementation. A user conference session well recorded perhaps? > On Mar 8, 2015, at 4:57 PM, John R Pierce wrote: > >> On 3/8/2015 7:40 AM, Nigel Gardiner wrote: >> I'm looking at making a data warehouse to address our rapidly spirall

Re: [GENERAL] Postgres and data warehouses

2015-03-08 Thread John R Pierce
On 3/8/2015 7:40 AM, Nigel Gardiner wrote: I'm looking at making a data warehouse to address our rapidly spiralling report query times against the OLTP. I'm looking first at what it would take to make this a real-time data warehouse, as opposed to batch-driven. we use a hybrid architecture.

Re: [GENERAL] Postgres and data warehouses

2015-03-08 Thread Bill Moran
On Sun, 8 Mar 2015 11:20:16 -0400 Stephen Frost wrote: > * Nigel Gardiner (nigelgardi...@gmail.com) wrote: > > I've had a quick search and haven't seen this approach used yet, but I was > > thinking, the asynchronous replication of Postgres databases could be used > > as a streaming journal of ch

Re: [GENERAL] Postgres and data warehouses

2015-03-08 Thread Stephen Frost
* Nigel Gardiner (nigelgardi...@gmail.com) wrote: > I've had a quick search and haven't seen this approach used yet, but I was > thinking, the asynchronous replication of Postgres databases could be used > as a streaming journal of changes to be processed by a data warehouse. The > other approach t

[GENERAL] Postgres and data warehouses

2015-03-08 Thread Nigel Gardiner
I'm looking at making a data warehouse to address our rapidly spiralling report query times against the OLTP. I'm looking first at what it would take to make this a real-time data warehouse, as opposed to batch-driven. One approach I've seen used to achieve real time data warehousing is to have mi