I'm looking at making a data warehouse to address our rapidly spiralling
report query times against the OLTP. I'm looking first at what it would
take to make this a real-time data warehouse, as opposed to batch-driven.
One approach I've seen used to achieve real time data warehousing is to
have mi
* Nigel Gardiner (nigelgardi...@gmail.com) wrote:
> I've had a quick search and haven't seen this approach used yet, but I was
> thinking, the asynchronous replication of Postgres databases could be used
> as a streaming journal of changes to be processed by a data warehouse. The
> other approach t
On Sun, 8 Mar 2015 11:20:16 -0400
Stephen Frost wrote:
> * Nigel Gardiner (nigelgardi...@gmail.com) wrote:
> > I've had a quick search and haven't seen this approach used yet, but I was
> > thinking, the asynchronous replication of Postgres databases could be used
> > as a streaming journal of ch
I wrote a quick benchmarking script to test various partitioning
strategies. The code is here.
https://gist.github.com/timuckun/954ab6bdce36fa14bc1c
I was astonished at the variability of the timings between the different
variations.
The test data contained 270K records. I did a simple insert i
On 3/8/2015 7:40 AM, Nigel Gardiner wrote:
I'm looking at making a data warehouse to address our rapidly
spiralling report query times against the OLTP. I'm looking first at
what it would take to make this a real-time data warehouse, as opposed
to batch-driven.
we use a hybrid architecture.
I strongly suspect many would like further details on your implementation. A
user conference session well recorded perhaps?
> On Mar 8, 2015, at 4:57 PM, John R Pierce wrote:
>
>> On 3/8/2015 7:40 AM, Nigel Gardiner wrote:
>> I'm looking at making a data warehouse to address our rapidly spirall
Thanks, I mean, how heavy it is in kB.
2015-03-04 12:17 GMT-03:00 John R Pierce :
> On 3/4/2015 7:03 AM, María Griensu wrote:
>
> I need to figure out how can I weight BLOB objects in a table of a DB, I'm
> not expert on this topics, so I appreciate any help you can give me.
>
>
> postgres's equ
Thanks, I mean, how heavy is.
2015-03-04 12:17 GMT-03:00 John R Pierce :
> On 3/4/2015 7:03 AM, María Griensu wrote:
>
> I need to figure out how can I weight BLOB objects in a table of a DB, I'm
> not expert on this topics, so I appreciate any help you can give me.
>
>
> postgres's equivalent o
Hi all,
I'm a student journalist working on a project for our student paper which
lists salaries and positions for every staff member at the university. We
received the data from an FOI request but the university is refusing to
give us primary keys for the data.
The issue we've run into is that i
On 3/8/2015 8:24 PM, Rob Sargent wrote:
I strongly suspect many would like further details on your implementation. A
user conference session well recorded perhaps?
the details are proprietary and quite specific to our workload and
requirements.
--
john r pierce
I expected the latter but … some proprietors like to brag :)
Standing down.
> On Mar 8, 2015, at 9:56 PM, John R Pierce wrote:
>
> On 3/8/2015 8:24 PM, Rob Sargent wrote:
>> I strongly suspect many would like further details on your implementation. A
>> user conference session well recorded pe
On 3/8/2015 11:49 PM, Eli Murray wrote:
Hi all,
I'm a student journalist working on a project for our student paper
which lists salaries and positions for every staff member at the
university. We received the data from an FOI request but the
university is refusing to give us primary keys for
Eli Murray wrote
> Basically, what we'd like to do is create a serial primary key but instead
> of having it increment every row, it needs to check the name and total
> salary columns and only increment if that person doesn't already exist.
So you already have a PK, (Name, Total Salary), but the s
On 3/8/2015 10:32 PM, David G Johnston wrote:
This solves the explicit problem given the assumption that (Name, Total
Salary) is indeed a uniquely identifying constraint.
that constraint seems flawed to me.
--
john r pierce 37N 122W
somewhere on the middle
14 matches
Mail list logo
