Re: Data Warehouse on MySQL questions

2008-04-07 Thread Dre
Hey Baron, Your blog post was quite informative; your suggestion to use a combination of merged MyISAM tables and InnoDB for the live partition made a lot of sense, and it sounds like the path I'll need to follow. I appreciate the information! Baron Schwartz wrote: Hi, I'll just address th

Re: Data Warehouse on MySQL questions

2008-04-06 Thread Baron Schwartz
Hi, I'll just address the things others didn't answer. On Thu, Apr 3, 2008 at 2:28 PM, Dre <[EMAIL PROTECTED]> wrote: > 1) Several sources seem to suggest MyISAM is a good choice for data > warehousing, but due to my lack of experience in a transaction-less world, One approach you might conside

Re: Data Warehouse on MySQL questions

2008-04-03 Thread Perrin Harkins
On Thu, Apr 3, 2008 at 2:28 PM, Dre <[EMAIL PROTECTED]> wrote: > 1) Several sources seem to suggest MyISAM is a good choice for data > warehousing, but due to my lack of experience in a transaction-less world, > this makes me a little nervous. MyISAM has the advantage of very fast loading. It's

Re: Data Warehouse on MySQL questions

2008-04-03 Thread Gary Richardson
I've built several datamarts using perl and MySQL. The largest ones have been up to about 30GB, so I'm not quite on your scale. for #1, I have an etl_id in the fact table so I can track back any particular ETL job. I typically make it a dimension and include date, time, software version, etc. That