python etl tool

2011-01-01 Thread krishna kumar
can u please list out the etl tool which has been devloped in python and it is being used in market now? or just list me the etl tools developed in python? Thanks Krishnakumar.A -- http://mail.python.org/mailman/listinfo/python-list

Re: etl tool!!!!!

2010-12-29 Thread meitham
BOn Dec 28, 1:14 pm, Stefan Sonnenberg-Carstens wrote: > Am 28.12.2010 13:57, schrieb krishna kumar:> Is there any efficient etl tool > developed in python? > > Yes, Python. I use SQLAlchemy for both sources and targets, just because I hate to type sql queries :-) I am convin

Re: etl tool!!!!!

2010-12-28 Thread Adam Tauno Williams
On Tue, 2010-12-28 at 07:57 -0500, krishna kumar wrote: > Is there any efficient etl tool developed in python? What does "efficient" mean to you? I work on a Python workflow solution that I use to do ETL. <https://sourceforge.net/projects/coils/> <https://lists.sourcefo

Re: etl tool!!!!!

2010-12-28 Thread Stefan Sonnenberg-Carstens
Am 28.12.2010 13:57, schrieb krishna kumar: Is there any efficient etl tool developed in python? Yes, Python. -- http://mail.python.org/mailman/listinfo/python-list

etl tool!!!!!

2010-12-28 Thread krishna kumar
Is there any efficient etl tool developed in python? -- http://mail.python.org/mailman/listinfo/python-list

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-10-02 Thread M.-A. Lemburg
Tony Schmidt wrote: > Hi, Marc-Andre - well, so far you seem to be the only one suggesting > that cross-database joins is the way to go - everyone else has been > telling me to build a warehouse. I initially was trying to avoid the > warehouse idea to "avoid going through the external temporary >

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-29 Thread Jim
On this post, you are talking about Talend and Informatica like both are comparable... indeed both tools are comparable in power and functionality. But keep in mind Informatica is a proprietary solution, with no access to the code. You have a license fee + other costs associated to the use of Infa.

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-24 Thread Tony Schmidt
Hi, Marc-Andre - well, so far you seem to be the only one suggesting that cross-database joins is the way to go - everyone else has been telling me to build a warehouse. I initially was trying to avoid the warehouse idea to "avoid going through the external temporary resource", as you say. But th

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-24 Thread M.-A. Lemburg
snfctech wrote: > @Lemburg: Thanks for the suggestion. I'm sure you make a fine > product, but my development platform is Linux, and I don't want any > additional Windows servers to deal with (than the ones I'm already > stuck with.) Strange, EasySoft used to support their product on Linux as wel

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-24 Thread Tony Schmidt
@Martin: Thanks for your great feedback. So do you think it would be very beneficial for me to start with an Inman or Kimball book? Or do you think it would be just leisure reading and not very practical at best - fill my head with needless jargon and inflexible dogmas, at worst? I took a datab

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-23 Thread Martin P. Hellwig
Tony Schmidt wrote: So do you think it would be very beneficial for me to start with an Inman or Kimball book? Or do you think it would be just leisure reading and not very practical at best - fill my head with needless jargon and inflexible dogmas, at worst? You have an unique opportunity he

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-23 Thread Martin P. Hellwig
snfctech wrote: @Martin: I originally thought that there was nothing "magical" about building a data warehouse, but then I did a little research and received all sorts of feedback about how data warehouse projects have notorious failure rates, that data warehouse design IS different than normal

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-23 Thread snfctech
@Lemburg: Thanks for the suggestion. I'm sure you make a fine product, but my development platform is Linux, and I don't want any additional Windows servers to deal with (than the ones I'm already stuck with.) On Sep 23, 2:02 am, "M.-A. Lemburg" wrote: > snfctech wrote: > > Does anyone have expe

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-23 Thread snfctech
@Martin: I originally thought that there was nothing "magical" about building a data warehouse, but then I did a little research and received all sorts of feedback about how data warehouse projects have notorious failure rates, that data warehouse design IS different than normal RDBMS - and then t

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-23 Thread nn
On Sep 22, 4:00 pm, snfctech wrote: > Does anyone have experience building a data warehouse in python?  Any > thoughts on custom vs using an out-of-the-box product like Talend or > Informatica? > > I have an integrated system Dashboard project that I was going to > build using cross-vendor joins o

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-23 Thread Martin P. Hellwig
snfctech wrote: Thanks for your replies, Sean and Martin. I agree that the ETL tools are complex in themselves, and I may as well spend that learning curve on a lower-level tool-set that has the added value of greater flexibility. Can you suggest a good book or tutorial to help me build a data

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-23 Thread M.-A. Lemburg
snfctech wrote: > Does anyone have experience building a data warehouse in python? Any > thoughts on custom vs using an out-of-the-box product like Talend or > Informatica? > > I have an integrated system Dashboard project that I was going to > build using cross-vendor joins on existing DBs, but

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-23 Thread Martin P. Hellwig
EAV model and back again, for example) than building your own solution will probably save you money and time (as opposed to learn how to use that ETL tool). This will require you to have at least interest in the following subjects: - Authorization, may everybody use all data or should it be

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-22 Thread snfctech
ransform it at the same time (moving relational data > automatically into a EAV model and back again, for example) than > building your own solution will probably save you money and time (as > opposed to learn how to use that ETL tool). > > This will require you to have at least inter

Re: custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-22 Thread Sean DiZazzo
On Sep 22, 1:00 pm, snfctech wrote: > Does anyone have experience building a data warehouse in python?  Any > thoughts on custom vs using an out-of-the-box product like Talend or > Informatica? > > I have an integrated system Dashboard project that I was going to > build using cross-vendor joins o

custom data warehouse in python vs. out-of-the-box ETL tool

2009-09-22 Thread snfctech
Does anyone have experience building a data warehouse in python? Any thoughts on custom vs using an out-of-the-box product like Talend or Informatica? I have an integrated system Dashboard project that I was going to build using cross-vendor joins on existing DBs, but I keep hearing that a data w