Re: Apache Sqoop code compilation

2014-11-16 Thread Abraham Elmahrek
Also, +1 on using Sqoop2. It sounds like you'll need incremental imports though: https://issues.apache.org/jira/browse/SQOOP-1168. This is slotted for Sqoop 1.99.5 ( https://cwiki.apache.org/confluence/display/SQOOP/Sqoop+2+Roadmap). -Abe On Sun, Nov 16, 2014 at 1:09 PM, Abraham Elmahrek wrote:

Re: Apache Sqoop code compilation

2014-11-16 Thread Abraham Elmahrek
P1: It sounds like the table containing your dimensions exists. So you should be able to wait for the dimension tables with a bash script or free form query ( http://sqoop.apache.org/docs/1.4.5/SqoopUserGuide.html#_free_form_query_imports). For instance, a free-form query can be used to limit the d

RE: Apache Sqoop code compilation

2014-11-16 Thread Shad Amez
: Apache Sqoop code compilation Hi Abe, I have two problems which I google around but didn't find a solution P1 - Handling late arriving dimensions. What it means I am getting the fact data with dimension details which don't exist in our data ware house already. I am thinking to write an

Re: Apache Sqoop code compilation

2014-11-16 Thread Mohan Goyal
Hi Abe, I have two problems which I google around but didn’t find a solution P1 - Handling late arriving dimensions. What it means I am getting the fact data with dimension details which don’t exist in our data ware house already. I am thinking to write an extension using Sqoop. This extension w

Re: Apache Sqoop code compilation

2014-11-16 Thread Abraham Elmahrek
Hey Mohan, I sometimes have to kill my .m2 and .ivy2 directories to get every thing to work. Instead of compiling from source, have you tried downloading a binary? Or using a big top distribution (http://bigtop.apache.org/)? Or using a vendor distribution? -Abe On Sun, Nov 16, 2014 at 11:28 AM,

Re: Apache Sqoop code compilation

2014-11-16 Thread Mohan Goyal
Please help setting up my development environment. I followed again today the development instructions provided at https://cwiki.apache.org/confluence/display/SQOOP/Setting+up+Development+Environment I am a Mac user and that is only difference. Mohan On Nov 16, 2014, at 9:58 AM, Jarek Jarcec

Re: Apache Sqoop code compilation

2014-11-16 Thread Jarek Jarcec Cecho
Hi Mohan, I’m adding Sqoop dev mailing list, please subscribe to the list in order to see responses on this email thread. Jarcec > On Nov 16, 2014, at 9:32 AM, Mohan Goyal wrote: > > Dear Jarek, > > First of all my appology reaching out to you directly. And please allow me to > introduce mys