Re: How to load csv data into HIVE

2012-09-08 Thread praveenesh kumar
; > Regards > Bejoy KS > > Sent from handheld, please excuse typos. > -- > *From: * "Connell, Chuck" > *Date: *Sat, 8 Sep 2012 12:18:33 + > *To: *user@hive.apache.org > *ReplyTo: * user@hive.apache.org > *Subject: *RE: How

Re: How to load csv data into HIVE

2012-09-08 Thread Bejoy KS
can be loaded into hive table. Regards Bejoy KS Sent from handheld, please excuse typos. -Original Message- From: "Connell, Chuck" Date: Sat, 8 Sep 2012 12:18:33 To: user@hive.apache.org Reply-To: user@hive.apache.org Subject: RE: How to load csv data into HIVE I would li

RE: How to load csv data into HIVE

2012-09-08 Thread Connell, Chuck
not individual lines/records. How would you do this? Thanks very much, Chuck From: praveenesh kumar [praveen...@gmail.com] Sent: Saturday, September 08, 2012 7:54 AM To: user@hive.apache.org Subject: Re: How to load csv data into HIVE You can use hadoop streamin

Re: How to load csv data into HIVE

2012-09-08 Thread praveenesh kumar
> scripts are. >>> >>> ** ** >>> >>> ** ** >>> >>> ** ** >>> >>> *From:* Sandeep Reddy P [mailto:sandeepreddy.3...@gmail.com] >>> *Sent:* Friday, September 07, 2012 10:42 AM >>> *To:* user@hive.apache.org >&g

Re: How to load csv data into HIVE

2012-09-07 Thread Sandeep Reddy P
t; >> ** ** >> >> ** ** >> >> *From:* Sandeep Reddy P [mailto:sandeepreddy.3...@gmail.com] >> *Sent:* Friday, September 07, 2012 10:42 AM >> *To:* user@hive.apache.org >> *Subject:* Re: How to load csv data into HIVE >> >> ** ** >> &g

Re: How to load csv data into HIVE

2012-09-07 Thread Mohammad Tariq
lot depends on how clever your > scripts are. > > ** ** > > ** ** > > ** ** > > *From:* Sandeep Reddy P [mailto:sandeepreddy.3...@gmail.com] > *Sent:* Friday, September 07, 2012 10:42 AM > *To:* user@hive.apache.org > *Subject:* Re: How to load csv data into

RE: How to load csv data into HIVE

2012-09-07 Thread Connell, Chuck
I cannot promise which is faster. A lot depends on how clever your scripts are. From: Sandeep Reddy P [mailto:sandeepreddy.3...@gmail.com] Sent: Friday, September 07, 2012 10:42 AM To: user@hive.apache.org Subject: Re: How to load csv data into HIVE Hi, I wrote a shell script to get csv data

Re: How to load csv data into HIVE

2012-09-07 Thread Mohammad Tariq
Hello Sandeep, I would suggest you to write a MapReduce job instead of usual sequential program to transform your files. It would be much faster. Then use Hive to load the data. Regards, Mohammad Tariq On Fri, Sep 7, 2012 at 8:11 PM, Sandeep Reddy P wrote: > Hi, > I wrote a shell scrip

Re: How to load csv data into HIVE

2012-09-07 Thread Sandeep Reddy P
Hi, I wrote a shell script to get csv data but when i run that script on a 12GB csv its taking more time. If i run a python script will that be faster? On Fri, Sep 7, 2012 at 10:39 AM, Connell, Chuck wrote: > How about a Python script that changes it into plain tab-separated text? > So it would

RE: How to load csv data into HIVE

2012-09-07 Thread Connell, Chuck
How about a Python script that changes it into plain tab-separated text? So it would look like this... 17496927414-mar-20063522876 14-mar-200650308651 etc... Tab-separated with newlines is easy to read and works perfectly on import. Chuck Connell Nuance R&D Data Team Burlington, MA 781-565

Re: How to load csv data into HIVE

2012-09-07 Thread Abhishek
So are you trying get rid of double quotes and pipe symbol?? Regards Abhi Sent from my iPhone On Sep 7, 2012, at 10:18 AM, Sandeep Reddy P wrote: > Hi, > Here is the sample data > "174969274","14-mar-2006"," > 3522876","","14-mar-2006","50308","65","1"| > "174969275","19-jul-2006","352315