Re: LOAD DATA problem

2012-03-21 Thread Sean McNamara
ache.org>> Subject: Re: LOAD DATA problem We also do the check before loading the file into hive, but we're not very happy with this solution. A hack on the backend is better since a hack on the front end has to happen for every file while a hack on the backend would actually ha

Re: LOAD DATA problem

2012-03-21 Thread Gabi D
nd return an exit > > code (what it used to do) > > Re-copy over the existing file (less preferable, but it would be a nice > if > > there was a flag to do this) > > > > > > For now as a hack I first check if the file already exists in hdfs > before I >

Re: LOAD DATA problem

2012-03-20 Thread Edward Capriolo
atomic would be ideal. > > Sean > > > From: Gabi D > Reply-To: > Date: Tue, 20 Mar 2012 17:59:37 +0200 > To: > Subject: Re: LOAD DATA problem > > Hi Edward, > thanks for looking into this. > what fix 2296 does is not so good. It kind of messes with my f

Re: LOAD DATA problem

2012-03-20 Thread Sean McNamara
From: Gabi D mailto:gabi...@gmail.com>> Reply-To: mailto:user@hive.apache.org>> Date: Tue, 20 Mar 2012 17:59:37 +0200 To: mailto:user@hive.apache.org>> Subject: Re: LOAD DATA problem Hi Edward, thanks for looking into this. what fix 2296 does is not so good. It kind of mes

Re: LOAD DATA problem

2012-03-20 Thread Gabi D
nged behavior caught us off guard. > > > > I haven't found a solution in my sleuthing tonight. Indeed, any help > would > > be greatly appreciated on this! > > > > Sean > > > > From: Gabi D > > Reply-To: > > Date: Tue, 20 Mar 2012 10:03:0

Re: LOAD DATA problem

2012-03-20 Thread Edward Capriolo
> I haven't found a solution in my sleuthing tonight.  Indeed, any help would > be greatly appreciated on this! > > Sean > > From: Gabi D > Reply-To: > Date: Tue, 20 Mar 2012 10:03:04 +0200 > To: > Subject: Re: LOAD DATA problem > > Hi Vikas, > we are facin

Re: LOAD DATA problem

2012-03-20 Thread Edward Capriolo
the only one scratching my head on this one!  The > changed behavior caught us off guard. > > I haven't found a solution in my sleuthing tonight.  Indeed, any help would > be greatly appreciated on this! > > Sean > > From: Gabi D > Reply-To: > Date: Tue, 20 Mar

Re: LOAD DATA problem

2012-03-20 Thread Sean McNamara
-To: mailto:user@hive.apache.org>> Date: Tue, 20 Mar 2012 10:03:04 +0200 To: mailto:user@hive.apache.org>> Subject: Re: LOAD DATA problem Hi Vikas, we are facing the same problem that Sean reported and have also noticed that this behavior changed with a newer version of hive. Previousl

Re: LOAD DATA problem

2012-03-20 Thread Gabi D
Hi Vikas, we are facing the same problem that Sean reported and have also noticed that this behavior changed with a newer version of hive. Previously, when you inserted a file with the same name into a partition/table, hive would fail the request (with yet another of its cryptic messages, an issue

Re: LOAD DATA problem

2012-03-20 Thread hadoop hive
hey Sean, its becoz you are appending the file in same partition with the same name(which is not possible) you must change the file name before appending into same partition. AFAIK, i don't think that there is any other way to do that, either you can you partition name or the file name. Thanks V

LOAD DATA problem

2012-03-19 Thread Sean McNamara
Is there a way to prevent LOAD DATA LOCAL INPATH from appending _copy_1 to logs that already exist in a partition? If the log is already in hdfs/hive I'd rather it fail and give me an return code or output saying that the log already exists. For example, if I run these queries: /usr/local/hive