Re: Hive performance vs. SQL?

2012-03-19 Thread Maxime Brugidou
>From my experience, if you can fit data in a SQL without sharding or anything, don't ever think twice. Hive is not even comparable. I would rather say that Hive is a nice SQL interface over Hadoop M/R rather than any SQL replacement. If you are running a DWH in SQL and you don't need to grow your

Re: Hive Dynamic Partions - How to avoid overwrite

2011-10-04 Thread Maxime Brugidou
i suspect you can't do that unless you use 0.8 from the wiki: "INSERT INTO will append to the table or partition keeping the existing data in tact. (Note: INSERT INTO syntax is only available starting in version 0.8)" if you don't have 0.8 then I suggest that you partition simply by day in additi

Re: Change in serdeproperties does not update existing partitions

2011-09-13 Thread Maxime Brugidou
t what you are looking for. Use this workaround with care, > you don't want to loose your data in recreating partitions. > > Hope it helps, > Ashutosh > > On Tue, Sep 13, 2011 at 06:03, Maxime Brugidou > wrote: > >> Hello, >> >> I am using Hive 0.7 from

Change in serdeproperties does not update existing partitions

2011-09-13 Thread Maxime Brugidou
Hello, I am using Hive 0.7 from cloudera cdh3u0 and I encounter a strange behavior when I update the serdeproperties of a table (for example for the RegexSerDe). If you have a simple partitioned table like create external table test_table ( id int) partitioned by (day string) row format serd