Re: Skewed vs ListBucketing

2014-07-02 Thread Lefty Leverenz
Well, it turns out I dropped the ball on improving the list bucketing docs back in April. See the message thread "Skewed Tables" that Mayur Gupta started on April 21 and Pras

Re: Skewed vs ListBucketing

2014-07-01 Thread Lefty Leverenz
The Skewed Tables section in the DDL wikidoc has more information which might be helpful. HIVE-3649 was just one of several jiras that added list bucketing in releases 0.10 and 0.11. See HIVE-3026

Re: Skewed vs ListBucketing

2014-07-01 Thread Lefty Leverenz
Does anyone have time to answer this? It would be good to clarify things in the wiki. HIVE-3649 added the list bucketing feature in release 0.10.0. The description says: We need to differ normal skewed table from list bucketing table. we use an

Skewed vs ListBucketing

2014-06-27 Thread Steven Willis
I'm having trouble understanding the difference between a skewed table and a list bucketed table: https://cwiki.apache.org/confluence/display/Hive/ListBucketing Is the only difference that ListBucketing stores the data as directories and a "plain" skewed table stores them as files? I think that