RE: Difference between RC file format & Parquet file format

2016-02-17 Thread Abhishek Dubey
I think it's fair to say that one of the main differences is the representation of nesting structure. Parquet uses Dremel's repetition and definition levels, which is an extremely efficient representation of nested structure that has the added benefit of being easy to embed into the column data

How to find hive version using hive editor in hue ?

2016-02-17 Thread Abhishek Dubey
Thanks in advance.. Warm Regards, Abhishek Dubey

Re: Tez issues with beeline via HS2

2016-02-17 Thread Gopal Vijayaraghavan
> * i used Gopal's fragment for tez-site.xml >(https://github.com/t3rmin4t0r/tez-autobuild/blob/llap/tez-site.xml.frag) Please check that the tez.lib.uris is filled out properly. I suspect it's all already setup since the CLI mode works anyway, but cross-check that the HS2 classpath does have

Tez issues with beeline via HS2

2016-02-17 Thread Stephen Sprague
Hi guys, it was suggested i post to the user@hive group rather than the user@tez group for this one. Here's my issue. My query hangs when using beeline via HS2 (but works with the local beeline client). I'd like to overcome that. This is my query: beeline -u 'jdbc:hive2:// dwrdevnn1.sv2.trui

RE: Difference between RC file format & Parquet file format

2016-02-17 Thread Ryan Harris
ORC files = optimized RC files https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ORC Parquet is similar to ORC, but a bit different. http://parquet.apache.org/documentation/latest/ Parquet is a bit more of a "standard" file format outside of Hive, while ORC files are primarily us

Difference between RC file format & Parquet file format

2016-02-17 Thread Ravi Prasad
Hi all, Can you please let me know, How the RC file format is different from the Parquet file format. Both are column oriented file format, then what are the difference. -- -- Regards, RAVI PRASAD. T

CVE-2015-7521: Apache Hive authorization bug disclosure (update)

2016-02-17 Thread Sushanth Sowmyan
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 CVE-2015-7521: Apache Hive authorization bug disclosure Severity: Important Vendor: The Apache Software Foundation Versions Affected: Apache Hive 0.13.x Apache Hive 0.14.x Apache Hive 1.0.0 - 1.0.1 Apache Hive 1.1.0 - 1.1.1 Apache Hive 1.2.0 - 1.2.1

Alter Index on Column Query consumes huge memory

2016-02-17 Thread Prabhu Joseph
Hi All, When rebuilding index on a table, where abc is an index on a column which has 8.5 lakh count for a single column value, the mapreduce job ran and the reducers timing out, when we monitored the reducers, it is taking 7.3GB RSS and 7.5GB Virt, the reducer memory configured is 7GB. The tas

Re: How can we find Hive version from Hive CLI or Hive shell?

2016-02-17 Thread Chandeep Singh
In order to run a unix shell command from hive you need to add ! to the beginning For example in your case: hive> ! hive --version; Hive 1.1.0-cdh5.4.8 Subversion file:///data/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hive-1.1.0-cdh5.4.8 -r Unknown Compiled by jenkins on Thu

RE: How can we find Hive version from Hive CLI or Hive shell?

2016-02-17 Thread Mich Talebzadeh
hive --version Hive 1.2.1 On 17/02/2016 06:25, Abhishek Dubey wrote: > Well thanks for the reply but it didn't seems to work at my side. > > To be more precise, I want to determine hive version while hive is running > like by querying or something... > > THANKS & REGARDS, > ABHISHEK DUB

Re: How can we find Hive version from Hive CLI or Hive shell?

2016-02-17 Thread Takanobu Asanuma
How about this way? hive> !hive --version; Hive 1.2.1 Regards, Takanobu Asanuma From: Abhishek Dubey mailto:abhishek.du...@xoriant.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: 2016年2月17日水曜日 15:25 To: "user@hive.apache.org

Re: How can we find Hive version from Hive CLI or Hive shell?

2016-02-17 Thread Prasanth Jayachandran
hive —version is supported from 0.13.0 onwards. This is an option to the hive script and not a command that you can run inside cli. If you are looking to find version via query then you can write a custom UDF similar to https://issues.apache.org/jira/browse/HIVE-12983 Thanks Prasanth On Feb 17