Re: why need set hive.server2.enable.doAs=false in SQL-Standard Based Authorization

2016-08-19 Thread Sushanth Sowmyan
One more addition to what Thejas mentioned - BitSetCheckAuthorizationProvider was the old legacy method of authorization in hive that was replaced in use-intent by SQLStandardAuthorization. I think we should look to deprecating and removing that now. In general, if you want conventional db-like gr

Re: [ANNOUNCE] New PMC Member : Pengcheng

2016-07-17 Thread Sushanth Sowmyan
Welcome aboard Pengcheng! :) On Jul 17, 2016 12:01, "Lefty Leverenz" wrote: > Congratulations Pengcheng! > > -- Lefty > > On Sun, Jul 17, 2016 at 1:03 PM, Ashutosh Chauhan > wrote: > >> > >> > Hello Hive community, >> > >> > I'm pleased to announce that Pengcheng Xiong has accepted the Apache >

Re: [ANNOUNCE] New PMC Member : Jesus

2016-07-17 Thread Sushanth Sowmyan
Good to have you onboard, Jesus! :) On Jul 17, 2016 12:00, "Lefty Leverenz" wrote: > Congratulations Jesus! > > -- Lefty > > On Sun, Jul 17, 2016 at 1:01 PM, Ashutosh Chauhan > wrote: > >> Hello Hive community, >> >> I'm pleased to announce that Jesus Camacho Rodriguez has accepted the >> Apach

Re: [VOTE] Bylaws change to allow some commits without review

2016-04-14 Thread Sushanth Sowmyan
+1 On Apr 13, 2016 17:20, "Prasanth Jayachandran" < pjayachand...@hortonworks.com> wrote: > +1 > > Thanks > Prasanth > > > > > On Wed, Apr 13, 2016 at 5:14 PM -0700, "Navis Ryu" > wrote: > > not sure I'm active PMC member but +1, anyway. > > 2016년 4월 14일 목요일, Lars Francke님이 작성한 메시지: > >> Hi every

CVE-2015-7521: Apache Hive authorization bug disclosure (update)

2016-02-17 Thread Sushanth Sowmyan
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 CVE-2015-7521: Apache Hive authorization bug disclosure Severity: Important Vendor: The Apache Software Foundation Versions Affected: Apache Hive 0.13.x Apache Hive 0.14.x Apache Hive 1.0.0 - 1.0.1 Apache Hive 1.1.0 - 1.1.1 Apache Hive 1.2.0 - 1.2.1

CVE-2015-7521: Apache Hive authorization bug disclosure

2016-01-28 Thread Sushanth Sowmyan
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 CVE-2015-7521: Apache Hive authorization bug disclosure Severity: Important Vendor: The Apache Software Foundation Versions Affected: Apache Hive 1.0.0 - 1.0.1 Apache Hive 1.1.0 - 1.1.1 Apache Hive 1.2.0 - 1.2.1 Description: Some partition-level o

Re: Synchronizing Hive metastores across clusters

2015-12-17 Thread Sushanth Sowmyan
e.org/jira/browse/HIVE-10264 On Thu, Dec 17, 2015 at 11:59 AM, Sushanth Sowmyan wrote: > Hi, > > I think that the replication work added with > https://issues.apache.org/jira/browse/HIVE-7973 is exactly up this > alley. > > Per Eugene's suggestion of MetaStoreEventList

Re: Synchronizing Hive metastores across clusters

2015-12-17 Thread Sushanth Sowmyan
Hi, I think that the replication work added with https://issues.apache.org/jira/browse/HIVE-7973 is exactly up this alley. Per Eugene's suggestion of MetaStoreEventListener, this replication system plugs into that and gets you a stream of notification events from HCatClient for the exact purpose

[ANNOUNCE] Apache Hive 1.2.1 Released

2015-06-28 Thread Sushanth Sowmyan
The Apache Hive team is proud to announce the the release of Apache Hive version 1.2.1. The Apache Hive (TM) data warehouse software facilitates querying and managing large datasets residing in distributed storage. Built on top of Apache Hadoop (TM), it provides: * Tools to enable easy data extra

[ANNOUNCE] Apache Hive 1.2.0 Released

2015-05-18 Thread Sushanth Sowmyan
The Apache Hive team is proud to announce the the release of Apache Hive version 1.2.0. The Apache Hive (TM) data warehouse software facilitates querying and managing large datasets residing in distributed storage. Built on top of Apache Hadoop (TM), it provides: * Tools to enable easy data e

Re: [ANNOUNCE] New Hive Committers - Prasanth J and Vaibhav Gumashta

2014-04-25 Thread Sushanth Sowmyan
Congrats, guys! :) On Fri, Apr 25, 2014 at 12:33 AM, Lefty Leverenz wrote: > Congratulations! > > -- Lefty > > > On Fri, Apr 25, 2014 at 12:10 AM, Hari Subramaniyan < > hsubramani...@hortonworks.com> wrote: > >> Congrats Prasanth and Vaibhav! >> >> Thanks >> Hari >> >> >> On Thu, Apr 24, 2014 at

Re: [ANNOUNCE] New Hive Committers - Alan Gates, Daniel Dai, and Sushanth Sowmyan

2014-04-14 Thread Sushanth Sowmyan
t;Prasanth Jayachandran" > >>> wrote: > >>>> > >>>> Congratulations everyone!! > >>>> > >>>> Thanks > >>>> Prasanth Jayachandran > >>>> > >>>> On Apr 14,

Re: HCatLoader / HCatStorer use WebHCat?

2013-10-08 Thread Sushanth Sowmyan
Currently, they don't. However, I do see that being potentially useful. On Oct 8, 2013 11:03 AM, "Timothy Potter" wrote: > I use CassandraStorage and HCatalog in my Pig analytics jobs and they are > using different versions of Thrift. I'm curious if the Pig load / store > funcs could use the WebH

Re: JSON format files versus AVRO

2013-10-08 Thread Sushanth Sowmyan
Have you had a look at the JsonSerDe in hcatalog to see if it suits your need? It does not support the format you are suggesting directly, but if you made the unique I'd part of the json object, so that each line was a json record, it would. It's made to be used in conjunction with text tables. A

Re: HCatalog in Hive 0.11

2013-10-03 Thread Sushanth Sowmyan
Hi, The error you're getting seems to be from this piece of code in the metastore: == 4182 String metastorePort = System.getenv("METASTORE_PORT"); 4183 if (metastorePort != null) { 4184 port = Integer.parseInt(metastorePort); 4185 } == Basically, for whatever reason, in your environmen

Re: Hive unit test errors

2013-09-09 Thread Sushanth Sowmyan
and I followed the >> instructions from the Hive wiki to run the unit tests. I don't understand >> why I'd get these errors, for so many times. If anyone who has successfully >> gotten unit tests to pass (those who regularly commit), can they share some >> insights? The doc

Re: Issue in BINARY datatype

2013-09-04 Thread Sushanth Sowmyan
I tried recreating your exact dump with a more recent(built as of about 3 weeks back) hive. And in addition to the base64-decoded version of the binary data, I get some extraneous characters in every line of the select *. (consistently the same extra characters) For eg, an od -c of the first line

Re: How to use HCatalog with Hive?

2013-09-04 Thread Sushanth Sowmyan
Hi, The hcat commandline should be available to you in the hcatalog/bin directory if you used the hive-0.11 binary tarball. That said, the hcat commandline is a simplified stripped down hive commandline, and except for switches like -g, you should be able to use the hive cli for everything you us

Re: Hive unit test errors

2013-09-04 Thread Sushanth Sowmyan
This seems to work for me on trunk. This should work in 0.11 as well, given that the feature it is complaining about was introduced in HIVE-4139, which was committed in hive-0.11. Could you please check your /hive/build/shims/hive-shims-0.11.0.jar (should be the same as /Users/echu/.ivy2/local/org

bz2 compressed table usage?

2013-04-05 Thread Sushanth Sowmyan
Hi folks, Anyone have any experience using bz2 based compressed tables? I have the following .q file: == SET hive.exec.dynamic.partition.mode=nonstrict; SET hive.exec.dynamic.partition=true; SET hive.exec.max.dynamic.partitions=500; SET hive.exec.max.dynamic.partitions.pernode=500; SET hive.exec.