[Announce] New Hive Committer - Mohit Sabharwal

On behalf of the Apache Hive PMC, I'm pleased to announce that Mohit Sabharwal has been voted a committer on the Apache Hive project. Please join me in congratulating Mohit ! Thanks, Szehon

Re: Work on Spark engine for Hive

ch Talebzadeh > > > > LinkedIn * > https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* > > > > http://talebzadehmich.wordpress.com > > > > On 8 April 201

Re: Work on Spark engine for Hive

Yes, that is a good goal we will have to do eventually. I was not aware that it is not working to be honest. Can you let us know what is broken on Hive 2 on Spark 1.6.1? Preferably via filing a JIRA on HIVE side? On Fri, Apr 8, 2016 at 7:47 AM, Mich Talebzadeh wrote: > This is a different thi

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

Congratulations Wei! On Wed, Mar 9, 2016 at 5:26 PM, Vikram Dixit K wrote: > The Apache Hive PMC has voted to make Wei Zheng a committer on the Apache > Hive Project. Please join me in congratulating Wei. > > Thanks > Vikram. >

Re: [ANNOUNCE] New PMC Member : John Pullokkaran

Congratulations! On Tue, Nov 24, 2015 at 3:02 PM, Xuefu Zhang wrote: > Congratulations, John! > > --Xuefu > > On Tue, Nov 24, 2015 at 3:01 PM, Prasanth J > wrote: > >> Congratulations and Welcome John! >> >> Thanks >> Prasanth >> >> On Nov 24, 2015, at 4:59 PM, Ashutosh Chauhan >> wrote: >> >>

Re: Hive Server2 Monitoring

There is ongoing work to add the metrics to HiveServer2 (HIVE-10761), it is in progress for Hive 2.0. This already has some basic metrics like connection and JVM metrics as you mentioned, and we hope to add more soon. Thanks Szehon On Wed, Nov 11, 2015 at 11:43 AM, Udit Mehta wrote: > Yes that

Re: Does Parquet use any default compression?

No compression for now, I am thinking to change new tables to default to snappy compression (HIVE-11912), but haven't done so yet. On Wed, Oct 14, 2015 at 8:52 PM, Yue Liu wrote: > Hi, All, > > I am using Hive-0.14.0, when I create a table stored as parquet, does it > use any default compression

Re: [ANNOUNCE] New Hive PMC Chair - Ashutosh Chauhan

Congrats to Ashutosh and thanks Carl for the years of service! On Wed, Sep 16, 2015 at 2:00 PM, Eugene Koifman wrote: > Congrats! > > From: Pengcheng Xiong > Reply-To: "user@hive.apache.org" > Date: Wednesday, September 16, 2015 at 1:23 PM > To: "user@hive.apache.org" > > Cc: "d...@hive.apach

Re: HiveServer Thrift TTransportException

I've seen this when connecting from a client expecting another authentication mode, check 'hive.server2.authentication' is set to the value expected by the client (ie, NOSASL vs NONE). Thanks Szehon On Tue, Jul 28, 2015 at 8:58 PM, Pengcheng Liang wrote: > Hi all, > > I get a exception on hives

Re: "show databases" doesn't return all databases with Kerberos/Sentry enabled

Hi Liping Do you want to check the Sentry mailing list as well? They might know more about this scenario. Thanks Szehon On Wed, May 13, 2015 at 10:18 AM, Liping Zhang wrote: > Dear all, > > I installed CDH, kerberos, sentry to enable security for hive beeline. I > did following commands: > >

Re: [ANNOUNCE] New Hive Committers - Jimmy Xiang, Matt McCline, and Sergio Pena

Congrats guys! On Mon, Mar 23, 2015 at 11:27 AM, Prasanth Jayachandran < pjayachand...@hortonworks.com> wrote: > Congratulations everyone! > > On Mar 23, 2015, at 11:26 AM, Chinna Rao Lalam < > lalamchinnara...@gmail.com> wrote: > > Congratulations to all... > > On Mon, Mar 23, 2015 at 11:38 P

Re: [ANNOUNCE] New Hive Committers -- Chao Sun, Chengxiang Li, and Rui Li

Congratulations guys ! On Mon, Feb 9, 2015 at 3:38 PM, Jimmy Xiang wrote: > Congrats!! > > On Mon, Feb 9, 2015 at 12:36 PM, Alexander Pivovarov > > wrote: > > > Congrats! > > > > On Mon, Feb 9, 2015 at 12:31 PM, Carl Steinbach wrote: > > > >> The Apache Hive PMC has voted to make Chao Sun, Che

Re: Hive 1.0 vs. 0.15

You are right, as I understand now 0.15 will become 1.1, we probably need to bulk-update all the fix version(s) that are marked as the old one. For now you can treat the 0.15 as meaning 1.1 On Mon, Feb 9, 2015 at 2:41 PM, John Omernik wrote: > Hey all, I was monitoring a specific JIRA for Hive

Re: Parquet support for Timestamp in 0.14

Hi Yang I saw you posted this question in several places, I gave an answer in HIVE-6394 as I saw that one first, to the timestamp query. Can't speak about about date support, as its not in my knowledge. Thanks Szehon On Mon, Feb 2, 2015 at 4:15 PM, Yang wrote: > the parquet spec about logical

Re: [ANNOUNCE] New Hive PMC Members - Szehon Ho, Vikram Dixit, Jason Dere, Owen O'Malley and Prasanth Jayachandran

on behalf of Carl > Steinbach > *Sent:* Wednesday, January 28, 2015 1:15 PM > *To:* d...@hive.apache.org; user@hive.apache.org > *Cc:* sze...@apache.org; vik...@apache.org; jd...@apache.org; Owen > O'Malley; prasan...@apache.org > *Subject:* [ANNOUNCE] New Hive PMC Members - Sze

Re: "org.datanucleus" is already registered

You might have to use 0.13.1 then, as its possible 0.14/trunk *might* call new hadoop API's not in your hadoop version. Thanks Szehon On Thu, Jan 22, 2015 at 1:07 PM, Dmitry Sivachenko wrote: > > > On 22 янв. 2015 г., at 22:18, Szehon Ho wrote: > > > > Yea I think

Re: "org.datanucleus" is already registered

you try an older release of hive that was built against that. Thanks Szehon On Thu, Jan 22, 2015 at 11:09 AM, Dmitry Sivachenko wrote: > On 22 янв. 2015 г., at 21:58, Dmitry Sivachenko > wrote: > > > > > >> On 22 янв. 2015 г., at 21:44, Szehon Ho wrote: > >> &g

Re: "org.datanucleus" is already registered

I've seen this when there are some settings for maven repo that get this jar to be in there twice (duplicate repository). In your case, its picking up from "file:/opt/home/mitya/.m2/repository" and "file:/home/mitya/.m2/repository/" Best to check the maven settings and make sure it is only in the

Re: Re: How to debug Hive0.14 with Hadoop2.5.0 in Eclipse?

g the code. My question is how I can generate an eclipse project > with hadoop 2.5 in the classpath instead of hadoop0.20? > > Wantao > > > > > 在 2014-12-22 15:18:30，"Szehon Ho" 写道： > > I dont know how to run it through eclipse, do you mean run the hiveCLI > c

Re: How to debug Hive0.14 with Hadoop2.5.0 in Eclipse?

I dont know how to run it through eclipse, do you mean run the hiveCLI command line (/bin/hive)? If so, then you have to make sure HADOOP_HOME is set to include the hadoop 2.5.0 jars. There should not be 0.20.2 jars in the classpath. Thanks Szehon On Sun, Dec 21, 2014 at 2:12 AM, vic0777 wro

Re: hive server2 error upgrade hive from 0.10.0 to 0.13.1

Hi That might not work, as it might need a later version of hadoop/yarn, if not the one that comes with cdh5.2. Hive 0.13 was built with Hadoop 2.3.0 Yarn. Thanks Szehon On Wed, Nov 26, 2014 at 11:25 PM, Jander g wrote: > Hi, everybody > > We use Hadoop CDH4.6.0， now i try to upgrade only hiv

Re: Beeline client

Late reply, but I saw a similar issue as described in HIVE-6928, which is fixed. Not sure if its the same issue. You can also try --outputFormat=vertical as a workaround. Thanks Szehon On Sat, Nov 1, 2014 at 12:03 AM, Vikas Parashar wrote: > No Cli, will give you that access. this is all depe

Re: [ANNOUNCE] New Hive PMC Member - Alan Gates

Congratulations, Alan! On Mon, Oct 27, 2014 at 4:17 PM, Hari Subramaniyan < hsubramani...@hortonworks.com> wrote: > Congrats Alan! > > Thanks > Hari > > On Mon, Oct 27, 2014 at 4:08 PM, Vaibhav Gumashta < > vgumas...@hortonworks.com > > wrote: > > > Congratulations Alan! > > > > On Mon, Oct 27, 2

Re: beeline remote client not connecting to hiveserver2

I believe you should be able to put in anything by default. The hive jdbc url is of the form jdbc:hive2://:, is the url correct? Thanks, Szehon On Wed, Jul 2, 2014 at 10:16 AM, Hang Chan wrote: > beeline does not seem to be connecting remotely. It works if I connect > using the embedded clie

Re: Column selection in Hive

Why dont you just use CTAS (Create table as select), putting the 190 columns in the select part? I guess you're maybe asking for any way to not have to type all the columns, but I'm not aware of any. https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-CreateTable

Re: [ANNOUNCE] New Hive Committers - Gopal Vijayaraghavan and Szehon Ho

Thank you all very much, and congrats Gopal! Szehon On Sun, Jun 22, 2014 at 8:42 PM, Carl Steinbach wrote: > The Apache Hive PMC has voted to make Gopal Vijayaraghavan and Szehon Ho > committers on the Apache Hive Project. > > Please join me in congratulating Gopal and Szehon

Re: Rebuild HCatalog

Hi Carlotta, There are some instructions here on building from source, do they help? https://cwiki.apache.org/confluence/display/Hive/GettingStarted#GettingStarted-BuildingHivefromSource Thanks Szehon On Thu, Jun 19, 2014 at 12:42 PM, Carlotta Hicks wrote: > Hi! I have install a couple of

Re: Unable to load data in hive table

ts > partition(cust_prof=1); doesnt work that way > > > On Tue, May 20, 2014 at 2:24 PM, Szehon Ho wrote: > >> In this kind of insert where you mention partition, you need to specify >> which partition. >> >> Example load data local inpath './custs&#

Re: Unable to load data in hive table

In this kind of insert where you mention partition, you need to specify which partition. Example load data local inpath './custs' into table custs partition(cust_prof=1); On Mon, May 19, 2014 at 7:02 PM, Rahul Channe wrote: > I have created the following partitioned table in hive > > create ta

Re: Running a hive script from Java via API.

It is not really recommended anymore, as HiveServer2 with a client is the where the community is focusing now. And JDBC-client supports mode where the HiveServer2 is embedded. Some older product like HiveCLI or Beeline did like what you said, but again this mode might not be fully supported. For

Re: Is the Hive PreCommit Build broken?

Yea the bigtop dev box hosting our jenkins job is out of space, I just bumped a mail on the hive-dev list with more details. Thanks Szehon On Tue, Apr 15, 2014 at 4:33 PM, Anthony Hsu wrote: > Hi, > > Yesterday, I uploaded a new patch to > HIVE-6835

Re: Beeline questions

Hi I tried to answer the best I could, I think beeline logging still can have some improvements. On Tue, Apr 15, 2014 at 7:48 AM, Uber Slacker wrote: > Hi folks. I've been trying out Beeline and have a couple questions. I > haven't seen a ton of documentation or examples of people using Beeline

Re: [ANNOUNCE] New Hive Committers - Alan Gates, Daniel Dai, and Sushanth Sowmyan

Congratulations, guys! On Mon, Apr 14, 2014 at 11:14 AM, Hari Subramaniyan < hsubramani...@hortonworks.com> wrote: > Congrats! > > > On Mon, Apr 14, 2014 at 11:09 AM, Tao Li wrote: > >> Congrats！ >> On Apr 15, 2014 1:55 AM, "Prasanth Jayachandran" < >> pjayachand...@hortonworks.com> wrote: >> >

Re: declaring a List in HiveQL for UDF

I might be wrong, but it seems like it wont be useful, as there is no 'list' Hive data type. Valid complex types are listed here: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Types#LanguageManualTypes-ComplexTypes As for complex literals, say if you want to test a udf that oper

Re: UDF reflect

Hi, according to the description of the reflect UDF, you are trying to call java.util.UUID.hashcode(uidString), which doesnt seem to be an existing method on either java 6/7. http://docs.oracle.com/javase/7/docs/api/java/util/UUID.html#hashCode() Thanks Szehon On Wed, Apr 2, 2014 at 2:13 PM,

Re: Running hive jdbc, local metastore, local mapreduce.

Hi I'm not sure if there's documents, but it should be similar. That is done regularly as part of the Hive build, see the test: /hive/itests/hive-unit/src/test/java/org/apache/hive/jdbc/TestJdbcDriver2.java. You can see that project's pom, if you run it with hadoop-2 profile, then it pulls in had

Re: HiveThrift Service Issue

erGroupInformation > (UserGroupInformation.java:doAs(1411)) - PriviledgedActionException as:root > (auth:SIMPLE) > cause:org.apache.hadoop.sec > > > > On Thursday, March 20, 2014 3:53 PM, Szehon Ho > wrote: > Hi Raj, > > There are map-reduce job logs generated if the MapRedTask fai

Re: HiveThrift Service Issue

Hi Raj, There are map-reduce job logs generated if the MapRedTask fails, those might give some clue. Thanks, Szehon On Thu, Mar 20, 2014 at 12:29 PM, Raj Hadoop wrote: > I am struggling on this one. Can any one throw some pointers on how to > troubelshoot this issue please? > > > On Thursda

Re: read a Hive Map without knowing keys

question > mark. > > Admittedly, "select *?" looks like syntax with an extra wildcard. > > -- Lefty > > > On Tue, Mar 18, 2014 at 3:07 AM, Szehon Ho wrote: > >> You can try to check other string udf's for that case, here >> https://cwiki.apache.org

Re: read a Hive Map without knowing keys

> > More dumb questions. What is "select *?" ? > > > > Also, any hints on how to find whether the map_keys contains a substring? > For example, supposing the map_keys contains emails, I want to see if one > of the emails contains "gmail.com". > > > >

Re: read a Hive Map without knowing keys

Select *? There are other built-in functions like map_keys and map_values you can use in queries on maps. Not sure if this addresses the question. Thanks Szehon On Mon, Mar 17, 2014 at 3:05 PM, Frank Luo wrote: > Is there a way to read Hive Map datatype without knowing keys? > > > > Accordi

Re: data get truncated.

_SEQ ( > value string) > ROW FORMAT DELIMITED LINES TERMINATED BY '\n' > STORED AS SEQUENCEFILE; > > If I understand correctly, is the key and is ignored > when reading and is the row object, however is still being > truncated. Is my schema correct? > &g

Re: data get truncated.

Hi, did you try specifying row, field delimiter on create table ? Thanks Szehon On Fri, Mar 7, 2014 at 5:27 PM, Kim Chew wrote: > I have an input file in Sequence File format which has the format, > > which has the type > > Then I created a table, > > CREATE TABLE if not exists TEST ( >

Re: Versioninfo and platformName issue.

I think you need to explicitly set HADOOP_VERSION to 2.0.0. Can you try? I have seen hive script reading this variable and falling back to running "hadoop version", which in your case it cannot parse due to the cdh suffix. Thanks Szehon On Wed, Dec 11, 2013 at 6:37 AM, Manish wrote: > Adam,

Re: query though hive jdbc cause chinese character become unrecognizable characters

ke a look at >> HIVE-3245<https://issues.apache.org/jira/browse/HIVE-3245> for >> details, and see if that configuration works for you? Make sure your Jdbc >> application's encoding is set correctly to UTF8 like it describes. >> >> Thanks, >> Szehon &g

Re: query though hive jdbc cause chinese character become unrecognizable characters

see if that configuration works for you? Make sure your Jdbc application's encoding is set correctly to UTF8 like it describes. Thanks, Szehon On Fri, Dec 6, 2013 at 12:21 PM, Szehon Ho wrote: > Looks like the issue is tracked from HIVE-3245. I think we need to > support adding enco

Re: query though hive jdbc cause chinese character become unrecognizable characters

Looks like the issue is tracked from HIVE-3245. I think we need to support adding encoding parameter as part of jdbc url similar to mysql jdbc's useUnicode/characterEncoding flags. I can take a look at it if nobody else has. For now, I think you can manually encode the result value from jdbc. T

Re: [ANNOUNCE] New Hive Committers - Jitendra Nath Pandey and Eric Hanson

Congrats, nice work! On Thu, Nov 21, 2013 at 10:14 PM, Prasad Mujumdar wrote: >Congrats!! > > thanks > Prasad > > > > On Thu, Nov 21, 2013 at 3:29 PM, Carl Steinbach wrote: > > > The Apache Hive PMC has voted to make Jitendra Nath Pandey and Eric > Hanson > > committers on the Apache Hive