Re: Tez job submissions failing when cluster is under provisioned..

> This seems to be something YARN fair-scheduler reporting it this way.. >although Tez doesn't seem to handle. Pepperdata? > I did come across HIVE-12957, in which the fix patch seems to only >report the error better instead of doing anything about it. ... > Now comes my question, is this in a

Re: SELECT without FROM

Thank you, Shannon! On Fri, Mar 11, 2016 at 4:47 AM, Shannon Ladymon wrote: > It looks like FROM was made optional in Hive 0.13.0 with HIVE-4144 > (thanks Alan Gates to > pointing us to the grammar file and Sushanth Sowyman for helping track this

Re: Error in Hive on Spark

Thanks for reply I have set the property spark.home in my application. Otherwise the application threw 'SPARK_HOME not found exception'. I found hive source code in SparkClientImpl.java: private Thread startDriver(final RpcServer rpcServer, final String clientId, final String secret) throw

Re: SELECT without FROM

>> any database Just as trivia: i have not used oracle for quite a while but it traditionally does not. AFAICT it is also not ansi sql 2016-03-10 17:47 GMT-08:00 Shannon Ladymon : > It looks like FROM was made optional in Hive 0.13.0 with HIVE-4144 >

Re: SELECT without FROM

It looks like FROM was made optional in Hive 0.13.0 with HIVE-4144 (thanks Alan Gates to pointing us to the grammar file and Sushanth Sowyman for helping track this down). A note has been added to the wiki

Tez job submissions failing when cluster is under provisioned..

Hello, Ran into this today.. We'r seeing Tez jobs failing to submit when cluster is under high load. In particular, the split calculation seems to fall over when it sees # slots <0. This seems to be something YARN fair-scheduler reporting it this way.. although Tez doesn't seem to handle. Vertex

Re: ODBC drivers for Hive 2

The problem with Tableau is that it tries to optimize the code itself which really does not work for something that uses generic ODBC 3. We used to have it with Tableau connecting to Oracle TimesTen IMDB (that did not have its dedicated ODBC driver in Tableau so had to use ODBC 2, even an older ver

Re: ODBC drivers for Hive 2

> If yes, maybe one should think about an open source one, which is >reliable and supports a richer set of Odbc functionality. I had a similar thought last week, which ended up with me discovering that the hive/odbc folder is full of dead code. I'm going to rm -rvf odbc/ with https://issues.apac

Re: ODBC drivers for Hive 2

I guess these vendor drivers are variants of generic ODBC 3 drivers. Some of them like Progress direct do bespoke drivers. They used to be called Merant drivers that made drivers for Oracle, Sybase and so forth and now rebadged as Progress DataDirect ODBC drivers. The issue is that I don't intend

Re: Hive Cli ORC table read error with limit option

Alternatively you can send orcfiledump output for the empty orc file from broken partition. Thanks Prasanth On Mar 10, 2016, at 5:11 PM, Prasanth Jayachandran mailto:pjayachand...@hortonworks.com>> wrote: Could you attach the emtpy orc files from one of the broken partition somewhere? I can ru

Re: Hive Cli ORC table read error with limit option

Could you attach the emtpy orc files from one of the broken partition somewhere? I can run some tests on it to see why its happening. Thanks Prasanth On Mar 8, 2016, at 12:02 AM, Biswajit Nayak mailto:biswa...@altiscale.com>> wrote: Both the parameters are set to false by default. hive> set h

Re: Hive alter table concatenate loses data - can parquet help?

After hive 1.2.1 there is one patch that went in related to alter table concatenation. https://issues.apache.org/jira/browse/HIVE-12450 I am not sure if its related though. Could you please file a bug for this? It will be great if you can attach a small enough repro for this issue. I can verify

Re: ODBC drivers for Hive 2

Just out of curiosity: what is the code base for the odbc drivers by Hortonworks, cloudera & co? Did they develop them on their own? If yes, maybe one should think about an open source one, which is reliable and supports a richer set of Odbc functionality. Especially in the light of Orc,parque

Re: ODBC drivers for Hive 2

I've had the best luck with the Hortonworks driver (32-bit Windows). The Cloudera and Microsoft ones have seemed flaky (crashes, some SQL not supported). I haven't tried the Data Direct driver. Cheers, Toby. On Fri, Mar 11, 2016 at 4:46 AM, Mich Talebzadeh wrote: > Hi, > > The best ODBC drivers

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

Thanks folks! I'm happy to be part of the community and able to contribute! Thanks, Wei From: Eugene Koifman mailto:ekoif...@hortonworks.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Thursday, March 10, 2016 at 10:25 To: "user@hive.apache

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

Congratulations! From: Hari Sivarama Subramaniyan mailto:hsubramani...@hortonworks.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Thursday, March 10, 2016 at 10:02 AM To: "user@hive.apache.org" mailto:user@hiv

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

?Congrats Wei. Thanks Hari From: Pengcheng Xiong Sent: Thursday, March 10, 2016 9:50 AM To: user@hive.apache.org Cc: d...@hive.apache.org; w...@apache.org Subject: Re: [ANNOUNCE] New Hive Committer - Wei Zheng Big congrats Wei! Pengcheng On Thu, Mar 10, 2016

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

Big congrats Wei! Pengcheng On Thu, Mar 10, 2016 at 9:25 AM, Vijay K.N wrote: > Congrats Wei Zheng!! > On Mar 10, 2016 6:57 AM, "Vikram Dixit K" wrote: > >> The Apache Hive PMC has voted to make Wei Zheng a committer on the Apache >> Hive Project. Please join me in congratulating Wei. >> >> Th

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

Congrats Wei Zheng!! On Mar 10, 2016 6:57 AM, "Vikram Dixit K" wrote: > The Apache Hive PMC has voted to make Wei Zheng a committer on the Apache > Hive Project. Please join me in congratulating Wei. > > Thanks > Vikram. >

what are the exact performance criteria when you are comparing pig and hive?

HI I've gone through https://issues.apache.org/jira/browse/HIVE-396 benchmarks. My question is can we generalize that hive will be faster in all the use cases. - weblogs - xml - json Does hive performance depend on different use cases or type of data we are processing? -- *With Re

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

Congrats Wei! From: Madhu Thalakola mailto:madhu8...@yahoo.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>>, Madhu Thalakola mailto:madhu8...@yahoo.com>> Date: Thursday, March 10, 2016 at 2:47 PM To: "user@hive.apache.org

Re: 答复: [ANNOUNCE] New Hive Committer - Wei Zheng

Congrats, Wei! On Thu, Mar 10, 2016 at 6:49 AM, Daniel Lopes wrote: > \o/ > > On Thu, Mar 10, 2016 at 11:31 AM, 谭成灶 wrote: > >> Congratulations, Wei ! >> >> -- >> 发件人: Madhu Thalakola >> 发送时间: ‎2016/‎3/‎10 21:47 >> 收件人: user@hive.apache.org >> 抄送: d...@hive.apache.o

ODBC drivers for Hive 2

Hi, The best ODBC drivers that I found to work with Hive 2 is Progress Data Direct driver for Hive (ODBC 3 compliant).. I tried Cloudera one very shaky (although I tried that on Hive 1.2.1). Tried Microsoft ones but it hangs. Just to be clear I am using 64-bit drivers. This is not direct data fe

Re: impala like formatting of tables inside Hive cli

Try beeline tool to connect to HIve Server2. It may not be that aesthetically close. Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://t

impala like formatting of tables inside Hive cli

Is there a setting that will yield nicely formatted tables as in Impala. I am attaching an example of what I mean.

Re: 答复: [ANNOUNCE] New Hive Committer - Wei Zheng

\o/ On Thu, Mar 10, 2016 at 11:31 AM, 谭成灶 wrote: > Congratulations, Wei ! > > -- > 发件人: Madhu Thalakola > 发送时间: ‎2016/‎3/‎10 21:47 > 收件人: user@hive.apache.org > 抄送: d...@hive.apache.org; w...@apache.org > 主题: Re: [ANNOUNCE] New Hive Committer - Wei Zheng > > Congratu

答复: [ANNOUNCE] New Hive Committer - Wei Zheng

Congratulations, Wei ! 发件人: Madhu Thalakola 发送时间: ‎2016/‎3/‎10 21:47 收件人: user@hive.apache.org 抄送: d...@hive.apache.org; w...@apache.org 主题: Re: [ANNOUNCE

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

Congratulations Wei Zheng Thanks, MAdhu Help ever, Hurt never

Hive StreamingAPI leaves table in not consistent state

Hello, I'm using Hortonworks Data Platform 2.3.4 which includes Apache Hive 1.2.1 and Apache Storm 0.10. I've build Storm topology using Hive Bolt, which eventually using Hive StreamingAPI to stream data into hive table. In Hive I've created transactional table: 1. CREATE EXTERNAL TABLE cdr1 (

Error in Hive on Spark

I am trying out Hive on Spark with hive 2.0.0 and spark 1.4.1, and executing org.apache.hadoop.hive.ql.Driver with java application. Following are my situations: 1.Building spark 1.4.1 assembly jar without Hive . 2.Uploading the spark assembly jar to the hadoop cluster. 3.Executing the java appli

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

Best wishes Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com On 10 March 2016 at 10:48, Loïc Chanel wrote

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

Congratulations ! Loïc CHANEL System & virtualization engineer TO - XaaS Ind - Worldline (Villeurbanne, France) 2016-03-10 11:44 GMT+01:00 Jeff Zhang : > Congratulations, Wei ! > > On Thu, Mar 10, 2016 at 3:27 PM, Lefty Leverenz > wrote: > >> Congratulations! >> >> -- Lefty >> >> On Wed, Mar 9,

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

Congratulations, Wei ! On Thu, Mar 10, 2016 at 3:27 PM, Lefty Leverenz wrote: > Congratulations! > > -- Lefty > > On Wed, Mar 9, 2016 at 10:30 PM, Dmitry Tolpeko > wrote: > >> Congratulations, Wei! >> >> On Thu, Mar 10, 2016 at 5:48 AM, Chao Sun wrote: >> >>> Congratulations! >>> >>> On Wed, M