Re: FW: Custom UDF Loses Depenencies

2019-03-05 Thread Kevin Risden
nk it also mattered if it was a local jar vs a jar on HDFS. Sorry I don't have more info for you :/ I wanted to make sure you knew you weren't crazy and I've seen similar things. Kevin Risden On Tue, Mar 5, 2019 at 6:37 PM Shawn Weeks wrote: > Ok maybe this scenario will sound f

Re: FW: Custom UDF Loses Depenencies

2019-03-05 Thread Kevin Risden
Different classloader potentially inside HS2? I know there used to be some interesting cases of classloading when trying to add custom UDFs. Not sure what the current state is. Kevin Risden On Tue, Mar 5, 2019 at 4:46 PM Shawn Weeks wrote: > Didn't here anything on the dev mailing l

Re: HiveServer2 performance references?

2018-10-16 Thread Kevin Risden
Thanks for the responses. I'll wait to test with HIVE-20621 to see how much that helps. For HIVE-17194, doesn't look like that is documented outside of JIRA currently. It looks like I may have picked up over the wire compression by default. I had assumed it wasn't compressed. Ke

HiveServer2 performance references?

2018-10-15 Thread Kevin Risden
HTTP mode is significantly slower. I searched and didn't find any references to performance of HiveServer2 out of the box. I also didn't see any information about reducing amount of data over the wire with compression. Any pointers would be very helpful. Thanks! Kevin Risden

Re: use jdbc connect to hive2.0

2016-05-04 Thread kevin
t; work. I assume you are trying to have hive.server2.enable.doAs=true. > > I am not sure why you are seeing different behavior with hive 1.2.1 . > > On Wed, May 4, 2016 at 12:27 AM, kevin wrote: > > I found hadoop info is :2016-05-04 13:49:33,785 INFO > > org.apache.had

Re: use jdbc connect to hive2.0

2016-05-04 Thread kevin
hive1.2.1 the problem is gone. is hive2 not match hadoop2.7.1? 2016-05-04 11:29 GMT+08:00 kevin : > hi all; > I use hive-2.0.0 with hadoop2.7.1 when I connect to the hiveserver2 I got > msg : Failed to open new session: java.lang.RuntimeException: > org.apache.hadoop.ipc.Rem

use jdbc connect to hive2.0

2016-05-03 Thread kevin
hi all; I use hive-2.0.0 with hadoop2.7.1 when I connect to the hiveserver2 I got msg : Failed to open new session: java.lang.RuntimeException: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.authorize.AuthorizationException): User: dcos is not allowed to impersonate dcos dcos is

Permanent UDF is only available for HiveCLI

2016-03-04 Thread Kevin Vasko
able for all contexts? In all cases I'm creating the function in the same database (default). -Kevin

Re: Hive Struct Type Restrictions.

2016-03-03 Thread Kevin Vasko
I had a similar issue when using Hive and trying to create a 400+ column table. Are you using HDP or have Apache Atlas anywhere in your ecosystem? If so, try disabling Apache Atlas and see if the issue goes away. My issue seemed be related to the fact that the Apache Atlas system was erroring when

Re: What is the real meaning of negative value in Vertex.

2016-02-18 Thread Kevin Vasko
Typically when I have seen this the jobs were failing. Is yours completing successfully? -Kevin > On Feb 18, 2016, at 4:58 PM, mahender bigdata > wrote: > > Hi , > > Can any one throw some information on below results of TEZ. What is the > real meaning of neg

Hive fails with IOException: Error writing to server on long query

2016-02-18 Thread Kevin Vasko
> is breaking something. I have an application that generates my select > statement with the 400 or so xpaths which is about 60kb worth of text. I am > then just copy and pasting it into the hivecli. I also tried using beeline > and get the same error. Anyone have a suggestion for a workaround? > > > -Kevin

Re: hive1.2.1 on spark 1.5.2

2016-01-26 Thread kevin
Thank you Mich Talebzadeh and Sofia Panagiotidi . I changed my spark version to 1.4.1 , and everything is ok. 2016-01-26 16:45 GMT+08:00 kevin : > hi,all >I tried hive on spark with version hive1.2.1 spark1.5.2. I build spark > witout -Phive . And I test spark cluster stand alone w

hive1.2.1 on spark 1.5.2

2016-01-26 Thread kevin
hi,all I tried hive on spark with version hive1.2.1 spark1.5.2. I build spark witout -Phive . And I test spark cluster stand alone with spark-submit and it is ok. but when I use hive , on spark web-site I can see the hive on spark application ,finally I got error: 16/01/26 16:23:42 INFO slf

Fw: important message

2015-09-16 Thread Fox Kevin M
Hey friend! Check this out http://wgsfaststart.com/putting.php?14mp8 Fox Kevin M

Re: percentile_approx slowness

2014-10-02 Thread Kevin Weiler
be put into a new table? -- Kevin Weiler IT IMC Financial Markets | 233 S. Wacker Drive, Suite 4300 | Chicago, IL 60606 | http://imc-chicago.com/ Phone: +1 312-204-7439 | Fax: +1 312-244-3301 | E-Mail: kevin.wei...@imc-chicago.com<mailto:kevin.wei...@imc-chicago.com> On Sep 25, 2014, at 3

percentile_approx slowness

2014-09-25 Thread Kevin Weiler
13 hours to complete (in the case of 100,000 as my sampling rate). Are there some hive settings I should be investigating to see if I can have this query complete in a reasonable time? -- Kevin Weiler IT IMC Financial Markets | 233 S. Wacker Drive, Suite 4300 | Chicago, IL 60606 | http://imc

Re: Remove duplicate records in Hive

2014-09-10 Thread Kevin Weiler
Whoops, thought this was someone in my office, so obviously you can’t come see me :) -- Kevin Weiler IT IMC Financial Markets | 233 S. Wacker Drive, Suite 4300 | Chicago, IL 60606 | http://imc-chicago.com/ Phone: +1 312-204-7439 | Fax: +1 312-244-3301 | E-Mail: kevin.wei...@imc-chicago.com

Re: Remove duplicate records in Hive

2014-09-10 Thread Kevin Weiler
If you can just query the table for your results, you can do a SELECT DISTINCT instead of just a SELECT. If you give me a bit more information about where the duplicate data is coming from, I can provide a bit more detail. You can come see me on the end of desk. -- Kevin Weiler IT IMC

Re: hive query with in statement

2014-08-13 Thread Kevin Weiler
This is a relatively old stack overflow post. I’m not sure what version you guys are using, but IN seems to work just fine for me. -- Kevin Weiler IT IMC Financial Markets | 233 S. Wacker Drive, Suite 4300 | Chicago, IL 60606 | http://imc-chicago.com/ Phone: +1 312-204-7439 | Fax: +1 312-244

case statement in SELECT TRANSFORM

2014-07-30 Thread Kevin Weiler
Is it possible to have CASE or SUM statements inside of a TRANSFORM selection? When I do it now, I get the following error: FAILED: ParseException line 41:10 mismatched input 'AS' expecting ) near 'END' in transform clause -- Kevin Weiler IT IMC Financial Markets | 233 S.

Re: python UDF and Avro tables

2014-07-29 Thread Kevin Weiler
are passed through STDIN and delimited by “\t”. I simply needed to split on this field in my python UDF and it worked. Thanks! -- Kevin Weiler IT IMC Financial Markets | 233 S. Wacker Drive, Suite 4300 | Chicago, IL 60606 | http://imc-chicago.com/ Phone: +1 312-204-7439 | Fax: +1 312-244-3301

python UDF and Avro tables

2014-07-24 Thread Kevin Weiler
troller.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) at org.apache.hadoop.mapred.Child.main(Child.java:262) -- Kevin Weiler IT IMC Financial Markets |

RE: [ANNOUNCE] Kevin Wilfong elected to Hive PMC

2013-03-04 Thread Kevin Wilfong
Thanks eveyone! From: Ricky Saltzer [ri...@cloudera.com] Sent: Monday, March 04, 2013 12:13 PM To: d...@hive.apache.org Cc: user@hive.apache.org; Kevin Wilfong Subject: Re: [ANNOUNCE] Kevin Wilfong elected to Hive PMC Congratulations, Kevin! On Mon, Mar 4, 2013

Potential change to metastore Thrift APIs

2012-02-15 Thread Kevin Wilfong
hrift clients other than HiveMetaStoreClient.java, and which option is generally preferred. I am, of course, also open to other ideas. - Kevin Wilfong