Re: Hive on Spark VS Spark SQL

2015-05-21 Thread Cheolsoo Park
Hi Xuefu, Thanks for the good comparison. I agree with most points, but #1 isn't true. SparkSQL has its own parser (implemented with Scala parser combinator library), analyzer, and optimizer although they're not as mature as Hive. What it depends on Hive for is Metastore, CliDriver, DDL parser, e

CVE-2015-1772

2015-05-21 Thread Chao Sun
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 CVE-2015-1772: Apache Hive Authentication vulnerability in HiveServer2 Severity: Important Vendor: The Apache Software Foundation Versions Affected: All versions of Apache Hive from 0.11.0 to 1.0.0, and 1.1.0 . Users affected: Users who use LDAP au

Re: basic math

2015-05-21 Thread Craig Jones
It doesn't matter. Sorry for the confusion. I'll see if I can come up with a simpler case. On Thu, May 21, 2015 at 12:26 PM, j.barrett Strausser < j.barrett.straus...@gmail.com> wrote: > You appear to be mixing up your terms or at least transposing them. Hard > for me to understand without consis

Re: basic math

2015-05-21 Thread j.barrett Strausser
You appear to be mixing up your terms or at least transposing them. Hard for me to understand without consistent notation. In the hive version you subtract from the "b" term COS(b_stop_latitude_deg*pi()/180.0)*COS(a_stop_latitude_deg*pi()/180.0)*COS(a_stop_longitude_deg*pi()/180.0-b_stop_longitud

Re: ORC Table creation failure

2015-05-21 Thread vivek veeramani
Hi Abe, The column in the WHERE clause is also string. I tried creating without any filters, just a CTAS and that failed too. Thanks, Vivek On Thu, May 21, 2015 at 7:47 PM, Abe Weinograd wrote: > I think your WHERE clause is having casting issues. Is that column of the > right data type? Can

Re: ORC Table creation failure

2015-05-21 Thread Abe Weinograd
I think your WHERE clause is having casting issues. Is that column of the right data type? Can you run the SELECT by itself without the CREATE TABLE? Abe On Wed, May 20, 2015 at 11:23 PM, vivek veeramani < vivek.veeraman...@gmail.com> wrote: > > Hi , > > I'm trying to create a subset table fro

basic math

2015-05-21 Thread Craig Jones
I have what I thought was going to be a very simple math operation in hive. I know there are some packages that will allow this to be calculated but let's go with this for now. the point of the query is to calculate a distance between two lat/long points. This is a portion of the select. The fir

Re: upgrade of Hadoop cluster from 5.1.2 to 5.2.1.

2015-05-21 Thread sreebalineni .
Hi you need to check if you have access to hdfs directory group.you can find that as on linux id userid and in the output see if you have group.in ur case it seems g-stor something like that check the message permission denied in the logs On May 21, 2015 9:31 AM, "Anupam sinha" wrote: > I have up