Re: Re: Re: hive will die or not?

2016-08-07 Thread
regards wenli On 08/08/2016 10:16, Edward Capriolo wrote: A few entities going to "kill/take out/better than hive" I seem to remember HadoopDb, Impala, RedShift , voltdb... But apparent hive is still around and probably faster http://www.slideshare.net/hortonworks/hive-on-spark-is-blazing-fa

Re: hive will die or not?

2016-08-07 Thread Marcin Tustin
I think that's right. My testing (not very scientific) puts it on par for redshift for the datasets I use. On Sunday, August 7, 2016, Edward Capriolo wrote: > A few entities going to "kill/take out/better than hive" > I seem to remember HadoopDb, Impala, RedShift , voltdb... > > But apparent hiv

Re: Re: hive will die or not?

2016-08-07 Thread Edward Capriolo
A few entities going to "kill/take out/better than hive" I seem to remember HadoopDb, Impala, RedShift , voltdb... But apparent hive is still around and probably faster http://www.slideshare.net/hortonworks/hive-on-spark-is-blazing-fast-or-is-it-final On Sun, Aug 7, 2016 at 9:49 PM, 理 wrote:

Re: Re: hive will die or not?

2016-08-07 Thread
in my opinion, multiple engine is not advantage, but reverse. it disperse the dev energy. consider the activity ,sparksql support all tpc ds without modify syntax! but hive cannot. consider the tech, dag, vectorization, etc sparksql also has, seems the code is more ef

Re: hive will die or not?

2016-08-07 Thread Will Du
First, hive supports different engines. Look forward it's dynamic engine switch Second, look forward hadoop 3rd gen and map reduce on memory will fill the gap Thanks, Will > On 2016年8月7日, at 20:27, 理 wrote: > > hi, > sparksql improve so fast, both hive and sparksql are similar, so hive

hive will die or not?

2016-08-07 Thread
hi, sparksql improve so fast, both hive and sparksql are similar, so hive will lost or not? regards

Re: hue / hive issue with sqlite

2016-08-07 Thread Edward Capriolo
The "database" that is locked has nothing to do with hive the problem is complete a hue problem. Find the appropriate hue mailing list to get help. On Sun, Aug 7, 2016 at 9:11 AM, Sumit Khanna wrote: > Hey Edward, > > would still the issue ? How often? As in the storage format in here is > parqu

RE: Crate Non-partitioned table from partitioned table using CREATE TABLE .. LIKE

2016-08-07 Thread Markovitz, Dudu
The managed/external table is non-issue since you can create the table as managed and after that alter it to external. ALTER TABLE t SET TBLPROPERTIES('EXTERNAL'='TRUE') Dudu From: Mich Talebzadeh [mailto:mich.talebza...@gmail.com] Sent: Sunday, August 07, 2016 5:02 PM To: Marcin Tustin Cc: us

RE: Crate Non-partitioned table from partitioned table using CREATE TABLE .. LIKE

2016-08-07 Thread Markovitz, Dudu
It was not clear from the original post so I have asked for clarification and the answer was that the partition columns should be excluded. Dudu From: Marcin Tustin [mailto:mtus...@handybook.com] Sent: Sunday, August 07, 2016 4:40 PM To: Mich Talebzadeh Cc: user Subject: Re: Crate Non-partitio

Re: Crate Non-partitioned table from partitioned table using CREATE TABLE .. LIKE

2016-08-07 Thread Mich Talebzadeh
The source table is a partitioned external table and the target table is also external but not partitioned. A straight create table as .. from external table won't work hive> CREATE EXTERNAL TABLE sales5 AS SELECT * FROM SALES; FAILED: SemanticException [Error 10070]: CREATE-TABLE-AS-SELECT canno

Re: Crate Non-partitioned table from partitioned table using CREATE TABLE .. LIKE

2016-08-07 Thread Marcin Tustin
Yes, but a create table unpartitioned as select * from partitioned will create an unpartitioned table with all the data in partitioned table. It won't lose the partition column, but nowhere do I see a need for that column to be removed. On Sun, Aug 7, 2016 at 9:25 AM, Mich Talebzadeh wrote: > Hi

Re: Crate Non-partitioned table from partitioned table using CREATE TABLE .. LIKE

2016-08-07 Thread Mich Talebzadeh
Hi Marcin, The thread owner question was "Hi I've a scenario where I need to create a table from partitioned table but my destination table should not be partitioned. I won't be knowing the schema so I cannot create manually the destination table. By the way both tables are external tables." Th

Re: Crate Non-partitioned table from partitioned table using CREATE TABLE .. LIKE

2016-08-07 Thread Marcin Tustin
Why exclude the partition column? It will still be unpartitioned whether or not the partition column is excluded. On Sun, Aug 7, 2016 at 8:23 AM, Markovitz, Dudu wrote: > It won’t help him since ‘*’ represent all columns including the partition > columns which he wants to exclude. > > > > Dudu >

Re: hive concurrency not working

2016-08-07 Thread Mich Talebzadeh
-- I am pretty sure that they will support it because the Spark option is supported Hortonworks support Spark but not Hive on Spark. Their official distro is Hive on Tez + LLAP Not sure where you get your information from though I got it from Hortonworks and I know that Dr Mich Talebzadeh

Re: hue / hive issue with sqlite

2016-08-07 Thread Sumit Khanna
Hey Edward, would still the issue ? How often? As in the storage format in here is parquet, and am able to view sample sets for each column and raw select queries are working just fine, but none of min / max / distinct / where 'd work. Thanks, On Sun, Aug 7, 2016 at 6:38 PM, Edward Capriolo wro

Re: hue / hive issue with sqlite

2016-08-07 Thread Edward Capriolo
You need to take this up with the appropriate hue/cloudera user group. One issue is that SQL lite is a embedded single user database and does not work well with more than one user. We switched to postges in our deployment and would still hit this issue. I never got it resolved, On Sun, Aug 7, 2016

RE: Crate Non-partitioned table from partitioned table using CREATE TABLE .. LIKE

2016-08-07 Thread Markovitz, Dudu
It won’t help him since ‘*’ represent all columns including the partition columns which he wants to exclude. Dudu From: Marcin Tustin [mailto:mtus...@handybook.com] Sent: Sunday, August 07, 2016 3:17 PM To: user@hive.apache.org Subject: Re: Crate Non-partitioned table from partitioned table usin

Re: Crate Non-partitioned table from partitioned table using CREATE TABLE .. LIKE

2016-08-07 Thread Marcin Tustin
Will CREATE TABLE sales5 AS SELECT * FROM SALES; not work for you? On Thu, Aug 4, 2016 at 5:05 PM, Nagabhushanam Bheemisetty < nbheemise...@gmail.com> wrote: > Hi I've a scenario where I need to create a table from partitioned table > but my destination table should not be partitioned. I won't be

Re: hue / hive issue with sqlite

2016-08-07 Thread Sumit Khanna
Any ideas? Please let me know. Thanks, On Sun, Aug 7, 2016 at 2:12 PM, Sumit Khanna wrote: > Hello, > > we have hue configured against sqlite as default database. > > *queries like select height from students limit 222;* work > > but *queries like select max(height) from students;* wont. > > i

hue / hive issue with sqlite

2016-08-07 Thread Sumit Khanna
Hello, we have hue configured against sqlite as default database. *queries like select height from students limit 222;* work but *queries like select max(height) from students;* wont. in fact that displays " database is locked " error message. is sqlite / hue and as in not migrating to mysql