Re: Questions Regarding Bucket Map Join in Hive

2023-07-12 Thread smart li
Subject: Successful Implementation of Bucket Map Join Hi, I hope this message finds you well. I wanted to express my gratitude for the detailed instructions you provided on setting up the Bucket Map Join. Your guidance proved to be extremely helpful and, following your steps, I am pleased to con

Re: Questions Regarding Bucket Map Join in Hive

2023-07-01 Thread Okumin
Hi, I understand you are trying MapReduce! I recommend you use Tez unless you have special reasons. Tez is the recommended engine and I guess more community members use Hive 3 on Tez. It means you are more likely to get answers when you encounter trouble. Quickly, I succeeded in enabling Bucket M

Re: Questions Regarding Bucket Map Join in Hive

2023-06-25 Thread smart li
Hello, First of all, I would like to express my gratitude for your responses and assistance. I’m currently encountering a scenario where my Hive is not choosing BucketMapJoin, and I wonder whether this is due to its underlying execution engine, which is MapReduce. In addition, I am operating in a

Re: Questions Regarding Bucket Map Join in Hive

2023-06-25 Thread Okumin
Hi smart li, As far as I tried with Hive 3.1.2 on Tez, Bucket Map Join was probably triggered. My configurations could be different from yours, though. # How I tested ## hive-site.xml https://github.com/zookage/zookage/blob/v0.2.3/kubernetes/base/common/config/hive/hive-site.xml ## Prepare tes

Re: Questions about HIVE-20508

2019-09-20 Thread Peter Vary
Hi Julien, See my answers below: > On Sep 19, 2019, at 21:55, Julien Phalip wrote: > > Hi, > > I'm interested in a new config property that was added as part of HIVE-20508 > , and had a few questions: > > 1) The update was merged >

Re: Questions on LLAP and hive.server2.enable.doAs

2018-05-17 Thread Sungwoo Park
For question 1, if hive.server2.enable.doAs is set to true, the AppMaster fails to connect to LLAP daemons (from my experiments). --- Sungwoo On Fri, May 18, 2018 at 1:02 AM, Sungwoo Park wrote: > Hello, > > I have a couple of questions on LLAP and hive.server2.enable.doAs. I've > learned that

Re: Questions about hive authorization under hdfs permissions.

2014-06-16 Thread Thejas Nair
I hope you don't mind me cc'ing user-group so that this q&a is available for others as well. The grant/revoke based authorization models (including the new sql-standards based authorization in hive 0.13) does not automatically ensure that the user has necessary privileges on hdfs dirs and files. T

Re: Questions about Hive

2012-09-17 Thread Ricky Saltzer
Yes, Hive is meant for batch processing on a very large data set. It's very latent when compared to other "databases" such as, MySQL, but excels where other databases faulter. For example, running analysis on several terabytes of data is not unusual in Hive. It was mentioned to consider HBase,

Re: Questions about Hive

2012-09-17 Thread MiaoMiao
I believe Hive is not for web users, since it takes several minutes or even hours to do one query. But I managed to provide a web service via THRIFT and php. http://nousefor.net/55/2011/12/php/hbase-and-hive-thrift-php-client/ On Mon, Sep 17, 2012 at 10:42 PM, Hamilton, Robert (Austin) wrote: > He

RE: Questions about Hive

2012-09-17 Thread Hamilton, Robert (Austin)
Hello, something :) Regarding jdbc style: I understand this approach has some limitations, but here is an example. You will need to make sure the hive service is running: https://cwiki.apache.org/Hive/hiveserver.html Here is a sample code that I've used for testing. It is not the best java in th

Re: Questions about Hive

2012-09-17 Thread Tim Robertson
I don't think Hive is intended for web request scoped operations... that would be a rather unusual case from my understanding. HBase sounds more like the Hadoop equivalent that you might be looking for, but you need to look at your search patterns to see if HBase is a good fit (you need to manage

Re: Questions about Hive

2012-09-16 Thread Something Something
Thank you both for the answers. We are trying to find out if Hive can be used as a replacement of Netezza, but if there are no indexes then I don't see how it will beat Netezza in terms of performance. Sounds like it certainly can't be used to do a quick lookup from a webapp - like Netezza can.

Re: Questions about Hive

2012-09-16 Thread Tim Robertson
> > Note: I am a newbie to Hive. > > Can someone please answer the following questions? > > 1) Does Hive provide APIs (like HBase does) that can be used to retrieve > data from the tables in Hive from a Java program? I heard somewhere that > the data can be accessed with JDBC (style) APIs. True

RE: Questions about Hive

2012-09-16 Thread Balaraman, Anand
Regarding usage of APIs to work on HIVE, here is a tip: Try using a JDBC connector (like 'hive-jdbc-0.7.1-cdh3u1.jar') as a plugin in any querying tool such as DbVisualizer. I am connecting to hive using the above setup as well as using SQL Explorer plugin in Eclipse. Regards Anand B Fro

Re: Questions

2012-01-19 Thread Mohammad Tariq
ogs.. > > Finally, is there any tutorials using Java API of Hive and Hbase??? > > Date: Thu, 19 Jan 2012 13:36:30 +0530 > Subject: Re: Questions > From: hadooph...@gmail.com > To: user@hive.apache.org > > > hey  Dalia , > > A: bot

Re: Questions

2012-01-19 Thread hadoop hive
und that Hive queries are faster according to some blogs.. > > Finally, is there any tutorials using Java API of Hive and Hbase??? > -- > Date: Thu, 19 Jan 2012 13:36:30 +0530 > Subject: Re: Questions > From: hadooph...@gmail.com > To: user@hive.apache.o

RE: Questions

2012-01-19 Thread Dalia Sobhy
+0530 Subject: Re: Questions From: hadooph...@gmail.com To: user@hive.apache.org hey Dalia , A: both are good its up to u what kinda data you are processing through them, for many row and billions of col you can you Hbase and if you need to update data on regular basis then u can you hbase, for

Re: Questions

2012-01-19 Thread hadoop hive
hey Dalia , A: both are good its up to u what kinda data you are processing through them, for many row and billions of col you can you Hbase and if you need to update data on regular basis then u can you hbase, for hive you can store data and easy to use as SQL , easy fetching and all. for more

Re: questions about statistics in 0.7

2011-05-26 Thread Ning Zhang
On May 26, 2011, at 1:28 PM, Guy Bayes wrote: Crap sorry hit send too early questions 1: Job overhead of generating statistics on the fly with set hive.stats.autogather=true;? Overhead is minimum. The only accountable overhead is to insert a row into a RDBMS/HBase at the end of a task. At the

Re: questions about statistics in 0.7

2011-05-26 Thread Guy Bayes
Crap sorry hit send too early questions 1: Job overhead of generating statistics on the fly with set hive.stats.autogather=true;? 2: Is stat descriptions in describe table extended implemented? I've gathered stats on a table but do not see the expected entries (rowNum = , etc) in the describe st