Re: What does Apache Hive do?

2022-05-18 Thread wilson
I doubt OP has been posting useless messages. what he has posted in different lists: What does apache hive do? What does apache spark do? What does apache hbase do? What does apache kafka do? ... It's totally meaningless. apache has 300+ active projects, will you foreach them to ask the same que

Re: hive3 and tez-0.10.1

2022-05-13 Thread wilson
nager classpath and restarted Thanks. On Sat, May 14, 2022 at 6:30 AM Pau Tallada wrote: > there is no info there to extract any conclusion. you have too look at the > logs > > On Sat, May 14, 2022, 00:12 wilson wrote: > >> I then installed tez-0.9.2 for hive 3. But stil

Re: hive3 and tez-0.10.1

2022-05-13 Thread wilson
; > We are testing a deployment with Tez 0.10.0, and it seems to work fine. >> > >> > Best regards, >> > >> > Pau. >> > >> > Missatge de wilson del dia dv., 13 de maig 2022 a >> les >> > 12:52: >> > >> >>

Re: hive3 and tez-0.10.1

2022-05-13 Thread wilson
What tez version should I use? Can you share the deployment details? Thanks > Hi, > > AFAIK, Hive3 is not compatible with Tez 0.10.1. > We are testing a deployment with Tez 0.10.0, and it seems to work fine. > > Best regards, > > Pau. > > Missatge de wilson del

hive3 and tez-0.10.1

2022-05-13 Thread wilson
I am these packages in a single node VM: apache-tez-0.10.1-bin.tar.gz apache-hive-3.1.2-bin.tar.gz hadoop-3.3.2.tar.gz And java: $ java -version java version "1.8.0_321" Java(TM) SE Runtime Environment (build 1.8.0_321-b07) Java HotSpot(TM) 64-Bit Server VM (build 25.321-b07, mixed mode)

RE: Get the job id for a hive query

2013-02-27 Thread Todd Wilson
figured out how to do it. :/ Best Regards, Todd Wilson Senior Technical Consultant Coffing Data Warehousing (513) 292-3158 <http://www.coffingdw.com/> www.CoffingDW.com The information contained in this communication is confide

describe table issue, hive_system table, set command and version fuction questions

2013-01-31 Thread Todd Wilson
Hello Everyone: I'm using Hive .9. MapR ODBC driver against Cloudera. Relatively new to Hadoop, been looking at it about a week to add it to our query tool. CREATE DATABASE test; CREATE TABLE test.table1 (col1 int); describe table1; I'm getting the message "Table table1 does

View metadata

2013-01-24 Thread Todd Wilson
ply here? I see a TBL_Type column in the ERwin diagram under the TBLS table so I thought this information might be kept here (if supported). Thank you very much for your help!!! Best Regards, Todd Wilson Senior Technical Consultant Coffing Data Warehousing (513) 292

Re: Amazon EMR Best Practices for Hive metastore

2012-03-06 Thread Sam Wilson
We also do #4. Initially we had lots of conversations about all the other options and we should do this or that... Ultimately we focused on just going live as quickly as possible and getting more involved in the setup later. Since then the only thing we've needed to do is hack a few o the basel

Re: rainstor

2012-01-25 Thread Sam Wilson
Google? Sent from my iPhone On Jan 25, 2012, at 7:34 PM, Dalia Sobhy wrote: > Do anyone have any idea about rainstor ??? > > Opensource? How to download ? How to use? PErformance ??

Re: drop table -> java.lang.OutOfMemoryError: Java heap space

2012-01-05 Thread Sam Wilson
I recommend trying a daily partitioning scheme over an hourly one. We had a similar setup and ran into the same problem and ultimately found that daily works fine for us, even with larger file sizes. At the very least it is worth evaluating. Sent from my iPhone On Jan 5, 2012, at 2:23 PM, Mat

Re: Hive Metadata URI error

2011-12-11 Thread Sam Wilson
Try file:// in front of the property value... Sent from my iPhone On Dec 12, 2011, at 12:07 AM, "Periya.Data" wrote: > Hi, >I am trying to create Hive tables on an EC2 instance. I get this strange > error about URI schema and log4j properties not found. I do not know how to > fix this. >

Re: Building out Hive in EC2/S3 versus dedicated servers

2011-11-22 Thread Sam Wilson
We recently adopted Hadoop and Hive for doing some significant data processing. We went the Amazon route. My own $.02 is as follows: If you are already incredibly experienced with Hadoop and Hive and have someone on staff who has previously built a cluster at least as big as the one you are pr

Re: Asynchronous query exection

2011-11-15 Thread Sam Wilson
If you go this route, you may want to use nohup. This way your processes will continue running even if you lose connection to your terminal session. Other options: 1) You can write your queries to a DB/Queue and have a process running on the Hive server that reads from the DB/queue and runs the

Re: RDBS and Hive

2011-05-31 Thread Andrew Wilson
Yes, here is the ticket: https://issues.apache.org/jira/browse/HIVE-1555?page=com.atlassian.streams.streams-jira-plugin%3Aactivity-stream-issue-tab#issue-tabs We us

Re: Dynamic Configuration support in Hive SQL

2011-03-21 Thread Andrew Wilson
We use the Cloudera Oozie distro which has a Hive action, and provides that kind of template support for Hive scripts. On Mar 21, 2011, at 11:35 AM, Lenin Gali wrote: > Best way to do this is to write shell or python scripts and echo with > substitute variables and call hive from command line p

Re: Unit testing Hive script

2011-02-18 Thread Andrew Wilson
Hi Radek, I've been using the MiniMRCluster and MiniDFSCluster to run unit tests locally. That has been giving me decent cycle time. I have fixture tables in my test/resources which I can load into the MiniHiveCluster as part of test setup. I loosely based my code on QTestUtil in the Hive trunk