Re: Re: AW: Build hwi of hive 0.14.0 failed

Hi, After changing the hadoop-2 profile to use hadoop 2.5.2, the following command can build the target hive-hwi-0.13.1.war file mvn install -pl hwi -P hadoop-2 -DskipTests war:war But the http://:/hwi can't open with the following errors: Problem accessing /hwi/. Reason: Unable to fi

Re: Job aborted due to stage failure

Hi Yuemeng, I'm glad that Hive on Spark finally works for you. As you know, this project is still in development and yet to be released. Thus, please forgive about the lack of proper documentation. We have a "Get Started" page that's linked in HIVE-7292. If you can improve the document there, it w

Re: Re: AW: Build hwi of hive 0.14.0 failed

Now I am trying to build the hwi.war file for hive-0.13.1, is the following command the correct one? cd $HIVE_SRC_HOME/hwi mvn pakage I am running hadoop 2.5.2, should I made any changes to the configurations regarding to hadoop versions inside $HIVE_SRC_HOME/pom.xml and $HIVE_SRC_HOME/h

Re: hive transactions

Can you just bounce one mysql db On Dec 4, 2014 9:26 AM, "yogendra reddy" wrote: > Thanks Vikas Srivastava, I do have lot of space available in my metastore > db > > > Thanks, > Yogendra > > On Thu, Dec 4, 2014 at 9:12 AM, hadoop hive wrote: > >> Hi yogendra, >> >> You need to check if space is

Re: hive transactions

Thanks Vikas Srivastava, I do have lot of space available in my metastore db Thanks, Yogendra On Thu, Dec 4, 2014 at 9:12 AM, hadoop hive wrote: > Hi yogendra, > > You need to check if space is available on you backend metadata db server > like mysql or oracle server. > > It might be possible

RE: hive transactions

Hi yogendra, You need to check if space is available on you backend metadata db server like mysql or oracle server. It might be possible the your queries are getting stuck becoz there is no enough space for mysql logging. Thanks Vikas Srivastava On Dec 4, 2014 7:59 AM, "Yogendra reddy" wrote:

Re: Question

Hi Gabriel/Bill, I completely see that PIG and Hive are alternatives for MapReduce which help Users working BigData Systems who dont have any JAVA knowledge. As we all know that MAPReduce handles both Struct and unstruct data, i just wanted to know which one among PIG/Hive handles Unstructured Data

Re: Question

Mohan, I think that depends on your use case and how you feel with the technologies, I am not a pig expert but as Bill said, Hive and Pig are ways to do easier the way to process the data, you can write mapreduce to do any hive or pig task and more , it's definitely more versatile but more hard

RE: hive transactions

Thanks Alan, I'm able to see TXNS table and yes I have upgraded from 0.13 to 0.14. any idea as to wht else might cause this issue? Thanks, Yogendra -Original Message- From: "Alan Gates" Sent: ‎12/‎3/‎2014 9:51 AM To: "user@hive.apache.org" Subject: Re: hive transactions Usually this

Re: Question

Thankyou Gabriel Your answers are very useful to me. Thanks a lot On Thu, Dec 4, 2014 at 7:29 AM, Bill Busch wrote: > MapReduce can be used for both structure and unstructured data. Hive is > a storage and retrieval mechanism (e.g. database). The trouble with RDBMS > is that you either hav

RE: Question

MapReduce can be used for both structure and unstructured data. Hive is a storage and retrieval mechanism (e.g. database). The trouble with RDBMS is that you either have to parse the unstructured data into a structured row /column format OR store it as an object. There are issues both perfo

Re: Job aborted due to stage failure

hi,thanks a lot for your help,with your help ,my hive-on-spark can work well now it take me long time to install and deploy.here are some advice,i think we need to improve the installation documentation, allowing users to use the least amount of time to compile and install 1)add which spark ver

Re: Question

Thanks Gabriel for the prompt response I see in online blogs saying MapReduce for Unstructured Data , Pig for Semi Sturctured Data and Hive is only for Structured Data. Can you please justify this? Thanks in advance On Thu, Dec 4, 2014 at 6:56 AM, Gabriel Eisbruch wrote: > Hi Mohan, >W

Re: JDBC/beeline client hangs with HiverServer2 (0.13.1)

Looks like the connection is successful when you don't set "auth=noSasl", which is expected. You don't need to set that property in normal configuration. Not sure why the 'show table' is failing. Do you see any errors in the HiveServer2 log ? thanks Prasad On Wed, Dec 3, 2014 at 10:22 AM, Atu

Re: Question

Hi Mohan, We are using hive for unstructured (or semi structured data) using map columns, for example, we use for fixed data standard columns and form dynamic data map columns. Gabriel. 2014-12-03 22:19 GMT-03:00 Mohan Krishna : > Hive is for only structured data or it handles Unstructured d

Re: Question

Hive is for only structured data or it handles Unstructured data as well ? On Thu, Dec 4, 2014 at 6:49 AM, Mohan Krishna wrote: > Hive is for only structured data or it handles Unstructured data as well ? >

Question

Hive is for only structured data or it handles Unstructured data as well ?

Re: Fwd: Question on ORC file stripe size.

Stripe size is too low. ORC maintains multiple buffers in memory. ORC’s memory manager flushes a stripe when the in-memory data size (which includes buffers in memory) is greater than specified stripe size. This check happens after every 5000 rows.  This is what is happening in this case There

Re: Enabling Tez sessions on HiveServer2

Hi Pala, The doAs turning off requirement is the last entry in the table on that page. It needs to be turned off while using the pool of sessions because once the session has started, there is currently no way of changing the user of the session. With the doAs turned off, since everything runs as

Re: Where is the base directory of a transaction table?

Are you running a stand alone metastore process? The compactor runs in a stand alone metastore, not in the client. Alan. vic0777 December 2, 2014 at 23:13 Hi Alan, Thans for your help. I set the hive.compactor.initiator.on(= true) and hive.compactor.worker.threads(=2

Re: UPDATE implementation

Yes. Alan. Brian Jeltema December 3, 2014 at 11:02 I’m anticipating using UPDATE statements in Hive 0.14. In my use case, I may need to perform 30 or so updates at a time. Will each UPDATE result in an MR job doing a full partition scan? Brian -- Sen

Re: Enabling Tez sessions on HiveServer2

I should have mentioned this earlier: I am using Hive 13, Tez 0.4.1 on Hadoop 2.5 Hi Vikram, Yes my intention was to enable shared sessions on HiveServer2 so that queries from multiple users can benefit from YARN app and container reuse. I didn't know doAs needs to be turned off. But I don't thi

Re: what is the bench mark using SSD for HDFS over HDD

Run IO intensive tests, such as TESTDFSIO and Terasort. From: Amit Behera mailto:amit.bd...@gmail.com>> Reply-To: mailto:user@hive.apache.org>> Date: Wed, 3 Dec 2014 00:09:39 +0530 To: mailto:user@hive.apache.org>> Subject: what is the bench mark using SSD for HDFS over HDD Hi User, I want to kn

UPDATE implementation

I’m anticipating using UPDATE statements in Hive 0.14. In my use case, I may need to perform 30 or so updates at a time. Will each UPDATE result in an MR job doing a full partition scan? Brian

RE: JDBC/beeline client hangs with HiverServer2 (0.13.1)

Hi Andrew, Yes I did look at the below Wiki page earlier. I didn’t modify any default settings for HiveServer2 so the hive.server.authentication is “NONE” at this point (which probably results to “SASL” by default I guess). Also if you look at the beeline output, it is able to connect to HiveSe

Re: JDBC/beeline client hangs with HiverServer2 (0.13.1)

Hi Atul, The setting you pasted is for the metastore's authentication (setting to false means SASL is disabled there). The setting you want is: hive.server2.authentication – Authentication mode, default NONE. Options are NONE, NOSASL, KERBEROS, LDAP, PAM and CUSTOM. See https://cwiki.apach

RE: JDBC/beeline client hangs with HiverServer2 (0.13.1)

Hi Prasad, My default hive-site.xml has following, doesn’t that mean “sasl” is disabled ? hive.metastore.sasl.enabled false If true, the metastore Thrift interface will be secured with SASL. Clients must authenticate with Kerberos. Also the normal Hive login gives following output for s

Re: UNSUBSCRIBE

To unsubscribe, you need to send a message to user-unsubscr...@hive.apache.org instead of this mailing list. See http://hive.apache.org/mailing_lists.html. -- Lefty On Tue, Dec 2, 2014 at 10:01 PM, Sri kripa wrote: > >