Re: Origin of hive.auto.convert.sortmerge.join.noconditionaltask

2015-08-04 Thread Lefty Leverenz
Good question. I can't find it in any Hive releases. There's hive.auto.convert.join.noconditionaltask (starting in 0.11.0) but not hive.auto.convert.sortmerge.join.noconditionaltask. Several JIRA issues mention it, including the 0.13.0 release note for HIVE-6098

Re: Error communicating with metastore

2015-08-04 Thread Alan Gates
Ok, the next step is to look at the logs from your Hive metastore server and see exactly what's happening. The error you're seeing is from the client. On your metastore server there should be logs with the same timestamp giving details on why the transaction operation failed. Alan. Sarath

Re: Error communicating with metastore

2015-08-04 Thread Eugene Koifman
could you execute "set hive.txn.manager" and "set hive.metastore.uris" in Hive CLI to confirm that your client is configured correctly? From: Sarath Chandra mailto:sarathchandra.jos...@algofusiontech.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org

Re: hive error when trying to write data to s3n

2015-08-04 Thread Pun Intended
Yes, the explain plan definitely only has Move Operators (no Copy Operators). With that though, this definitely looks like a hive bug? Does anyone know if there is corresponding HIVE ticket or a workaround for the issue? Thanks! Stage: Stage-3 Move Operator files: hdfs direct

Origin of hive.auto.convert.sortmerge.join.noconditionaltask

2015-08-04 Thread William Slacum
Hi all, I've had some questions from users regarding setting `hive.auto.convert.sortmerge.join.noconditionaltask`. I see, in some documentation from users and vendors, that it is recommended to set this parameter. In neither Hive 0.12 nor 0.14 can I find in HiveConf where this is actually defined

Re: hive error when trying to write data to s3n

2015-08-04 Thread Gopal Vijayaraghavan
> Moving data to: >s3n://:@my_bucket/a/b/2015-07-30/.hive-staging_hiv >e_2015-08-04_18-38-47_649_1476668515119011800-1/-ext-1 > Failed with exception Wrong FS: >s3n://:@my_bucket/a/b/2015-07-30/.hive-staging_hiv >e_2015-08-04_18-38-47_649_1476668515119011800-1/-ext-10002, expected: >hdfs://s

hive error when trying to write data to s3n

2015-08-04 Thread Pun Intended
Hello, I have a query that used to work fine previously. I am testing on hive 1.1 now and it is failing. The AWS access and secret key have permissions to read and write data to this directory. The directory exists. hive -e " insert overwrite directory 's3n://:@my_bucket/a/b/2015-07-30' SELECT *

Does Struct inside Struct works?

2015-08-04 Thread ram kumar
CREATE EXTERNAL TABLE pick ( ud STRING, pi ARRAY > >> ) ROW FORMAT SERDE 'com.proofpoint.hive.serde.JsonSerde' LOCATION 's3n://';

Re: getting mismatched input 'ROW' expecting error in hive creation

2015-08-04 Thread gabriel balan
Hi + "ROW FORMAT DELIMITED FIELDS TERMINATED BY '\b' LINES TERMINATED BY '\n'"); Shouldn't you escape the backslashes ('\\n' instead of '\n'), so they're not interpreted by java? hth GB On 8/4/2015 11:22 AM, Sateesh Karuturi wrote: i want create a hive table using java code. my code is pa

getting mismatched input 'ROW' expecting error in hive creation

2015-08-04 Thread Sateesh Karuturi
i want create a hive table using java code. my code is package com.inndata.services; import java.sql.ResultSet; import java.sql.SQLException; import java.sql.Connection; import java.sql.Statement; import java.sql.DriverManager; public class HiveCreateTable { private static String driverName = "co

Re: unsubscribe

2015-08-04 Thread Grant Overby (groverby)
Ajeet, You are able to unsubscribe yourself from the mailing list. See https://hive.apache.org/mailing_lists.html [http://www.cisco.com/web/europe/images/email/signature/est2014/logo_06.png?ct=1398192119726] Grant Overby Software Engineer Cisco.com grove...@cisco.com

Re: start hiveserver2 failed need help

2015-08-04 Thread Grant Overby (groverby)
Looks like the user running hiveserver2 didn’t have permission (local file system) to write to the directory specified by HiveConf.ConfVars.LOCALSCRATCHDIR . The default scratch directory is: “${system:java.io.tmpdir}” + File.separator + “${system:user.name}” , so it’s unusual to see this error

unsubscribe

2015-08-04 Thread Ajeet O
Hi pls unsubscribe me from this forum . Regards Ajeet Ojha Tata Consultancy Services Limited Cell:- 9811220828 Mailto: ajee...@tcs.com Website: http://www.tcs.com Experience certainty. IT Services Business Solutions

Obtain query metadata information in UDF

2015-08-04 Thread Adeel Qureshi
I posted a question few days ago about how to capture current user information in a UDF and the answer basically was to use SessionState.getUserFromAuthenticator(). I am wondering if there is a similar mechanism to obtain query metadata information such as the sql statement or the current database