unsubscribe

2013-07-10 Thread Kasa V Varun
Unsubscribe. This email message may contain proprietary, private and confidential information. The information transmitted is intended only for the person(s) or entities to which it is addressed. Any review, retransmission, dissemination or other use of, or taki

HiveServer2 JDBC Client- [Multithreaded connection]

2013-07-10 Thread Varunkumar Manohar
Hi, I am attempting to create a JDBC Client to HiveServer2. I have set the following property to support concurrency hive.support.concurrency Enable Hive's Table Lock Manager Service true The JDBC client spawns multiple threads using a executor service and each thread tries to get a c

Re: how to config hive use yarn ?

2013-07-10 Thread ch huang
i export env variable HADOOP_MAPRED_HOME= /usr/lib/hadoop-mapreduce in hive-env.sh,now it's work fine On Thu, Jul 11, 2013 at 10:42 AM, ch huang wrote: > i already test yarn ,is work fine ,but i find it can not work in hive > ,why? i use hive 0.94.6 ,it still can not support yarn?

how to config hive use yarn ?

2013-07-10 Thread ch huang
i already test yarn ,is work fine ,but i find it can not work in hive ,why? i use hive 0.94.6 ,it still can not support yarn?

Re: HBase --> Hive / HCatalog --> PIG

2013-07-10 Thread Rajesh Balamohan
Thanks a lot Thiruvel. I will look into the JIRA. ~Rajesh.B On Thu, Jul 11, 2013 at 7:09 AM, Thiruvel Thirumoolan < thiru...@yahoo-inc.com> wrote: > Hi Rajesh, > > You might be interested in HIVE-4331 for the Pig integration. I think > Viraj had tested this entire use case on a secure cluste

lot's of deprecated info in hive metastore log

2013-07-10 Thread ch huang
i do not know why ,i have no mapred.reduce.tasks option defined in config file,anyone can help? hive-metastore.log:2013-07-10 10:10:34,890 WARN conf.Configuration (Configuration.java:warnOnceIfDeprecated(824)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.redu

Re: HBase --> Hive / HCatalog --> PIG

2013-07-10 Thread Thiruvel Thirumoolan
Hi Rajesh, You might be interested in HIVE-4331 for the Pig integration. I think Viraj had tested this entire use case on a secure cluster. -Thiruvel From: Rajesh Balamohan mailto:rajesh.balamo...@gmail.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apach

HBase --> Hive / HCatalog --> PIG

2013-07-10 Thread Rajesh Balamohan
Hi All, Has anyone tried out the following usecase in security enabled hadoop cluster?. 1. Create a table in HBase 2. Create a table in Hive pointing to the HBase table created in #1 3. Since HCatalog uses hive metastore, this table will be visible to HCatalog as well. 4. Try to access hive table

Re: export csv, use ',' as split

2013-07-10 Thread Navis류승우
Fixed in hive-0.11.0 https://issues.apache.org/jira/browse/HIVE-3682 2013/7/11 Sanjay Subramanian : > Hive does not have a output delimiter specifier yet (not sure if 0.11.x may > have it) > > But for now please try the following > > hive -e myquery | sed 's/\t/,/g' >> result.csv > > Good luck >

Re: Oracle to Hive

2013-07-10 Thread Michael Malak
Untested: SELECT a.c100, a.c300, b.c400   FROM t1 a   JOIN t2 b   ON a.c200 = b.c200   JOIN (SELECT DISTINCT a.c100           FROM t1 a2           JOIN t2 b2           ON a2.c200 = b2.c200         WHERE b2.c400 >= SYSDATE - 1) a3   ON a.c100 = a3.c100   WHERE b.c400 >= SYSDATE - 1    AND a.c300 =

Oracle to Hive

2013-07-10 Thread Raj Hadoop
  All,   Can anyone give me tips on how to convert the following Oracle SQL to a Hive query.     SELECT a.c100, a.c300, b.c400   FROM t1 a JOIN t2 b ON a.c200 = b.c200  WHERE a.c100 IN (SELECT DISTINCT a.c100 FROM t1 a JOIN t2 b ON a.c200 = b.c200  

Re: hive jdbc exception

2013-07-10 Thread Konstantinos Aretakis
Thanks! It was the server not able to run at the default port 1! I did netstat and I saw a service running at 1 port and thought it was the hive server but it wasnt! I changed the port and it worked! Thanks again! K.A On 10 Ιουλ 2013, at 23:30, Stephen Sprague wrote: obvious question fi

Re: hive jdbc exception

2013-07-10 Thread Stephen Sprague
obvious question first. is your Hive Server running on port 1?to check: $ netstat -lanp | grep 1 (might need to run as root. show us the output) On Wed, Jul 10, 2013 at 1:04 PM, Κωνσταντίνος Αρετάκης wrote: > Hi all, > I am trying to execute a hiveql query from a java application

hive jdbc exception

2013-07-10 Thread Κωνσταντίνος Αρετάκης
Hi all, I am trying to execute a hiveql query from a java application with connection string "jdbc:hive://localhost:1" but I get org.apache.transport.TTransportException. Have anyone faced this problem to give me a solution? Thanks

Re: export csv, use ',' as split

2013-07-10 Thread Sanjay Subramanian
Hive does not have a output delimiter specifier yet (not sure if 0.11.x may have it) But for now please try the following hive -e myquery | sed 's/\t/,/g' >> result.csv Good luck Sanjay From: kentkong_work mailto:kentkong_w...@163.com>> Reply-To: "user@hive.apache.org

Re: Using INDEX inside SUBSTR

2013-07-10 Thread Stephen Sprague
rather than us just do the work for you show us your attempts to solve this. hint: did you look at this page? https://cwiki.apache.org/Hive/languagemanual-udf.html#LanguageManualUDF-StringFunctions On Wed, Jul 10, 2013 at 5:06 AM, dyuti a wrote: > Hi All, > One of my Teradata query is > > SUB

Using INDEX inside SUBSTR

2013-07-10 Thread dyuti a
Hi All, One of my Teradata query is SUBSTR(PRESG_ID,INDEX(PRESG_ID,' ')+1,1) IN ('1','2','3') Any idea of the above to convert to hive, It seems to be a simple qus but am stuck...didn't get a chance to try it out in cluster :( -Thanks

Re: start hive2 error

2013-07-10 Thread Matouk IFTISSEN
hello, verify if ZooKeeper is running on port 2181 (not on port 2281 like you have in Hive-site.xml) if changing port don't work assure that your Zookeeper quorum is listining on port 2281. 2013/7/10 ch huang > i try start hiveserver2 ,buy error in log file ,why ? i use hive 0.10 > > 2013-07-1

start hive2 error

2013-07-10 Thread ch huang
i try start hiveserver2 ,buy error in log file ,why ? i use hive 0.10 2013-07-10 14:18:31,821 WARN hive.metastore (HiveMetaStoreClient.java:open(285)) - Failed to connect to the MetaStore Server... 2013-07-10 14:18:32,830 ERROR service.CompositeService (CompositeService.java:start(74)) - Error st

Re: can not connect hive through jdbc

2013-07-10 Thread ch huang
yes i try ,and i get Invalid URL error Exception in thread "main" java.sql.SQLException: Invalid URL: jdbc:hive2:// 192.168.10.22:1/default at org.apache.hadoop.hive.jdbc.HiveConnection.(HiveConnection.java:85) at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:104) at java.

Re: can not connect hive through jdbc

2013-07-10 Thread Nitin Pawar
Can you tell use which jdbc version are you using? and try changing it to "jdbc:hive" from " jdbc:hive2" On Wed, Jul 10, 2013 at 12:34 PM, ch huang wrote: > i use following java code > > > import java.sql.Connection; > import java.sql.DriverManager; > import java.sql.ResultSet; > import

Re: export csv, use ',' as split

2013-07-10 Thread Nitin Pawar
hive create table is different than the hive query output, hive by default uses tab as output column separator on console. if you want to change to csv, why don't you just use sed and replace tab with "," if you want a csv generated out of the query itself then create a temporary external table w

can not connect hive through jdbc

2013-07-10 Thread ch huang
i use following java code import java.sql.Connection; import java.sql.DriverManager; import java.sql.ResultSet; import java.sql.Statement; public class DemoHive { public static void main(String[] args) throws Exception { Class.forName("org.apache.hadoop.hive.