Re: Difference between join and inner join

They are functionally equivalent, but INNER JOIN can be a bit clearer to read, especially if the query has other join types (i.e. LEFT or RIGHT or CROSS) included in it. Regards Vikas Srivastava On 12 Feb 2017, 12:02 PM +0800, Divya Gehlot , wrote: > Hi , > What's the difference between" join "

Re: Hive JDBC with ZooKeeper Discovery and Kerberos Principal

Did you tried jdbc:hive2:///;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver;principal=hive/_h...@example.com;transportMode=http;httpPath=cliservice On 18 Jan 2017, 12:40 PM +0800, Amin Abbaspour , wrote: > > Hi, > > > In case of HA JDBC connectivity to multiple Hive servers with Zo

Re: Container is running beyond physical memory limits

http://hortonworks.com/blog/how-to-plan-and-configure-yarn-in-hdp-2-0/ On Wed, Oct 14, 2015 at 1:42 AM, Mich Talebzadeh wrote: > Thank you all. > > > > Hi Gopal, > > > > My understanding is that the parameter below specifies the max size of 4GB > for each contain. That seems to work for me > > >

Re: Container is running beyond physical memory limits

mapreduce.reduce.memory.mb 4096 change this to 8 G On Wed, Oct 14, 2015 at 12:52 AM, Ranjana Rajendran < ranjana.rajend...@gmail.com> wrote: > Here is Altiscale's documentation about the topic. Do let me know if you > have any more questions. > > http://documentation.altiscale.com/heapsize

Re: Hive Server gets stucked with Load Data InPath

trying using "load data local inpath" On Fri, Oct 9, 2015 at 2:23 PM, Vineet Mishra wrote: > Any update around this? > > Thanks! > > On Fri, Oct 2, 2015 at 7:44 PM, Vineet Mishra > wrote: > >> Hi Praveen, >> >> This is the complete exception stack I m having. >> >> Thanks! >> On Oct 1, 2015 7:3

Re: hive transactions

Can you just bounce one mysql db On Dec 4, 2014 9:26 AM, "yogendra reddy" wrote: > Thanks Vikas Srivastava, I do have lot of space available in my metastore > db > > > Thanks, > Yogendra > > On Thu, Dec 4, 2014 at 9:12 AM, hadoop hive wrote: > >> Hi yo

RE: hive transactions

Hi yogendra, You need to check if space is available on you backend metadata db server like mysql or oracle server. It might be possible the your queries are getting stuck becoz there is no enough space for mysql logging. Thanks Vikas Srivastava On Dec 4, 2014 7:59 AM, "Yogendra reddy" wrote:

Re: Values getting duplicated in Hive table(Partitioned)

Can you check your select query to run on non partitioned tables. Check if it's giving correct values. Same as for dept. B On Nov 17, 2014 10:03 AM, "unmesha sreeveni" wrote: > ***I created a Hive table with *non*- *partitioned* and using select > query I inserted data into *Partioned* Hive tab

Re: Values getting duplicated in Hive table(Partitioned)

You need to check you query. Last one is. Column and data is replicated by your query only. On Nov 17, 2014 10:01 AM, "unmesha sreeveni" wrote: > I created a Hive table with *partition* and inserted data into Partioned > Hive table. > > Refered site >

Re: Oozie job not running

Can try.. Nc -vz 192.168.31.130 11000 On Nov 5, 2014 2:41 AM, "Rahul Channe" wrote: > Hi All, > > I am trying to run my oozie job but its giving below error > > user@ubuntu:~/hive_oozie$ oozie job -oozie http://ubuntu:11000/oozie > -config job.properties -run > Error: E0501 : E0501: Could not p

Migration of metastore tables from mysql to oracle.

Hi folks, I have a requirement where I need to migrate metastore tables from mysql to oracle. Is there any who already performed this kind of activity. Any help will be appreciated Thanks Vikas Srivastava

Re: configuration in hive-site.xml

Just check if netstat -plten | grep 9083 If any process is running or not..I'd yes then metastore is running else not. On Sep 29, 2014 1:53 PM, "Poorvi Ahirwal" wrote: > how to find the node where metastore is running? > > On Mon, Sep 29, 2014 at 1:24 PM, hadoop hive w

Re: configuration in hive-site.xml

Its should be client node where metastore is running. With port 9083.

Re: ClassNotFoundException: org.datanucleus.api.jdo.JDOPersistenceManagerFactory

I am talking bout property file On Sep 23, 2014 5:18 PM, "Poorvi Ahirwal" wrote: > you are saying about mapred program or some property file? > > On Tue, Sep 23, 2014 at 4:14 AM, hadoop hive wrote: > >> Comment the jdo properties from mapred and hdfs >> On Sep

Re: Oracle backend for Hive Metastore

You can import the metastore db in oracle directly. Inside oracle db @/path/to/oracle-hive-0.12.0.sql On Sep 23, 2014 9:08 PM, "Rahul Channe" wrote: > Hi Alan, > > I am using version 0.12.0, I did not create tables explicitly. > > Temporarily I modified the hive-metastore jar to update long dat

Re: ClassNotFoundException: org.datanucleus.api.jdo.JDOPersistenceManagerFactory

Comment the jdo properties from mapred and hdfs On Sep 23, 2014 4:42 PM, "Poorvi Ahirwal" wrote: > Hi, > I am executing a mapreduce program with hcatalog and hive database. Even > if the jars are included its showing this error: > > Exception in thread "main" java.io.IOException: > com.google.com

RE: Distribution of Data

If in your core-site.xml or hdfs-site.XML .. Property is Marked as final it would not be overwrite by your code On Aug 26, 2014 7:07 PM, "CHEBARO Abdallah" wrote: > What does it mean my replication have set as final? > > > > *From:* hadoop hive [mailto:hadooph...@gma

Re: Distribution of Data

Can you check if your replication have set as final or not else it won't be effected. On Aug 26, 2014 6:46 PM, "CHEBARO Abdallah" wrote: > This question is not directly related to Hive, but: > > I configured 3 datanodes on my Linux machine. In my configuration, I > configured the number of repl

Re: Hive queries returning all NULL values.

re. > How can I see which field has the mismatch? > > > > On Sun, Aug 17, 2014 at 4:30 PM, hadoop hive wrote: > >> Hi, >> >> You check the data type you have provided while creating external table, >> it should match with data in files. >> >>

Re: Hive queries returning all NULL values.

Hi, You check the data type you have provided while creating external table, it should match with data in files. Thanks Vikas Srivastava On Aug 17, 2014 7:07 PM, "Tor Ivry" wrote: > Hi > > > > I have a hive (0.11) table with the following create syntax: > > > > CREATE EXTERNAL TABLE events( > >

Re: How to query UNION types in Hive with Avro

Hi Sachin, Here is the doc from hwk, this might help you. http://docs.hortonworks.com/HDPDocuments/HDP1/HDP-1.2.2/ds_Hive/language_manual/datatypes.html#LanguageManualTypes-UnionTypes Thanks Vikas Srivastava On Aug 12, 2014 12:31 AM, "Sachin Goyal" wrote: > Hi, > > I am using Hive and Avro wi

Re: Hivemetastore Error: Duplicate entry

Seems that you are inserting duplicate record into that global table. Can you show the query ??? On Jun 26, 2014 8:19 AM, "张伟" wrote: > I run hive-0.13.1 on hadoop-2.2.0. When I insert into an orc table, then i > get the following ERROR, indicating that Hive is trying to insert duplicate > entry

Re: Error in create table

Seems that you have created wrong table structure in hive metastore. Which hive are you using ?? you need to check which schema is required for your Hadoop version . On Jun 26, 2014 4:37 PM, "Rishabh Bhardwaj" wrote: > Hi all, > I have set mysql as my metastore but when I try to create a table

Re: Error in adding Hive UDF

Just export that path in your class path and restart megastore service. On Jun 27, 2014 7:26 PM, "Rishabh Bhardwaj" wrote: > Hi all, > I have a udf namely gwudf.jar > I have it on my local dir at /tmp/gwudf.jar ,and > also at hdfs at /user/hive/lib/gwudf.jar > > so when I am adding this jar, The

RE: Need urgent help

Are you able to see the file after giving full path like Hadoop fs -ls hdfs://$lpath:9000/pathToJar On Jul 2, 2014 10:17 AM, wrote: > The user has read permission > > Its > > rw-r—r— > > Thanks, > > Shouvanik > > > > *From:* hadoop hive [mailto:hadooph..

Re: ERROR 1115: Unsupported type: 5 in Pig's schema

Did you checked your .CSV file it must have same no of column. Scema looks good. On Jun 30, 2014 7:37 PM, "Carlotta Hicks" wrote: > Hi All! I created an hbase table and hcatalog table like the following: > > > > > > hive> describe formatted client; > > OK > > # col_name

RE: Need urgent help

xx.xxx:9000/user/ipg_intg_user/AP/scripts/lib/wsaUtils.jar > does not exist. > > > > > > > > > > *From:* hadoop hive [mailto:hadooph...@gmail.com] > *Sent:* Tuesday, July 01, 2014 8:58 PM > *To:* user@hive.apache.org > *Subject:* Re: Need urgent help > &

Re: Need urgent help

Check the permission and validate if jar is not corrupted. Apart from that you can put this jar inside in hive lib directory, that will be automatically read by hive. Thanks Vikas Srivastava On Jul 2, 2014 9:21 AM, wrote: > Hi, > > Cannot add a jar to hive classpath. > > Once I launch HIVE, I

ower of hive table

hi folks, I have a quick question, suppose I create a table in hive by a user and after sometime I want to change the owner of the table. 1- how can I change the owner of the table. 2- does I also need to change the directory owner 3- or what is the feasible way to do that. thanks hadoophive

RE: Exit Status for Success and Failure in HiveQL queries

Hey Jamal, You can use bash shell script combined with hive query, in shell script you can check for exit status. E.g :#!/bin/bashhive -e "show tables;"RET_VAL=$?if [ $RET_VAL -ne 0]; thenexit(1) - From: jamalrai...@gmail.com Date: Wed, 15 Aug 2012 17:03:14 -0700 Subject: Exit Status for

Re: Exception while running simple hive query

check for the permission.. On Mon, May 7, 2012 at 7:30 PM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: > I created a very simple hive table and then ran the following query that > should run a M/R job to return the results. > > hive> SELECT COUNT(*) FROM invites; > > But I am

Re: LOAD DATA problem

hey Sean, its becoz you are appending the file in same partition with the same name(which is not possible) you must change the file name before appending into same partition. AFAIK, i don't think that there is any other way to do that, either you can you partition name or the file name. Thanks V

Hive with JDBC

HI folks, I m facing a problem while when i fired a query through java code, its returns around half a million records which make the result set in hang state, please provide if there is any solution of that. Regards Vikas Srivastva

Remove Jobcache

Hi Folks, Do the hadoop/hive remove the jobcache present on data node, or we can say its clear that useless xml file after completing job. Or there is some configuration we can modify to remove it. Regards Ricks

Re: We cannot insert data to external table right?

But you can put the data at same place and read through hive (actually no need to insert data through table) On Wed, Mar 14, 2012 at 12:04 PM, Lu, Wei wrote: > Hi , > > ** ** > > Can we insert data to external hive tables? > > ** ** > > **1)**Create an external table > > create

need some Clarification about tmp folder(urgent)

Hi Folks, i Have some question like in my tmp folder on hdfs i have a user called hadoop whose having much space, i need to free this space so please help me out. * /tmp/hive-hadoop/hive_2012-03-13_04-32-14_701_8751021191431391338/-ext-10002/ * Is it part of data stored in hdfs or its just a te

Simple Hive Query

Hi Folks , i m facing a problem like i have a table a(k1 int ,k2 int ,k3 int ); and data present is like *9,*1,*3 3,4,5 12,32,54 *9,12,32 12,*9,21 i need row which doesn't have *9 in any fields. i wrote a query 1: select k1,k2,k3 from a where (k1<>'\*9' or k2<>'\*9' or k3<>'\*9'); 2: selec

Re: Doubt in INSERT query in Hive?

if you want to append data so you can you partitioning in that, crate partition everytime... On Wed, Feb 15, 2012 at 3:33 PM, Gabi D wrote: > Hi Bhavesh, > You could consider partitioning your table. Then every insert would be to > a different partition, not overwriting the previous ones, and a

Problem in reduce phase(critical)

On Fri, Feb 3, 2012 at 4:56 PM, hadoop hive wrote: > hey folks, > > i m getting this error while running mapreduce and these comes up in > reduce phase.. > > > 2012-02-03 16:41:19,780 WARN org.apache.hadoop.mapred.ReduceTask: > attempt_201201271626_528

Problem in reduce phase

hey folks, i m getting this error while running mapreduce and these comes up in reduce phase.. 2012-02-03 16:41:19,780 WARN org.apache.hadoop.mapred.ReduceTask: attempt_201201271626_5282_r_00_0 copy failed: attempt_201201271626_5282_m_07_2 from hadoopdata3 2012-02-03 16:41:19,954 WARN or

Re: Not able to create table in hive

Thanks Mark, I do have an access on metastore as I am login as admin. However when I query through Hue web interface it is working for me (using User: Guest). Here is how my hive-site.xml looks like. Is there any property that I need to extend here. javax.jdo.option.ConnectionURL jdbc:derby:

Re: move tables into different database

grate is > tbl_name. I should note that this worked for us for Hive 0.7.1, and we were > using a MySQL database for the metastore. > > Its certainly hacky, but did the job. Before you actually do the update > in the last step, you may want to test it thoroughly :). > > Sriram &g

Re: move tables into different database

e had a similar >> requirement in the past, and we wrote a shell script to update the MySQL >> metastore directly (obviously not the cleanest or recommended way to go). >> >> Cheers, >> Sriram >> >> From: hadoop hive >> Reply-To: >> Date: Mon, 30 Jan

jobtracker url(Critical)

Hey folks, i m facing a problem, with job Tracker URL, actually i added a node to the cluster and after sometime i restart the cluster, then i found that my job tracker is showing recent added node in *nodes * but rest of nodes are not available not even in *blacklist. * * * can any1 have any i

Re: JobTracker url shwoing less no of nodes available

*now On Tue, Jan 24, 2012 at 3:37 PM, hadoop hive wrote: > hey thanks Alex, > > not its working fine . > > Regards > Vikas Srivastava > > > On Tue, Jan 24, 2012 at 1:58 PM, alo alt wrote: > >> +common user BCC >> >> please post to the correct ma

Re: JobTracker url shwoing less no of nodes available

t; logs of the DNs. What says that? > > - Alex > > -- > Alexander Lorenz > http://mapredit.blogspot.com > > On Jan 24, 2012, at 7:55 AM, hadoop hive wrote: > > > HI Folks, > > > > i got a problem in my job tracker Url, its not Showing the actual no of

JobTracker url shwoing less no of nodes available

HI Folks, i got a problem in my job tracker Url, its not Showing the actual no of DN present in Cluster. any suggestion wats wrong with this, regards Vikas Srivastava

Re: Questions

yup Hive and Hbase Integration is gud to use. you can find those api in book*: the definitive guide * 2012/1/19 Dalia Sobhy > > Hey Vikas, > > I want to develop a medical API ... > > I want to ask whether Hive Hbase Integration performance is good or not, > because I found that Hive queries are

Re: Questions

hey Dalia , A: both are good its up to u what kinda data you are processing through them, for many row and billions of col you can you Hbase and if you need to update data on regular basis then u can you hbase, for hive you can store data and easy to use as SQL , easy fetching and all. for more

Re: Error while starting HiveServer

check your hosts file its should have the entry of NN . On Tue, Jan 17, 2012 at 5:36 PM, Bhavesh Shah wrote: > Hello, > While starting hive server I am getting error as: > hadoop@ubuntu:~/hive-0.7.1$ bin/hive --service hiveserver > Starting Hive Thrift Server > org.apache.thrift.transport.TTransp

dead datanode

hey folks, i have a issue, my data node is dead. where can i find the logs why its became dead and how to make it live without restarting the cluster. Thanks in advance

Re: Proper utilization of Map and reduce

is not uniformly distributed > across the cluster or so. Need detailed investigation, can't say in one > look. > > Regards > Bejoy.K.S > > -- > *From:* hadoop hive > *To:* user@hive.apache.org > *Sent:* Thursday, January 12, 2012 12:13 P

setOutputFormatClass

hey all, is *setOutputFormatClass *works in Java New Api ???, please tell me if u have any idea. regards ABC

Re: need help in Mapreduce(urgent)

Hey thanks for your reply i wanna ask that *setOutputFormatClass *works in Java New Api, please tell me if u have any idea. regards hadoophive On Mon, Jan 9, 2012 at 8:47 PM, Martin Kuhn wrote: > > > one more i wanna ask like how i can write output in different > directories according to key va

Re: need help in Mapreduce(urgent)

Thanks martin :) one more i wanna ask like how i can write output in different directories according to key values. On Mon, Jan 9, 2012 at 6:39 PM, Martin Kuhn wrote: > Hi Vikas, > > > 1:- How to format output from reduce( like default is tab separator can > we make it "," separator) > > If you