Re: Unable to load data in hive table

Yea, it was just an example, as I didnt know your schema. Then you can do (cust_prof='Pilot') or (cust_prof='Teacher'). Does that work for you? On Tue, May 20, 2014 at 4:27 PM, Rahul Channe wrote: > Hi Szehon, > > I have following records in my File, I want to load the cust table such a > way

Re: Unable to load data in hive table

Hi Szehon, I have following records in my File, I want to load the cust table such a way that the records are partitioned based on profession 401,Kristina,Chung,55,Pilot 402,Paige,Chen,74,Teacher 403,Sherri,Melton,34,Firefighter 404,Gretchen,Hill,66,Computer hardware engineer 4000

Re: Unable to load data in hive table

In this kind of insert where you mention partition, you need to specify which partition. Example load data local inpath './custs' into table custs partition(cust_prof=1); On Mon, May 19, 2014 at 7:02 PM, Rahul Channe wrote: > I have created the following partitioned table in hive > > create ta

Re: Any idea how to find out how long map reduce jobs are running?

Wrap the sqoop job in a python subprocess. Run that process on a separate thread. On Tue, May 20, 2014 at 9:57 AM, wrote: > There is no specific map reduce program here. Actually sqoop jobs run > and internally that executes a map-reduce job. > > > > *From:* Brad Ruderman [mailto:bruder...@rad

RE: Any idea how to find out how long map reduce jobs are running?

There is no specific map reduce program here. Actually sqoop jobs run and internally that executes a map-reduce job. From: Brad Ruderman [mailto:bruder...@radiumone.com] Sent: Tuesday, May 20, 2014 9:54 AM To: user@hive.apache.org Subject: Re: Any idea how to find out how long map reduce jobs are

Re: Any idea how to find out how long map reduce jobs are running?

Wrap your map reduce job in a script or something, maybe a python script and monitor the job asynchronously. On Tue, May 20, 2014 at 9:51 AM, wrote: > Thanks for the quick reply, Brad. > > > > Actually, the requirement is, > > > > We have to write a monitor to track how long a map-reduce job

RE: Any idea how to find out how long map reduce jobs are running?

Thanks for the quick reply, Brad. Actually, the requirement is, We have to write a monitor to track how long a map-reduce job runs. If the map reduce job runs after a specific time, certain actions should be taken. Have you ever created one? Thanks, Shouvanik From: Brad Ruderman [mailto:brude

Re: Any idea how to find out how long map reduce jobs are running?

Check jobtracker. Or you could do: mapred job -list Thanks, Brad On Tue, May 20, 2014 at 9:35 AM, wrote: > Hi, > > > > I need help in finding how long a map-reduce job runs. Any help is highly > appreciated. > > > > Thanks, > > Shouvanik > > -- > > This message i

Any idea how to find out how long map reduce jobs are running?

Hi, I need help in finding how long a map-reduce job runs. Any help is highly appreciated. Thanks, Shouvanik This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received

How to notify ooze from hive

I want to start a workflow from oozie after an 'event' occurs in hive.  The event can be createTable or dropTable or dataInsert and so  on. I do not have access to any jms queue. How can I notify oozie from hive and start a workflow without using jms? thanks Santhosh

Re: How to detect new table creation in hive

For the benefit of others:   I was able to capture the CreateTable and DropTable events. Got the sample NotificationListener from hcatalog/server-extensions/src/main/java/org/apache/hcatalog/listener/NotificationListener.java - hive - Git at Google , removed unwanted stuff, packaged into a jar an

RE: How to detect new table creation in hive

Hi Santosh, This class already part of the Hive version 0.12 onwards in following location. $HIVE_HOME/hcatalog/share/hcatalog/hcatalog-server-extensions-0.12.0.jar Just make sure you run Hcatalog server instead of hive metastore. Thanks and Regard. Sunil Kumar From: Santhosh Thomas [mailto:sant

Re: How to detect new table creation in hive

Thanks Sunil. I am already close to  it. Where did you put the NotificationListener.class?   ~santhosh From: Sunil N Kumar To: "user@hive.apache.org" ; Santhosh Thomas Cc: Raptors Sent: Tuesday, May 20, 2014 2:22 PM Subject: RE: How to detect new table creation in hive Hi Santhosh,

RE: How to detect new table creation in hive

Hi Santhosh, I have used this in the Falcon for creating Hive process to manage Hive tables across multiple Hadoop cluster. Current Hcatalog publish an event to the Message Broker say Active MQ whenever new partition added or deleted in the Hive Metastore. Following setting needs to done at hive

How to detect new table creation in hive

Hello I am writing an application that detects new table creation in  hive. I came across attribute ' hive.metastore.event.listeners' in hive-default.xml, but could not find any usage samples. The API docs also does not describe much. Can someone please help? Is there a better way to detect n