Re: calling avro RPC in a customized sink

2014-08-13 Thread terrey shih
thanks. Sharninder On Tue, Aug 12, 2014 at 1:26 AM, Sharninder wrote: > The purpose of a sink is to take events from a channel and pass it on to a > further destination. That destination can be anything, including your > another program listening on rpc. > > > > On Tue, Aug 12, 2014 at 1:26 PM,

The znode for the -ROOT- region doesn't exist! ERROR

2014-08-13 Thread terrey shih
Hi, I have the flume setup using asynchbase sink to write to Hbase server locally and everything works fine on my local machine. However when I configured it to connect to a remote hadoop server using the hbase-site.xml. I got the following error. ERROR [main-EventThread] (HBaseClient.java:2860

Re: The znode for the -ROOT- region doesn't exist! ERROR

2014-08-13 Thread Jonathan Natkins
Hey Gary, >From the information I've got here, this looks like more of an HBase problem than a Flume problem. My recommendation would be to first double check that you can run commands against the HBase instance from your Flume agent node. Try running `hbase shell` and execute a list command. If y

Re: The znode for the -ROOT- region doesn't exist! ERROR

2014-08-13 Thread Hari Shreedharan
Actually what version of Flume are you using? ROOT was removed in Hbase 96 I think, you need to use Flume 1.5.0 or higher for asynchbase sink to work. On Wed, Aug 13, 2014 at 4:51 PM, Jonathan Natkins wrote: > Hey Gary, > > From the information I've got here, this looks like more of an HBase >

Re: The znode for the -ROOT- region doesn't exist! ERROR

2014-08-13 Thread terreyshih
Thanks Natty. Yes, Hari. I am using flume 1.5. I will double check the configuration again just to make sure. thanks On Aug 13, 2014, at 4:56 PM, Hari Shreedharan wrote: > Actually what version of Flume are you using? ROOT was removed in Hbase 96 I > think, you need to use Flume 1.5.0 or hi

performance of Using AsyncHbaseEventSerializer to write to Hbase

2014-08-13 Thread terreyshih
Hi, I am using asynchbase for dropping data in the Hbase table . On my development environment, I have a client agent running on one vm and a server agent (which also has HBase locally installed) running on another vm. I have a serializer that extends the AsyncHbaseEventSerializer class and w

flume failover only support two nodes?

2014-08-13 Thread 基勇
Hello,guys I tested flume failover feature found failover support only two nodes, may I ask whether it is so?‍ config file: storm@storm01:~/apache-flume-1.5.0-bin/conf$ more flume-sink.properties #Name the compents on this agent a1.sources = r1 a1.sinks = k1 k2 k3 k4 a1.channels = c1 #D

Re: flume failover only support two nodes?

2014-08-13 Thread Hari Shreedharan
Each sink needs to have a different priority. If multiple sinks have same priority, only one of them will be used. 基勇 wrote: Hello,guys I tested flume failover feature found failover support only two nodes, may I ask whether it is so?‍ config file: storm@storm01:~/apache-flume-1.5.0-bin/conf$

Re: flume failover only support two nodes?

2014-08-13 Thread Jeff Lord
Also all of your sinks are pointing to the same host for the next hop. So if the agent on that host is unavailable for some reason than failover is pointless. For testing this ok, for production there is a better way. On Wednesday, August 13, 2014, Hari Shreedharan wrote: > Each sink needs to ha