Re: A puzzy problem about flume Failover Sink Processor

2017-04-03 Thread hui.pan
Hi:     Thank you for your advise,and I will have a try.Regrads, Hollis Pan On 04/1/2017 21:18,Denes Arvay wrote: Hi,If you are using HDFS HA you don't have to do any special configuration on Flume side. One HDFS Sink is enough, just use the logical nameservice i

Re: A puzzy problem about flume Failover Sink Processor

2017-04-03 Thread hui.pan
Dear Chris:    Thank you for your reply.Do you mean how to maintain my namenodes when failover occurs?     I use ZKFailoverController which is is a new component in zookeeper for my two namenodes,it is a  Automatic Namenode failover process in Hadoop。   Then what's should I do?   Thanks.

Re: A puzzy problem about flume Failover Sink Processor

2017-04-01 Thread Chris Horrocks
The following error occurs when your flume agent tries to write to the standby NameNode: "Operation category WRITE is not supported in state standby" What failover mechanism are you using for your NameNodes? -- Chris Horrocks On Sat, Apr 1, 2017 at 11:31 am, hui@wbkit.com wrote: I have a

Re: A puzzy problem about flume Failover Sink Processor

2017-04-01 Thread Denes Arvay
Hi, If you are using HDFS HA you don't have to do any special configuration on Flume side. One HDFS Sink is enough, just use the logical nameservice id in the hdfs.path property instead of the host name. See: https://community.cloudera.com/t5/Data-Ingestion-Integration/Flume-HDFS-HA/td-p/29141 R