Re: Question about Samza Metrcis

2016-09-08 Thread 舒琦
Hi Navina, Thanks for your clear description, I understand more now. ShuQi 舒琦 地址:长沙市岳麓区文轩路27号麓谷企业广场A4栋1单元6F 网址:http://www.eefung.com 微博:http://weibo.com/eefung 邮编:410013 电话:400-677-0986 传真:0731-88519609 > 在 2016年9月9日,04:19,Navina Ramesh 写道: > > Hi ShuQi, > > Auto-creation of streams

Re: Question about Samza Metrcis

2016-09-08 Thread Navina Ramesh
Hi ShuQi, Auto-creation of streams depends on your Kafka server configuration. In case of coordinator stream and checkpoint stream, samza explicitly creates a stream with 1 partition before publishing to it. This doesn't apply for metrics. So, if auto-creation is turned off in kafka server, then y

Re: Question about Samza Metrcis

2016-09-07 Thread 舒琦
Hi, Thanks for your help. I think checkpoint stream and coordinate stream will be auto-create per job if using kaka, but not metrics. After I manually created metrics stream in Kafka, the metrics is written into the stream. ShuQi > 在 2016年9月7日,23:15,Jagadish Venkatraman 写道: > > Can you ru

Re: Question about Samza Metrcis

2016-09-07 Thread Jagadish Venkatraman
Can you run your program in DEBUG log-level? Does sending the metric to the producer fail? Is the metric reporter thread showing an exception? (check the stderr file too) Producing to a kafka topic should usually auto-create it. On Wed, Sep 7, 2016 at 2:09 AM, 舒琦 wrote: > Hi, > > My samza job h

Question about Samza Metrcis

2016-09-07 Thread 舒琦
Hi, My samza job has following metrics configuration: serializers.registry.metrics.class=org.apache.samza.serializers.MetricsSnapshotSerdeFactory systems.kafka.samza.factory=org.apache.samza.system.kafka.KafkaSystemFactory systems.kafka.consumer.zookeeper.connect=zk11:3181,zk12:3181,zk13:3181 sy