Hi All,
As per this article:
http://www.confluent.io/blog/290-reasons-to-upgrade-to-apache-kafka-0.9.0.0
there are some well know bugs and feature improvements around log
compaction (state full management in Samza) and Replication. I also saw in
Samza issues about this upgrade:
https://issues.apache.org/jira/browse/SAMZA-855. My questions here:
* Do you guys experience issue with Kafka when it is used with log
compaction for Samza's state full management?
* What is the avg number of keys per partition that you have observed in
Kafka's log compacted topic for state full management, total number of
partition, replication factor and number of Kafka brokers?
* Will Kafka 0.9 upgrade will be included as part of Samza 0.10.1 as it
seems critical if Samza is used for stateful management? And what is the
timeline for Samza 0.10.1 that you are expecting?
* What is recommendation between the usage of Samza vs Kafka connect?
Should we use Samza for state full management and Kafka connect for other
stateless streaming soslution?
Thanks,
Nick
