Re: Samza compaction policy

2019-11-06 Thread Prateek Maheshwari
Hi Malcolm, Using cleanup.policy=compact on the Kafka checkpoint topic should be sufficient, and is the default when the topic is created by Samza. Under normal operations, a checkpoint topic should only have ~ num task messages. I can suggest the following ways to identify the issue: 1. Read th

[DISCUSS] Samza 1.3 release

2019-11-06 Thread Hai Lu
Hi all, It's been some time since our last release and we have accumulated some good features/improvements which call for a new 1.3 release. Want to kick off the discussion in the open source forum while we have already tested many of these changes internally at LinkedIn. As a quick highlight of