Samza compaction policy

2019-11-05 Thread Malcolm McFarland
Hey folks, We have cleanup.policy=compact set on our checkpoint topics. Even with this, we have almost 3 billion messages in some of these topics, and this is causing huge startup times. Are there any other settings we should set to optimize our startup times? Cheers, Malcolm McFarland Cavulus

Re: [DISCUSS] SEP-20: Samza on Kubernetes

2019-11-05 Thread Yi Pan
+1! Great to see this coming through! -Yi On Mon, Nov 4, 2019 at 9:20 PM Jagadish Venkatraman wrote: > +1, look forward to Samza K8s integration :) > > On Monday, November 4, 2019, Xinyu Liu wrote: > > > +1 on the design. This is a great feature to allow Samza to expand its > > deployment to K