API for containers?

2015-11-04 Thread Rick Mangi
Hello, I’m wondering if there’s currently any API (or other way) to find out which container would handle a theoretical key and what node that container is running on. The use-case I’m thinking of is if I wanted to run a rest service on each node which could handle queries against the current

Re: KafkaCheckPointManager is too slow

2015-11-04 Thread Chinmay Soman
Hey Jae , we've turned off log compaction because of issues seen earlier with the log compaction thread on kafka. We're still on 0.8.2 so we cant really turn it on. Our best bet is to set retention to like 3 hours or something. On Nov 4, 2015 12:18 AM, "Bae, Jae Hyeon" wrote: > Also, I am using

Re: KafkaCheckPointManager is too slow

2015-11-04 Thread Bae, Jae Hyeon
Hi Yi There are 8 partitions in the input topic. The size of checkpoint topic is 26 MB. segment.bytes26214400cleanup.policycompact On Tue, Nov 3, 2015 at 11:12 PM, Yi Pan wrote: > Hi, Jae, > > That's correct. I mentioned that just to confirm that checkpoint topic > should be log-compacted. The

Re: KafkaCheckPointManager is too slow

2015-11-04 Thread Bae, Jae Hyeon
Also, I am using Samza 0.9.1. On Wed, Nov 4, 2015 at 12:18 AM, Bae, Jae Hyeon wrote: > Hi Yi > > There are 8 partitions in the input topic. The size of checkpoint topic is > 26 MB. > > segment.bytes26214400cleanup.policycompact > > On Tue, Nov 3, 2015 at 11:12 PM, Yi Pan wrote: > >> Hi, Jae, >>