Re: incremental Checkpointing , Rocksdb HA

Thanks everyone, we were reasoning about the expense of drawing snapshots of large state as a major benenfits to using rocksdb compare to jdbc backend. Our use case is money related event processing. It requires keeping weeks long large window, major data source ingestion QPS is around hundreds, a

Re: Adding a Histogram Metric

Will the added metric be scoped appropriately (e.g. per operator)? Also, if the added metric is a Counter will it be available when listing counters in AbstractReporter? -Steve On Friday, June 17, 2016, Chesnay Schepler wrote: > That is currently not possible. We would have expose the internal

Re: Adding a Histogram Metric

Perfect! -Steve On Saturday, June 18, 2016, Chesnay Schepler wrote: > it would be scoped and reported just like any other Counter. > > Regards, > Chesnay > > On 18.06.2016 16:04, Steve Cosenza wrote: > > Will the added metric be scoped appropriately (e.g. per operator)? > Also, if the added met

Re: Adding a Histogram Metric

it would be scoped and reported just like any other Counter. Regards, Chesnay On 18.06.2016 16:04, Steve Cosenza wrote: Will the added metric be scoped appropriately (e.g. per operator)? Also, if the added metric is a Counter will it be available when listing counters in AbstractReporter? -S

Re: offheap memory allocation and memory leak bug

Hello, I repeated the same test with conf values. > taskmanager.heap.mb: 6500 > > taskmanager.memory.off-heap: true > > taskmanager.memory.fraction: 0.9 > > i set TM_MAX_OFFHEAP_SIZE="6G" in taskmanager sh. Taskmanager started with > capacman 14543 323 56.0 17014744 13731328 pts/1 Sl 16:23 35:

Re: Scheduling task slots in round-robin

I have opened a PR with my initial implementation, it seems to work well on the cluster at least for fairly simple jobs (haven't tried with iterations). It would be great to get some feedback before I start diving into the scheduler tests :) But no need

Adding a Histogram Metric

Hi Till, How would I plugin a custom counter so that I could use the existing MetricGroup and AbstractReporter functionality? Steve On Friday, June 17, 2016, Till Rohrmann > wrote: > Hi Steve, > > I thought again about the thread-safe counters and I'm not so sure anymore > whether we should add

Re: Adding a Histogram Metric

That is currently not possible. We would have expose the internal addMetric(String name, Metric metric) method. Regards, Chesnay On 18.06.2016 04:48, Steve Cosenza wrote: Hi Till, How would I plugin a custom counter so that I could use the existing MetricGroup and AbstractReporter functional