Re: Flink State monitoring

2018-05-11 Thread Juho Autio
stuff that we should have >>>> at some point. >>>> >>>> One thing that comes to mind is checking the size of checkpoints, which >>>> gives you an indirect way of figuring out how big state is but that's not >>>> very exact, i.e. doesn't

Re: Flink State monitoring

2018-04-24 Thread Juho Autio
;> Aljoscha >>> >>> > On 20. Dec 2017, at 08:09, Netzer, Liron >>> wrote: >>> > >>> > Ufuk, Thanks for replying ! >>> > >>> > Aljoscha, can you please assist with the questions below? >>> > >>> > Thanks,

Re: Flink State monitoring

2018-04-20 Thread Stefan Richter
;> > Ufuk, Thanks for replying ! >> > >> > Aljoscha, can you please assist with the questions below? >> > >> > Thanks, >> > Liron >> > >> > -Original Message- >> > From: Ufuk Celebi [mailto:u...@apache.org <mailto:u..

Re: Flink State monitoring

2018-04-20 Thread Juho Autio
>> Best, >> Aljoscha >> >> > On 20. Dec 2017, at 08:09, Netzer, Liron wrote: >> > >> > Ufuk, Thanks for replying ! >> > >> > Aljoscha, can you please assist with the questions below? >> > >> > Thanks, >> > Liron >> > >

Re: Flink State monitoring

2018-04-20 Thread Stefan Richter
below? > > > > Thanks, > > Liron > > > > -Original Message- > > From: Ufuk Celebi [mailto:u...@apache.org <mailto:u...@apache.org>] > > Sent: Friday, December 15, 2017 3:06 PM > > To: Netzer, Liron [ICG-IT] > > Cc: user@flink.apach

Re: Flink State monitoring

2018-04-20 Thread Stefan Richter
replying ! > > > > Aljoscha, can you please assist with the questions below? > > > > Thanks, > > Liron > > > > -Original Message- > > From: Ufuk Celebi [mailto:u...@apache.org <mailto:u...@apache.org>] > > Sent: Friday, December 1

Re: Flink State monitoring

2018-04-20 Thread Juho Autio
gt;> Aljoscha >> >> > On 20. Dec 2017, at 08:09, Netzer, Liron wrote: >> > >> > Ufuk, Thanks for replying ! >> > >> > Aljoscha, can you please assist with the questions below? >> > >> > Thanks, >> > Liron >

Re: Flink State monitoring

2018-01-04 Thread Steven Wu
the questions below? > > > > Thanks, > > Liron > > > > -Original Message- > > From: Ufuk Celebi [mailto:u...@apache.org] > > Sent: Friday, December 15, 2017 3:06 PM > > To: Netzer, Liron [ICG-IT] > > Cc: user@flink.apache.org >

Re: Flink State monitoring

2018-01-04 Thread Aljoscha Krettek
w? > > Thanks, > Liron > > -Original Message- > From: Ufuk Celebi [mailto:u...@apache.org] > Sent: Friday, December 15, 2017 3:06 PM > To: Netzer, Liron [ICG-IT] > Cc: user@flink.apache.org > Subject: Re: Flink State monitoring > > Hey Liron, > >

RE: Flink State monitoring

2017-12-19 Thread Netzer, Liron
Ufuk, Thanks for replying ! Aljoscha, can you please assist with the questions below? Thanks, Liron -Original Message- From: Ufuk Celebi [mailto:u...@apache.org] Sent: Friday, December 15, 2017 3:06 PM To: Netzer, Liron [ICG-IT] Cc: user@flink.apache.org Subject: Re: Flink State

Re: Flink State monitoring

2017-12-15 Thread Ufuk Celebi
Hey Liron, unfortunately, there are no built-in metrics related to state. In general, exposing the actual values as metrics is problematic, but exposing summary statistics would be a good idea. I'm not aware of a good work around at the moment that would work in the general case (taking into accou

Flink State monitoring

2017-12-14 Thread Netzer, Liron
Hi group, We are using Flink keyed state in several operators. Is there an easy was to expose the data that is stored in the state, i.e. the key and the values? This is needed for both monitoring as well as debugging. We would like to understand how many key+values are stored in each state and a