Re: Flink State monitoring

2018-05-11 Thread Juho Autio
stuff that we should have >>>> at some point. >>>> >>>> One thing that comes to mind is checking the size of checkpoints, which >>>> gives you an indirect way of figuring out how big state is but that's not >>>> very exact, i.e. doesn't

Re: Flink State monitoring

2018-04-24 Thread Juho Autio
;> Aljoscha >>> >>> > On 20. Dec 2017, at 08:09, Netzer, Liron >>> wrote: >>> > >>> > Ufuk, Thanks for replying ! >>> > >>> > Aljoscha, can you please assist with the questions below? >>> > >>> > Thanks,

Re: Flink State monitoring

2018-04-20 Thread Stefan Richter
;> > Ufuk, Thanks for replying ! >> > >> > Aljoscha, can you please assist with the questions below? >> > >> > Thanks, >> > Liron >> > >> > -Original Message- >> > From: Ufuk Celebi [mailto:u...@apache.org <mailto:u..

Re: Flink State monitoring

2018-04-20 Thread Juho Autio
>> Best, >> Aljoscha >> >> > On 20. Dec 2017, at 08:09, Netzer, Liron wrote: >> > >> > Ufuk, Thanks for replying ! >> > >> > Aljoscha, can you please assist with the questions below? >> > >> > Thanks, >> > Liron >> > >

Re: Flink State monitoring

2018-04-20 Thread Stefan Richter
below? > > > > Thanks, > > Liron > > > > -Original Message- > > From: Ufuk Celebi [mailto:u...@apache.org <mailto:u...@apache.org>] > > Sent: Friday, December 15, 2017 3:06 PM > > To: Netzer, Liron [ICG-IT] > > Cc: user@flink.apach

Re: Flink State monitoring

2018-04-20 Thread Stefan Richter
replying ! > > > > Aljoscha, can you please assist with the questions below? > > > > Thanks, > > Liron > > > > -Original Message- > > From: Ufuk Celebi [mailto:u...@apache.org <mailto:u...@apache.org>] > > Sent: Friday, December 1

Re: Flink State monitoring

2018-04-20 Thread Juho Autio
gt;> Aljoscha >> >> > On 20. Dec 2017, at 08:09, Netzer, Liron wrote: >> > >> > Ufuk, Thanks for replying ! >> > >> > Aljoscha, can you please assist with the questions below? >> > >> > Thanks, >> > Liron >

Re: Flink State monitoring

2018-01-04 Thread Steven Wu
the questions below? > > > > Thanks, > > Liron > > > > -Original Message- > > From: Ufuk Celebi [mailto:u...@apache.org] > > Sent: Friday, December 15, 2017 3:06 PM > > To: Netzer, Liron [ICG-IT] > > Cc: user@flink.apache.org >

Re: Flink State monitoring

2018-01-04 Thread Aljoscha Krettek
w? > > Thanks, > Liron > > -Original Message- > From: Ufuk Celebi [mailto:u...@apache.org] > Sent: Friday, December 15, 2017 3:06 PM > To: Netzer, Liron [ICG-IT] > Cc: user@flink.apache.org > Subject: Re: Flink State monitoring > > Hey Liron, > >

RE: Flink State monitoring

2017-12-19 Thread Netzer, Liron
Ufuk, Thanks for replying ! Aljoscha, can you please assist with the questions below? Thanks, Liron -Original Message- From: Ufuk Celebi [mailto:u...@apache.org] Sent: Friday, December 15, 2017 3:06 PM To: Netzer, Liron [ICG-IT] Cc: user@flink.apache.org Subject: Re: Flink State

Re: Flink State monitoring

2017-12-15 Thread Ufuk Celebi
Hey Liron, unfortunately, there are no built-in metrics related to state. In general, exposing the actual values as metrics is problematic, but exposing summary statistics would be a good idea. I'm not aware of a good work around at the moment that would work in the general case (taking into accou