Hi Thanks for the answer , then how can i measure the performance of flink ?
i want to run my application with both spark and flink . and want to measure the performance . so i can check how fast flink process my data as compare to spark. Regards prateek On Mon, May 9, 2016 at 2:17 AM, Ufuk Celebi <u...@apache.org> wrote: > Hey Prateek, > > On Fri, May 6, 2016 at 6:40 PM, prateekarora <prateek.arora...@gmail.com> > wrote: > > I have below information from spark . do i can get similar information > from > > Flink also ? if yes then how can i get that. > > You can get GC time via the task manager overview. > > The other metrics don't necessarily translate to Flink as Flink is not > executing your streaming program as mini-batches, but your program is > executed with continuous (long lived) operators. > > This means for example that shuffles are continiously exchanging data > and you can't easily look at "how long the shuffle took". Also, the > scheduler delay and serialization times are not that interesting for > Flink as the cost of this is amortized over one long-running job (e.g. > because zero if your job is running long enough ;)) and you don't > schedule and serialize the tasks multiple times. > > – Ufuk >
