Re: Looking for online live training courses

2021-06-11 Thread B.B.
There are some beginner courses on Pluralsight. Just look for those with newer dates. BR, BB On Fri, 11 Jun 2021 at 03:33, Xia(Nate) Qu wrote: > Hi all, > > My team is planning to start our journey of Apache Flink, was wondering if > there are any professional training courses (online interacti

Re: Time needed to read from Kafka source

2021-05-27 Thread B.B.
t; *ObjectValidator.of().getValidator()* in a field to be sure that it's not > a pricey construction. > Did you evaluate what happens when you skip the validation entirely in > terms of records/s? > > On Thu, May 27, 2021 at 11:18 AM B.B. wrote: > >> I am having a prob

Re: Time needed to read from Kafka source

2021-05-27 Thread B.B.
First identify what's the source of the >> bottleneck and then try to understand what's causing it. >> >> Best, >> Piotrek >> >> [1] busyTimeMsPerSecond is available since Flink 1.13. Flink 1.13 also >> comes with nice tools to analyse bottleneck

Re: Time needed to read from Kafka source

2021-05-26 Thread B.B.
irst identify what's the source of the > bottleneck and then try to understand what's causing it. > > Best, > Piotrek > > [1] busyTimeMsPerSecond is available since Flink 1.13. Flink 1.13 also > comes with nice tools to analyse bottlenecks in the WebUI (coloring nod

Re: Time needed to read from Kafka source

2021-05-26 Thread B.B.
at's causing it. >> >> Best, >> Piotrek >> >> [1] busyTimeMsPerSecond is available since Flink 1.13. Flink 1.13 also >> comes with nice tools to analyse bottlenecks in the WebUI (coloring nodes >> in the job graph based on busy/back pressured status and

Time needed to read from Kafka source

2021-05-25 Thread B.B.
Hi, I am in the process of optimizing my job which at the moment by our thinking is too slow. We are deploying job in kubernetes with 1 job manager with 1gb ram and 1 cpu and 1 task manager with 4gb ram and 2 cpu-s (eg. 2 task slots and parallelism of two). The main problem is one kafka source t

Union of more then two streams

2021-04-02 Thread B.B.
Hi, I have an architecture question regarding the union of more than two streams in Apache Flink. We are having three and sometime more streams that are some kind of code book with whom we have to enrich main stream. Code book streams are compacted Kafka topics. Code books are something that does