RE: [E] RE: Recommendations on using multithreading in flink map functions in java

2023-08-18 Thread Schwalbe Matthias
@gmail.com>>; user@flink.apache.org<mailto:user@flink.apache.org>; dominik.buen...@swisscom.com<mailto:dominik.buen...@swisscom.com> Subject: Re: [E] RE: Recommendations on using multithreading in flink map functions in java ⚠EXTERNAL MESSAGE – CAUTION: Think Before You Click ⚠ Thanks R

Re: [E] RE: Recommendations on using multithreading in flink map functions in java

2023-08-15 Thread Vignesh Kumar Kathiresan via user
Thanks Ron and Thias, I understand flink parallelism works at task level. Distribute n subtasks of the operator across your cluster and parallel process the elements by distributing them across multiple instances of your operator. This gives me very high throughput. What I want to know is how to