Thanks, I'll check more about job tuning.
On Mon, 16 Aug 2021 at 06:28, Caizhi Weng wrote:
> Hi!
>
> if I use parallelism of 2 or 4 - it takes the same time.
>>
> It might be that there is no data in some parallelisms. You can click on
> the nodes in Flink web UI and see if it is the case for ea
Hi!
if I use parallelism of 2 or 4 - it takes the same time.
>
It might be that there is no data in some parallelisms. You can click on
the nodes in Flink web UI and see if it is the case for each parallelism,
or you can check out the metrics of each operator.
if I don't increase parallelism and
What about scaling up with #task slots left?
You can obtain this information from Flink's endpoint.
Cheers,
Sendoh
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Hi,
Any suggestions would really help. Thanks.
On Mon, Jan 15, 2018 at 12:07 AM, Navneeth Krishnan <
reachnavnee...@gmail.com> wrote:
> Hi All,
>
> Has anyone tried scaling out flink cluster on EMR based on CPU usage/
> kafka lag/ back pressure monitoring? If so can you provide some insights on
t; --
> Jonathan (Bill) Sparks
> Software Architecture
> Cray Inc.
>
> From: Stephan Ewen
> Reply-To: "user@flink.apache.org"
> Date: Friday, June 5, 2015 12:48 PM
> To: "user@flink.apache.org"
> Subject: Re: scaling flink
>
> It was supposed
ilto:user@flink.apache.org>"
mailto:user@flink.apache.org>>
Subject: Re: scaling flink
It was supposed to mean "please PING us" ;-)
On Fri, Jun 5, 2015 at 7:21 PM, Stephan Ewen
mailto:se...@apache.org>> wrote:
Hi Bill!
For the WordCount case, these numbers are not unexp
It was supposed to mean "please PING us" ;-)
On Fri, Jun 5, 2015 at 7:21 PM, Stephan Ewen wrote:
> Hi Bill!
>
> For the WordCount case, these numbers are not unexpected. Flink does not
> yet use a hash aggregator for the "reduce(v1, v2)" call, but uses a
> sort-based aggregation for that. Flink'
Hi Bill!
For the WordCount case, these numbers are not unexpected. Flink does not
yet use a hash aggregator for the "reduce(v1, v2)" call, but uses a
sort-based aggregation for that. Flink's sort aggregations are very
reliable and very scalable compared to many hash aggregations, but often
more ex
