Thanks for both of your help...
but...
I can not understand both:
------------------------------------------------------------------------------------------------
Dear David Anderson:
Is the whole command like this?
flink run --backpressure -c wordcount_increstate
datastream_api-1.0-SNAPSHOT.jar
------------------------------------------------------------------------------------------------
Dear Arvid Heise:
For conf.setInteger(RestOptions.PORT, RestOptions.PORT.defaultValue());
will this settings work to sleep when the output stream is generating?
------------------------------------------------------------------------------------------------
apologise for my poor basic knowledge of flink~
Thanks for both of your help~
------------------ ???????? ------------------
??????:
"David Anderson"
<dander...@apache.org>;
????????: 2020??10??9??(??????) ????8:23
??????: "Arvid Heise"<ar...@ververica.com>;
????: "??????"<appleyu...@foxmail.com>;"user"<user@flink.apache.org>;
????: Re: how to simulate the scene "back pressure" in flink?Thanks~!
The Flink Operations Playground includes an optional backpressure simulation
you can experiment with. It is described at the end of [1].
[1] https://ci.apache.org/projects/flink/flink-docs-release-1.11/try-flink/flink-operations-playground.html#variants
On Fri, Oct 9, 2020 at 10:02 AM Arvid Heise <ar...@ververica.com> wrote:
You can add
conf.setInteger(RestOptions.PORT, RestOptions.PORT.defaultValue());
at any place before creating the environment [1]. Default value is 8081, so you
can access web ui through http://localhost:8081, but you can really choose any
other free port.
[1]
https://github.com/apache/flink/blob/61a997364b020b44bd26df76208e76106c6390b5/flink-tests/src/test/java/org/apache/flink/test/checkpointing/UnalignedCheckpointITCase.java#L198
On Fri, Oct 9, 2020 at 9:24 AM ?????? <appleyu...@foxmail.com> wrote:
Thanks for your repies,
could you tell me where to set RestOption.POPT?in configuration
what's the value should I set for RestOption.PORT?
Thanks.
------------------ ???????? ------------------
??????:
"Arvid Heise"
<ar...@ververica.com>;
????????: 2020??10??9??(??????) ????3:00
??????: "??????"<appleyu...@foxmail.com>;
????: "David&nbsp,Anderson"<dander...@apache.org>;"user"<user@flink.apache.org>;
????: Re: how to simulate the scene "back pressure" in flink?Thanks~!
The easiest way to see backpressure is to add some sleep to your sink, check
[1] for an example.
If you execute that unit test with a RestOption.PORT set in the configuration,
you can even load the Web UI and watch the backpressure accumulate and finally
go away at the end of the test.
[1]
https://github.com/apache/flink/blob/61a997364b020b44bd26df76208e76106c6390b5/flink-tests/src/test/java/org/apache/flink/test/checkpointing/UnalignedCheckpointITCase.java#L536
On Tue, Oct 6, 2020 at 4:13 PM ?????? <appleyu...@foxmail.com> wrote:
I want to learn the concept "back pressure".
but I can not find the datastream generator example to generate a lot of data.
besides,
is there any example on how to simulate the scene "back pressure" in WEB
UI?
Thanks for your help~
--
Arvid Heise | Senior Java Developer
Follow us @VervericaData
--
Join Flink Forward - The Apache Flink Conference
Stream Processing | Event Driven | Real Time
--
Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany
--
Ververica GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji (Toni)
Cheng
--
Arvid Heise | Senior Java Developer
Follow us @VervericaData
--
Join Flink Forward - The Apache Flink Conference
Stream Processing | Event Driven | Real Time
--
Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany
--
Ververica GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji (Toni)
Cheng
