Hi all,
I am running Flink on a standalone cluster and getting very long
execution time for the streaming queries like WordCount for a fixed text
file. My VM runs on a Debian 10 with 16 cpu cores and 32GB of RAM. I
have a text file with size of 2GB. When I run the Flink on a standalone
cluste
a Gao*
On Tue, Oct 29, 2019 at 9:27 PM Habib Mostafaei
mailto:ha...@inet.tu-berlin.de>> wrote:
Hi all,
I am running Flink on a standalone cluster and getting very long
execution time for the streaming queries like WordCount for a
fixed text
file. My VM runs on a Debian
more runtime information would help figure outwheretheproblem is.
1) how many parallelisms actually working
2) the metrics for each operator
3) the jvm profiling information, etc
*Best Regards,*
*Zhenghua Gao*
On Wed, Oct 30, 2019 at 8:25 PM Habib Mostafaei
mailto:ha...@inet.tu-berlin.de
t 31, 2019 at 9:05 PM Habib Mostafaei
mailto:ha...@inet.tu-berlin.de>> wrote:
I enclosed all logs from the run and for this run I used
parallelism one. However, for other runs I checked and found that
all parallel workers were working properly. Is there a simple way
to get pro
ote profiling.
Piotrek
On 31 Oct 2019, at 14:05, Habib Mostafaei <mailto:ha...@inet.tu-berlin.de>> wrote:
I enclosed all logs from the run and for this run I used parallelism
one. However, for other runs I checked and found that all parallel
workers were working properly. Is there a s
:57, Habib Mostafaei <mailto:ha...@inet.tu-berlin.de>> wrote:
Hi Piotrek,
Thanks for the list of profilers. I used VisualVM and here is the
resource usage for taskManager.
Habib
On 11/1/2019 9:48 AM, Piotr Nowojski wrote:
Hi,
> Is there a simple way to get profiling informat
