Re: Flink Memory analyze on AWS EMR

2020-05-13 Thread Jacky D
n issue > to improve the docs. > > Thank you~ > > Xintong Song > > > [1] > https://ci.apache.org/projects/flink/flink-docs-stable/monitoring/application_profiling.html#profiling-with-jitwatch > > On Wed, May 13, 2020 at 2:45 AM Jacky D wrote: > >> hi, Arvid >

Re: Flink Memory analyze on AWS EMR

2020-05-12 Thread Jacky D
s Jacky Arvid Heise 于2020年5月12日周二 下午12:57写道: > Hi Jacky, > > I suspect that the quotes are the actual issue. Could you try to remove > them? See also [1]. > > [1] > http://blogs.perl.org/users/tinita/2018/03/strings-in-yaml---to-quote-or-not-to-quote.html > > On T

Re: Flink Memory analyze on AWS EMR

2020-05-12 Thread Jacky D
d post the result and a few lines before & after that? This is not > included in the clip of attached log file. > > Thank you~ > > Xintong Song > > > > On Tue, May 12, 2020 at 5:33 AM Jacky D wrote: > >> hi, Robert >> >> Thanks so much for

Re: Flink Memory analyze on AWS EMR

2020-05-11 Thread Jacky D
> https://github.com/apache/flink/blob/release-1.6/flink-yarn/src/main/java/org/apache/flink/yarn/AbstractYarnClusterDescriptor.java#L1630 > > > On Mon, May 11, 2020 at 9:56 PM Jacky D wrote: > >> Hi,Robert >> >> Yes , I tried to retrieve more log info from yarn UI

Re: Flink Memory analyze on AWS EMR

2020-05-11 Thread Jacky D
> Have you tried retrieving the YARN application logs? > Does the YARN UI / resource manager logs reveal anything on the reason for > the deployment to fail? > > Best, > Robert > > > On Mon, May 11, 2020 at 9:34 PM Jacky D wrote: > >> >> >> --

Fwd: Flink Memory analyze on AWS EMR

2020-05-11 Thread Jacky D
-- Forwarded message - 发件人: Jacky D Date: 2020年5月11日周一 下午3:12 Subject: Re: Flink Memory analyze on AWS EMR To: Khachatryan Roman Hi, Roman Thanks for quick response , I tried without logFIle option but failed with same error , I'm currently using flink 1.6

Flink Memory analyze on AWS EMR

2020-05-11 Thread Jacky D
hi, All I'm encounter a memory issue with my flink job on AWS EMR(current flink version 1.6.2) , I would like to find the root cause so I'm trying JITWatch on my local standalone cluster but I can not use it on EMR . after I add following config on flink-conf.yaml : env.java.opts: "-XX:+UnlockDia