HI Robert,
I'm able to see taskmanage and jobmanager logs after I changed the
log4j.properties file (/usr/lib/flink/conf).
It seems to be a problem with EMR 6.1 distribution. the
log4j.properties files is different in the Flink package that I downloaded
and the one that comes with EMR 6.1. I repla
Hey Diwakar,
the logs you are providing still don't contain the full Flink logs.
You can not stop the Flink on YARN using "yarn app -stop
application_1603649952937_0002". To stop Flink on YARN, use: "yarn
application -kill ".
On Sat, Oct 31, 2020 at 6:26 PM Diwakar Jha wrote:
> Hi,
>
> I wan
Hi,
I wanted to check if anyone can help me with the logs. I have sent several
emails but not getting any response.
I'm running Flink 1.11 on EMR 6.1. I don't see any logs though I get this
stdout error. I'm trying to upgrade Flink 1.8 to Flink 1.11
18:29:19.834 [flink-akka.actor.default-dispatc
Hello,
I see that in my class path (below) I have both log4j-1 and lo4j-api-2. is
this because of which i'm not seeing any logs. If so, could someone suggest
how to fix it?
export
CLASSPATH=":lib/flink-csv-1.11.0.jar:lib/flink-json-1.11.0.jar:lib/flink-shaded-zookeeper-3.4.14.jar:lib/flink-table-
Hello Everyone,
I'm able to get my Flink UI up and running (it was related to the session
manager plugin on my local laptop) but I'm not seeing any
taskmanager/jobmanager logs in my Flink application. I have attached some
yarn application logs while it's running but am not able to figure out how
t
Hi Robert,
Could please correct me. I'm not able to stop the app. Also, i
stopped flink job already.
sh-4.2$ yarn app -stop application_1603649952937_0002
2020-10-27 20:04:25,543 INFO client.RMProxy: Connecting to ResourceManager
at ip-10-0-55-50.ec2.internal/10.0.55.50:8032
2020-10-27 20:04:25,71
Hey Diwakar,
how are you deploying Flink on EMR? Are you using YARN?
If so, you could also use log aggregation to see all the logs at once (from
both JobManager and TaskManagers). (yarn logs -applicationId )
Could you post (or upload somewhere) all logs you have of one run? It is
much easier for
This is what I see on the WebUI.
23:19:24.263 [flink-akka.actor.default-dispatcher-1865] ERROR
org.apache.flink.runtime.rest.handler.taskmanager.TaskManagerLogFileHandler
- Failed to transfer file from TaskExecutor
container_1603649952937_0002_01_04.
java.util.concurrent.CompletionException:
o
With Flink 1.11 reporters were refactored to plugins, and are now
accessible by default (so you no longer have to bother with copying jars
around).
Your configuration appears to be correct, so I suggest to take a look at
the log files.
On 10/25/2020 9:52 PM, Diwakar Jha wrote:
Hello Everyon
Hello Everyone,
I'm new to flink and i'm trying to upgrade from flink 1.8 to flink 1.11 on
an emr cluster. after upgrading to flink1.11 One of the differences that i
see is i don't get any metrics. I found out that flink 1.11 does not have
*org.apache.flink.metrics.statsd.StatsDReporterFactory* ja
10 matches
Mail list logo
