Re: Flink batch app occasionally hang

2019-10-29 Thread Zhu Zhu
Hi Caio, Did you check whether there are enough resources to launch the other nodes? Could you attach the logs you mentioned? And elaborate how the tasks are connected in the topology? Thanks, Zhu Zhu Caio Aoque 于2019年10月30日周三 上午8:31写道: > Hi, I've been running some flink scala applications o

Re: Flink batch app occasionally hang

2019-10-29 Thread vino yang
Hi Caio, Because it involves interaction with external systems. It would be better if you can provide the full logs. Best, Vino Caio Aoque 于2019年10月30日周三 上午8:31写道: > Hi, I've been running some flink scala applications on an AWS EMR cluster > (version 5.26.0 with flink 1.8.0 for scala 2.11) for

Flink batch app occasionally hang

2019-10-29 Thread Caio Aoque
Hi, I've been running some flink scala applications on an AWS EMR cluster (version 5.26.0 with flink 1.8.0 for scala 2.11) for a while and I started to have some issues now. I have a flink app that reads some files from S3, process them and save some files to s3 and also some records to a database