Re: Resource changed on src filesystem after upgrade

2021-01-29 Thread Mark Davis
Hi Xintong Song, > - Does this error happen for every of your dataset jobs? For a problematic > job, does it happen for every container? > - What is the `jobs.jar`? Is it under `lib/`, `opt` of your client side > filesystem, or specified as `yarn.ship-files`, `yarn.ship-archives` or > `yarn.pro

Re: Resource changed on src filesystem after upgrade

2021-01-18 Thread Till Rohrmann
It would also help if you could send us the DEBUG logs of the run Mark. Including the logs from the client because they contain information about which timestamp is used for the upload. One more question which could help pinpointing the problem: Does the problem start occurring with Flink 1.10.0? M

Re: Resource changed on src filesystem after upgrade

2021-01-18 Thread Xintong Song
Hi Mark, Two quick questions that might help us understand what's going on. - Does this error happen for every of your dataset jobs? For a problematic job, does it happen for every container? - What is the `jobs.jar`? Is it under `lib/`, `opt` of your client side filesystem, or specified as `yarn.

Resource changed on src filesystem after upgrade

2021-01-17 Thread Mark Davis
Hi all, I am upgrading my DataSet jobs from Flink 1.8 to 1.12. After the upgrade I started to receive the errors like this one: 14:12:57,441 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager - Worker container_e120_1608377880203_0751_01_000112 is terminated. Diagnostics: