Re: Cannot download Jars from S3 due to resource timestamp changed

2019-04-08 Thread Till Rohrmann
Hi Yan and Tao Yang, thanks for raising this issue. Let's continue the discussion on the ticket in order to figure out a proper solution. Cheers, Till On Fri, Apr 5, 2019 at 11:23 PM Yan Yan wrote: > Hi Yantao, > > Thanks, I have also commented in the original JIRA. > https://issues.apache.org

Re: Cannot download Jars from S3 due to resource timestamp changed

2019-04-05 Thread Yan Yan
Hi Yantao, Thanks, I have also commented in the original JIRA. https://issues.apache.org/jira/browse/FLINK-8801?focusedCommentId=16807691&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel @Nico @Till Do you mind review if an alternative fix would be needed? If so, I can crea

Re: Cannot download Jars from S3 due to resource timestamp changed

2019-04-04 Thread yangtao.yt
Hi, Yan. we have met this problem too when using aliyun-pangu and have commented in FLINK-8801 but no response yet. I think most file systems including s3/s3a/s3n/azure/aliyun-oss etc can encounter this problem since they doesn’t implement FileSystem#setTimes but the PR in FLINK-8801 think they

Cannot download Jars from S3 due to resource timestamp changed

2019-04-04 Thread Yan Yan
Hi, I am running issues when trying to move from HDFS to S3 using Flink 1.6. I am getting an exception from Hadoop code: IOException("Resource " + sCopy + " changed on src filesystem (expected " + resource.getTimestamp() + ", was " + sStat.getModificationTime()); Digging into this, I f