Re: BucketingSink - Could not invoke truncate while recovering from state

2019-08-27 Thread Gyula Fóra
Thats a nice observation! :) I haven't caught that. We need to check that for sure. Gyula On Tue, Aug 27, 2019 at 5:00 PM Kostas Kloudas wrote: > Hi Guyla, > > Thanks for looking into it. > I did not dig into it but in the trace you posted there is the line: > > Failed to TRUNCATE_FILE ... for

Re: BucketingSink - Could not invoke truncate while recovering from state

2019-08-27 Thread Kostas Kloudas
Hi Guyla, Thanks for looking into it. I did not dig into it but in the trace you posted there is the line: Failed to TRUNCATE_FILE ... for **DFSClient_NONMAPREDUCE_-1189574442_56** on 172.31.114.177 because **DFSClient_NONMAPREDUCE_-1189574442_56 is already the current lease holder**. The client

Re: BucketingSink - Could not invoke truncate while recovering from state

2019-08-27 Thread Gyula Fóra
Hi all! I am gonna try to resurrect this thread as I think I have hit the same issue with the StreamingFileSink: https://issues.apache.org/jira/browse/FLINK-13874 I don't have a good answer but it seems that we try to truncate before we get the lease (even though there is logic both in BucketingS

Re: BucketingSink - Could not invoke truncate while recovering from state

2019-02-23 Thread sohimankotia
Any help ? -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

BucketingSink - Could not invoke truncate while recovering from state

2019-02-19 Thread sohimankotia
Hi, I have streaming job ( Flink 1.5.5 ) which was running on Hadoop hortonworks cluster with 150 parallelism (25 * 6). It has checkpoint enabled . One of the host in Hadoop went down which caused job to restart container and restart from last checkpoint. But it could not restart due to followin