Re: Checkpoint Error in flink with Rockdb state backend

2016-05-29 Thread Aljoscha Krettek
Ah yes, if you used a local filesystem for backups this certainly was the source of the problem. On Sun, 29 May 2016 at 17:57 arpit srivastava wrote: > I think the problem was that i was using local filesystem in a cluster. > Now I have switched to hdfs. > > Thanks, > Arpit > > On Sun, May 29, 2

Re: Checkpoint Error in flink with Rockdb state backend

2016-05-29 Thread arpit srivastava
I think the problem was that i was using local filesystem in a cluster. Now I have switched to hdfs. Thanks, Arpit On Sun, May 29, 2016 at 12:57 PM, Aljoscha Krettek wrote: > Hi, > could you please provide the code of your user function that has the > Checkpointed interface and is keeping state

Re: Checkpoint Error in flink with Rockdb state backend

2016-05-29 Thread Aljoscha Krettek
Hi, could you please provide the code of your user function that has the Checkpointed interface and is keeping state? This might give people a chance of understanding what is going on. Cheers, Aljoscha On Sat, 28 May 2016 at 20:55 arpit srivastava wrote: > Hi, > > I am using Flink on yarn clust

Checkpoint Error in flink with Rockdb state backend

2016-05-28 Thread arpit srivastava
Hi, I am using Flink on yarn cluster. My job was running for 2-3 days. After that it failed with two errors org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Error at remote task manager 'ip-xx.xx.xx.xxx'. at org.apache.flink.runtime.io.network.netty.PartitionR