HA lock nodes, Checkpoints, and JobGraphs not being removed after failure

2019-04-23 Thread dyana . rose
originally posted to the dev group, but it's a bit easy for things to get buried a bit there, and this may concern other HA users. Flink v1.7.1 After a Flink reboot we've been seeing some unexpected issues with excess retained checkpoints not being able to be removed from ZooKeeper after a new

Checkpoint/Savepoint error: Could not find any valid local directory

2019-04-16 Thread dyana . rose
When trying to savepoint or checkpoint we've begun getting this error: org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find any valid local directory for s3ablock-0001- I believe this error can occur when there's no space available. Task and Jo

Re: Problem producing to Kinesis

2018-06-15 Thread dyana . rose
Porting and rebuilding 1.4.x isn't a big issue. I've done it on our fork, back when I reported the upcoming issue and we're running fine. https://github.com/SaleCycle/flink/commit/d943a172ae7e6618309b45df848d3b9432e062d4 Ignore the circleci file of course, and the rest are the changes that I bac

Re: Unable to load AWS credentials: Flink 1.2.1 + S3 + Kubernetes

2018-03-28 Thread dyana . rose
Hiya, This sounds like it may be similar to the issue I had when running on ECS. Take a look at my ticket for how I got around this, and see if it's any help: https://issues.apache.org/jira/browse/FLINK-8439 Dyana On 2018/03/28 02:15:06, "Bajaj, Abhinav" wrote: > Hi, > > I am trying to use

Re: Basic question about flink programms

2018-03-16 Thread dyana . rose
In general I'd expect that every class with state that you use in Flink will be serialised, and therefore you should be marking your classes as Serializable and set a serialVersionUID I have what sounds like a very similar problem to yours. I need to use a non-serializable component in my strea

Re: Kinesis Connector SequenceNumber deserialisation on restart from Savepoint/checkpoint

2018-02-28 Thread dyana . rose
nevermind :) PEBKAC error. using the CLI and specifying the switches in the wrong location. Hopefully this will not be followed by an 'actually... there's still this other issue' post On 2018/02/28 15:38:29, dyana.r...@salecycle.com wrote: > 2018-02-28 15:16:36,675 INFO > org.apache.flink

Re: Kinesis Connector SequenceNumber deserialisation on restart from Savepoint/checkpoint

2018-02-28 Thread dyana . rose
should note this is under 1.4.1 On 2018/02/28 15:38:29, dyana.r...@salecycle.com wrote: > 2018-02-28 15:16:36,675 INFO > org.apache.flink.api.java.typeutils.TypeExtractor - class > org.apache.flink.streaming.connectors.kinesis.model.SequenceNumber does not > contain a setter for

Kinesis Connector SequenceNumber deserialisation on restart from Savepoint/checkpoint

2018-02-28 Thread dyana . rose
2018-02-28 15:16:36,675 INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.flink.streaming.connectors.kinesis.model.SequenceNumber does not contain a setter for field sequenceNumber 2018-02-28 15:16:36,675 INFO org.apache.flink.api.java.typeutils.TypeExtracto