Re: java.io.IOException: NSS is already initialized

Same environment, new error. I can run the same docker image with my local Mac, but on K8S, this gives me this error. I can not think of any difference between local Docker and K8S Docker. Any hint will be helpful. Thanks 2018-11-02 23:29:32,981 INFO org.apache.flink.runtime.executio

Re: Savepoint failed with error "Checkpoint expired before completing"

Great, thanks for sharing that info. Gagan On Thu, Nov 1, 2018 at 1:50 PM Yun Tang wrote: > Haha, actually externalized checkpoint also support parallelism changes, > you could read my email >

Re: FileNotFoundException on starting the job

Thank you, Alex, much appreciated. I'll check if changing a temporary io folder helps to resolve the issue. -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Kinesis Connector

Hi Steve, I think we can check the following things step by step: 1. Confirm if the data source has data. 2. Take a look at the log of Taskmanager or Jobmanager and check if there are exceptions. 3. Take a thread dump to see what was doing in the TaskManager. Best, Hequn On Fri, Nov 2, 2018 at

Kinesis Connector

I have tried just about everything to get a simple Flink application to consume from Kinesis. The application appears to connect ( I think ), no complaints... never receives any data. Even a very simple JAVA app see attached. Any help would be very much appreciated. Thanks -- Sent from: ht

Re: Using a ProcessFunction as a "Source"

As an update, there is now also this FLIP for the source refactoring: https://cwiki.apache.org/confluence/display/FLINK/FLIP-27%3A+Refactor+Source+Interface > On 1. Nov 2018, at 20:47, Addison Higham wrote: > > This is fairly stale, but getting back to this: > > We ended up going the route of

Re: Window State is not being store on check-pointing

Thanks . It solved problem. -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Question about slot and yarn vcores

Let's assume I have yarn cluster with 3 nodes, 3 vcores each nodes. So total available cores = 9 Now if I spin a flink job with taskmanager = 3 and no. of slots per task manager = 2 ,what will happen : 1. 3 Jvms will be initiated (for each task manager) 2. Each JVM will run 2 threads for tasks .

Re: Starting a seperate Java process within a Flink cluster

The error is most likely due to classpath issue. Because classpath is different when you running flink program in IDE and run it in cluster. And starting another jvm process in SourceFunction doesn't seems a good approach to me, is it possible for you to do in your custom SourceFunction ? Ly, Th

Re: FileNotFoundException on starting the job

my guess is that tmp directory got cleaned on your host and Flink couldn't restore memory state from it upon startup. Take a look at https://ci.apache.org/projects/flink/flink-docs-stable/ops/config.html#configuring-temporary-io-directories article, I think it is relevant On Thu, Nov 1, 2018 at 8

Re: Starting a seperate Java process within a Flink cluster

Yes, i did. It is definitely there. I tried and made a separate Maven project to test if something was wrong with my jar. The resulting shaded jar of that test project was fine and the message-buffer-process was running with that test jar. Am 02.11.2018 04:47 schrieb Yun Tang : Hi Since you us

Re: Why dont't have a csv formatter for kafka table source

I already answered his question but forgot to CC the mailing list: Hi Jocean, a standard compliant CSV format for a Kafka table source is in the making right now. There is a PR that implements it [1] but it needs another review pass. It is high on my priority list and I hope we can finalize i

Re: Why dont't have a csv formatter for kafka table source

Hi Jocean, these kind of issues should go to the user mailing list. I've cross posted it there and put dev to bcc. Cheers, Till On Fri, Nov 2, 2018 at 6:43 AM Jocean shi wrote: > Hi all， > I have encountered a error When i want to register a table from kafka > using csv formatter. >

Re: Flink CEP Watermark Exception

Hi Austin, Could you provide jobmanagers and taksmanagers logs for a failed run? The exception you've posted is thrown during processing messages, rather than during restoring, but you said it failed to restore checkpoint, how come it processes messages? Could you also describe exact conditions st