Re: Kafka 0.11

The different versions of the connector correspond to different versions of Kafka. If you are using Kafka 0.8 use 0.8 connector, etc. Versions of the connector after 0.10 support exactly once delivery, versions prior to that only offer at least once delivery. Kafka supports distributed proces

Re: DFS problem with removing checkpoint

HI, the problem was started on 1.3.1. Now I upgraded to Flink 1.3.3. I changed my cluster to 1.3.3  because of jira https://issues.apache.org/jira/browse/FLINK-8807. I will check in debug mode why cluster doesn't remove those files, maybe i will see why. Best regards On 22.04.2018 16:59, St

Re: DFS problem with removing checkpoint

Hi! Sorry for the late response... In which Flink version are you? I am wondering if this is somewhat related to that specific setup: Windows DFS filesystem mounted on Linux with CIFS - For the "completedCheckpoint", the cleanup should happen in the "ZooKeeperCompletedCheckpointStore" when d

Re: WordCount with Flink Docker

bq. at getDefaultTextLineDataSet(WordCountData.java:70)( org.apache.flink.api.java.io.CollectionInputFormat) I think the above was part of stack trace indicating some parsing problem. (similarly with at main(SimpleExample.java:30)) In your program, I guess line 30 was for the amounts.filter call.

Re: WordCount with Flink Docker

Looking at flink-examples/flink-examples-batch/src/main/java/org/apache/flink/examples/java/wordcount/util/WordCountData.java , line 70 is return env.fromElements(WORDS); possibly indicating some long line in the DataSet. FYI On Sun, Apr 22, 2018 at 1:33 AM, JP de Vooght wrote: > Thank y

Re: WordCount with Flink Docker

Just to update that the messages of type "The operator name DataSource () exceeded the 80 characters length limit and was truncated" occur for other operations than print statements. I am still new with Flink and am specifically interested in print/logging statements. Using Wordcounter in batch wi

Join two data streams on a given key and diffrent common window size.

hi all, flink 1.4 or 1.5 only support Join two data streams as shown below： but i have two data streams A and B, i want make A and B each set its own window size， not a common size； if can do this ,i can join A (window size:1min , TumblingEventTimeWindow) and B (window size:5min，SlidingEvent

Re: WordCount with Flink Docker

Thank you Ted! I still get the message below... taskmanager_1  | The operator name DataSource (at getDefaultTextLineDataSet(WordCountData.java:70 (org.apache.flink.api.java.io .CollectionInputFormat)) exceeded the 80 characters length limit and was truncated.

Re: Kafka 0.11

Hi Piotr! In this page of the documentation [1] I can see the different versions of Kafka Connectors, but I am now learning about Kafka so some help would be valuable. 1 -- Are 0.8, 0.9, 0.11 etc different version of the same thing or do they same thing? I mean does 0.11 offers everything the 0.8