Re: Flink takes 40ms ~ 100ms to proceed from one operator to another?

The previous email seems unable to display embedded images, let me put on the links. > Hi, > > My team and I try to measure total time spent on our flink job and found > out that Flink takes 40ms ~ 100ms to proceed from one operator to another. > I wonder how can we reduce this transition time. >

Flink takes 40ms ~ 100ms to proceed from one operator to another?

Hi, My team and I try to measure total time spent on our flink job and found out that Flink takes 40ms ~ 100ms to proceed from one operator to another. I wonder how can we reduce this transition time. Following DAG represents our job: and here is the screenshot of our log: at 19:37:04.564, the

Re: Unsure how to further debug - operator threads stuck on java.lang.Thread.State: WAITING

Miguel, I and my colleague ran into same problem yesterday. We were expecting Flink to get 4 inputs from Kafka and write the inputs to Cassandra, but the operators got stuck after the 1st input is written into Cassandra. This is how DAG looks like: Source: Custom Source -> Map -> (Sink: Unnamed, Si

Two questions on Flink externalized checkpoints

I left a question on stackoverflow ( https://stackoverflow.com/questions/49712817/two-questions-on-flink-externalized-checkpoints) and ask again in mail-list in case you check mail more often. I have two questions on Flink externalized checkpoints (Q1) I can set "state.checkpoints.dir" in flink-c

Anyway to read Cassandra as DataStream/DataSet in Flink?

Hi, I tried to treat Cassandra as the source of data in Flink with the information provided in the following links: - https://stackoverflow.com/questions/43067681/read-data-from-cassandra-for-processing-in-flink - https://www.javatips.net/api/flink-master/flink-examples/flink-examples-streaming/sr

Re: Example PopularPlacesFromKafka fails to run

uot;); sb.append(passengerCnt).append(","); sb.append(taxiId).append(","); sb.append(driverId); return sb.toString(); } This is a UTF-8 formatted mail --- James C.-C.Yu +886988713275 2018-03-23 9:59 GMT+08:00 Jame

Re: Example PopularPlacesFromKafka fails to run

- James C.-C.Yu +886988713275 2018-03-23 8:06 GMT+08:00 James Yu : > Hi, > > I fail to run the PopularPlacesFromKafka example with the following > exception, and I wonder what might cause this "Invalid record" error? > > when runn

Example PopularPlacesFromKafka fails to run

Hi, I fail to run the PopularPlacesFromKafka example with the following exception, and I wonder what might cause this "Invalid record" error? when running within Intellij IDEA --> 07:52:23.960 [Source: Custom Source -> Map (7/8)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Custom S

how does SQL mode work with PopularPlaces example?

Hi, I am following the PopularPlacesSQL example ( http://training.data-artisans.com/exercises/popularPlacesSql.html), but I am unable to understand why the following statement will pickup events with START flag only. "SELECT " + "toCoords(cell), wstart, wend, isStart, popCnt " + "FROM " + "(SELEC

Re: unable to addSource to StreamExecutionEnvironment?

-- James C.-C.Yu +886988713275 2018-03-20 16:55 GMT+08:00 James Yu : > Hi, > > I am following the Taxi example provided on "http://training.data- > artisans.com/exercises/taxiData.html", however, I got the following error > message when I copy addSource line into my Intellij ID

unable to addSource to StreamExecutionEnvironment?

Hi, I am following the Taxi example provided on " http://training.data-artisans.com/exercises/taxiData.html";, however, I got the following error message when I copy addSource line into my Intellij IDE. error message --> Incompatible types. Required DataStream but 'addSource' was inferred to Data