I think Till answered all your question but just to rephrase a bit.
1. The within and TimeCharacteristic are working on different levels. The
TimeCharacteristics tells how events are assigned a timestamp. The within
operator specifies the maximal time between first and last event of a
matched sequ
Hi Robert,
Thanks a lot for the reply.
To further explain how I verify the presence of duplicates, I write the
output stream received at the FlinkKafkaConsumer (after being sent from the
KafkaProducer) to a csv file.
Then the content of the file is scanned to see whether we received the exact
a
Yeah, this seems like a problem with flink check-pointing. The fact that
flink thinks that a checkpoint was successful, but in fact it wasn't.
On Jun 4, 2017 7:37 AM, "Tzu-Li (Gordon) Tai [via Apache Flink User Mailing
List archive.]" wrote:
> Thanks for the updates and testing efforts on this!
Thanks for the updates and testing efforts on this!
I’m sorry that I currently haven’t found the change to look closely into the
testing scenarios you’ve listed, yet.
But please keep us updated on this thread after testing it out also with the
Cloudera build.
One other suggestion for your test
Hi Shai,
Flink’s Kryo registrations do not allow specifying the registration ID. They
simply start from ID 10 ( < 10 is reserved by Kryo for primitive types).
My guess at what you’re observing here is that when trying to deserialize your
newly changed class instance, it also tries to read the e
I tested this with the standalone cluster, and I don't see this problem. So,
the problem could be that we haven't built Flink against cloudera Hadoop? I
will test it out.
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Fink-KafkaProducer-Data
Hi.
I'm running a job from a savepoint. I've changed one of the classes stored in
state. When I try to load the value from the state I get
"com.esotericsoftware.kryo.KryoException: Encountered unregistered class ID:
97".
I tried to understand if the problem arise from the nature of the change, o
Is it possible to return all windows update to single Sink (aggregated
collection).
The reason i am asking because we are using mysql for sink. I am wondering
if i can update all of the them in single batch so as to avoid possibly
avoid contention.
--
View this message in context:
http://apac
