Hi Max,
Yeah I tried that and its definitely better. Only a few points go missing
compared to a huge amount in the beginning. For now, its good for me and my
work.
Thanks a lot for the workaround.
-Biplob
--
View this message in context:
http://apache-flink-user-mailing-list-archive.233605
@Paris Thanks for the prompt feedback! I really have to check out your PR :)
@Biblop: If I understand correctly, a possible workaround in the
meantime seems to be to use `setBufferTimeout(0)` on your
StreamExecutionEnvironment. Could you try that?
On Wed, Jul 20, 2016 at 12:30 PM, Paris Carbone
This is possibly related to the way the queue between StreamIterationTail and
Head is currently implemented.
I think this part is a bit prone to records loss when things get wacky and
backpressure kicks in (but at least it avoids deadlocks, right?).
I don’t have the time availability to look int
CC Gyula and Paris in case they might want to help out.
On Tue, Jul 19, 2016 at 11:43 AM, Biplob Biswas
wrote:
> Hi Ufuk,
>
> Thanks for the update, is there any known way to fix this issue? Any
> workaround that you know of, which I can try?
>
>
>
> --
> View this message in context:
> http://a
Hi Ufuk,
Thanks for the update, is there any known way to fix this issue? Any
workaround that you know of, which I can try?
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Data-point-goes-missing-within-iteration-tp7776p8015.html
Sent from t
Unfortunately, no. It's expected for streaming iterations to loose
data (known shortcoming), but I don't see why they never see the
initial input. Maybe Gyula or Paris (they worked on this previously)
can chime in.
– Ufuk
On Tue, Jul 19, 2016 at 10:15 AM, Biplob Biswas
wrote:
> Hi Ufuk,
>
> Did
Hi Ufuk,
Did you get time to go through my issue, just wanted to follow up to see
whether I can get a solution or not.
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Data-point-goes-missing-within-iteration-tp7776p8010.html
Sent from the Ap
Hi,
Sorry for the late reply, was trying different stuff on my code. And from
what I observed, its very weird for me.
So after experimentation, I found out that when I increase the number of
centroids, the number of data points forwarded decreases, when I lower the
umber of centroids, the datapo
Any update?
On Wed, Jul 6, 2016 at 5:55 PM, Ufuk Celebi wrote:
> I couldn't tell anything from the code. I would suggest to reduce it
> to a minimal example with Integers where you do the same thing flow
> structure wise (with simple types) and let's check that again.
>
> On Wed, Jul 6, 2016 at 9
I couldn't tell anything from the code. I would suggest to reduce it
to a minimal example with Integers where you do the same thing flow
structure wise (with simple types) and let's check that again.
On Wed, Jul 6, 2016 at 9:35 AM, Biplob Biswas wrote:
> Thanks a lot, would really appreciate it.
Thanks a lot, would really appreciate it.
Also. please let me know if you don't understand it well, the documentation
is not really great at the moment in the code.
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Data-point-goes-missing-wit
Sorry Biplob, I didn't have time to look into your code today. I will
try to do it tomorrow though.
On Mon, Jul 4, 2016 at 2:53 PM, Biplob Biswas wrote:
> I have sent you my code in a separate email, I hope you can solve my issue.
>
> Thanks a lot
> Biplob
>
>
>
> --
> View this message in contex
I have sent you my code in a separate email, I hope you can solve my issue.
Thanks a lot
Biplob
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Data-point-goes-missing-within-iteration-tp7776p7798.html
Sent from the Apache Flink User Mailing
Can you share the complete program with me? Than I would look into it.
Could be that you count in a wrong way. The iteration should
definitely consume all the initial input once at least.
On Mon, Jul 4, 2016 at 12:07 PM, Biplob Biswas wrote:
> Can anyone check this once, and help me out with this
Can anyone check this once, and help me out with this?
I would be really obliged.
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Data-point-goes-missing-within-iteration-tp7776p7795.html
Sent from the Apache Flink User Mailing List archiv
15 matches
Mail list logo
