Your solution works well, many thanks. This solves the exception that I
described previously.
However, in a different part of the script I come across another problem
about reusing data sets. For example, given the script at
https://gist.github.com/GEOFBOT/d670f567f8c886572c8715a6058f8b34, I get a
In this branch: https://github.com/zentol/flink/tree/new-iterations you
can find a more fine-grained fix for chaining with
iterations. relevant commit: ac2305d9589a5c6ab9e94d04c870fba52716d695
On 13.10.2016 23:11, Chesnay Schepler wrote:
The chaining code is definitely related, I also have a pre
The chaining code is definitely related, I also have a pretty clear idea
how to fix it.
The odd thing is that the Java API doesn't catch this type mismatch; the
date types are
known when the plan is generated. This kind of error shouldn't even happen.
On 13.10.2016 21:15, Geoffrey Mon wrote:
Thank you very much. Disabling chaining with the Python API allows my
actual script to run properly. The division by zero must be an issue with
the job that I posted on gist.
Does that mean that the issue must be in the chaining part of the API?
Chaining from the way I understand it is an importan
A temporary work around appears to be disabling chaining, which you can
do by commenting out L215 "self._find_chains()" in Environment.py.
Note that you then run into a division by zero error, but i can't tell
whether that is a problem of the job or not.
On 13.10.2016 13:41, Chesnay Schepler wr
Hey Geoffrey,
I was able to reproduce the error and will look into it in more detail
tomorrow.
Regards,
Chesnay
On 12.10.2016 23:09, Geoffrey Mon wrote:
Hello,
Has anyone had a chance to look into this? I am currently working on the
problem but I have minimal understanding of how the intern
Hello,
Has anyone had a chance to look into this? I am currently working on the
problem but I have minimal understanding of how the internal Flink Python
API works; any expertise would be greatly appreciated.
Thank you very much!
Geoffrey
On Sat, Oct 8, 2016 at 1:27 PM Geoffrey Mon wrote:
> H
Hi Chesnay,
Heh, I have discovered that if I do not restart Flink after running my
original problematic script, then similar issues will manifest themselves
in other otherwise working scripts. I haven't been able to completely
narrow down the problem, but I promise this new script will have a
Clas
Hello Geoffrey,
this one works for me as well :D
Regards,
Chesnay
On 28.09.2016 05:38, Geoffrey Mon wrote:
Hello Chesnay,
Thank you for your help. After receiving your message I recompiled my
version of Flink completely, and both the NullPointerException listed in
the TODO and the ClassCastEx
Hello Chesnay,
Thank you for your help. After receiving your message I recompiled my
version of Flink completely, and both the NullPointerException listed in
the TODO and the ClassCastException with the join operation went away.
Previously, I had been only recompiling the modules of Flink that had
Hello Geoffrey,
i could not reproduce this issue with the commits and plan you provided.
I tried out both the FLINK-4098 and bulk-iterations branches (and
reverted back to the specified commits) and built Flink from scratch.
Could you double check that the code you provided produces the error
Hello,
I'll try to take a look this week.
Regards,
Chesnay
On 20.09.2016 02:38, Geoffrey Mon wrote:
Hello all,
I have recently been working on adding bulk iterations to the Python API of
Flink in order to facilitate a research project I am working on. The
current changes can be seen in this G
Hello all,
I have recently been working on adding bulk iterations to the Python API of
Flink in order to facilitate a research project I am working on. The
current changes can be seen in this GitHub diff:
https://github.com/apache/flink/compare/master...GEOFBOT:e8c9833b43675af66ce897da9880c4f8cd16
13 matches
Mail list logo