Re: Using data classes in pyflink

2025-01-16 Thread Dian Fu
Re problem 1: Could you share an example which could be run by others? It depends on `dataclass` which seems like a private class. Re problem 2: Seems like a classloader issue. Could you share how to reproduce it? Since you could run the first example in thread mode, it seems only happening in ce

Re: Using data classes in pyflink

2025-01-13 Thread Pavel Dmitriev
Hi Oleksii, it also can be related to the problem, that you have two different classloaders, because Flink creates a separate classloader for every running pipeline. It is especially related when you run the pipeline in Session Mode. Not sure whether it helps or not, but you can try the next con

Re: Using data classes in pyflink

2025-01-13 Thread Nikola Milutinovic
Hi Oleksii. The core error is (as you have seen): Caused by: java.lang.ClassCastException: pemja.core.object.PyIterator cannot be cast to pemja.core.object.PyIterator Now, since the name of the class is the same, the only way a cast can fail is if the versions of that class are different. How i