Re: PyFlink java.io.EOFException at java.io.DataInputStream.readInt

Hi Dian, Thank you for your help! Best, Yik San On Fri, Mar 19, 2021 at 9:33 PM Dian Fu wrote: > Good finding! > > I think we should handle this case more friendly as I guess this issue > should be very common for Python users since Python is dynamic language. I > have created https://issues.a

Re: PyFlink java.io.EOFException at java.io.DataInputStream.readInt

Good finding! I think we should handle this case more friendly as I guess this issue should be very common for Python users since Python is dynamic language. I have created https://issues.apache.org/jira/browse/FLINK-21876 to follow up with t

Re: PyFlink java.io.EOFException at java.io.DataInputStream.readInt

Yes, you need to ensure that the key and value types of the Map are determined Best, Xingbo Yik San Chan 于2021年3月19日周五 下午3:41写道： > I got why regarding the simplified question - the dummy parser should > return key(string)-value(string), otherwise it fails the result_type spec > > On Fri, Mar 19

Re: PyFlink java.io.EOFException at java.io.DataInputStream.readInt

I got why regarding the simplified question - the dummy parser should return key(string)-value(string), otherwise it fails the result_type spec On Fri, Mar 19, 2021 at 3:37 PM Yik San Chan wrote: > Hi Dian, > > I simplify the question in > https://stackoverflow.com/questions/66687797/pyflink-jav

Re: PyFlink java.io.EOFException at java.io.DataInputStream.readInt

Hi Dian, I simplify the question in https://stackoverflow.com/questions/66687797/pyflink-java-io-eofexception-at-java-io-datainputstream-readfully. You can also find the updated question below: I have a PyFlink job that reads from a file, filter based on a condition, and print. This is a `tree` v

Re: PyFlink java.io.EOFException at java.io.DataInputStream.readInt

Hi Dian, I am able to reproduce this issue in a much simpler setup. Let me update with the simpler reproducible example shortly. Best, Yik San On Fri, Mar 19, 2021 at 11:28 AM Yik San Chan wrote: > Hi Dian, > > It is a good catch, though after changing to use > flink-sql-connector-kafka_2.11-1

Re: PyFlink java.io.EOFException at java.io.DataInputStream.readInt

Hi Dian, It is a good catch, though after changing to use flink-sql-connector-kafka_2.11-1.12.0.jar I still get exactly the same error. Best, Yik San On Fri, Mar 19, 2021 at 11:02 AM Dian Fu wrote: > > I noticed that you use "flink-sql-connector-kafka_2.12-1.12.0.jar”. Does > the jar files in

Re: PyFlink java.io.EOFException at java.io.DataInputStream.readInt

I noticed that you use "flink-sql-connector-kafka_2.12-1.12.0.jar”. Does the jar files in the cluster nodes are also built with Scala 2.12? PyFlink package bundles jar files with Scala 2.11 by default. I’m still not sure if it’s related to this issue. However, I think this is problematic. Could

Re: PyFlink java.io.EOFException at java.io.DataInputStream.readInt

Hi Dian, The PyFlink version is 1.12.0 and the Flink version in the cluster nodes is also 1.12.0 $ which flink /data/apache/flink/flink-1.12.0/bin/flink Best, Yik San On Fri, Mar 19, 2021 at 10:26 AM Dian Fu wrote: > Hi, > > What’s the Flink version in the cluster nodes? It should matches the

Re: PyFlink java.io.EOFException at java.io.DataInputStream.readInt

Hi, What’s the Flink version in the cluster nodes? It should matches the PyFlink version. Regards, Dian > 2021年3月18日 下午5:01，Yik San Chan 写道： > > This question is cross-posted on StackOverflow > https://stackoverflow.com/questions/66687797/pyflink-java-io-eofexception-at-java-io-datainputstre