Re: OutOfMemoryError (java heap space) on small, local test

2022-10-31 Thread Matt Fysh
Thanks Leonard for taking a look. It seems odd that returning a list of objects can cause a fatal error such as this, and since I am new to Flink and also relatively new to Python, I assume that I am doing something wrong as returning a list of objects is a fairly common data modelling scenario. P

Re: OutOfMemoryError (java heap space) on small, local test

2022-10-31 Thread Leonard Xu
Hi, Matt I’ve checked your job is pretty simple, I've CC Xingbo who is a PyFlink expert to help take a quick look. Best, Leonard > 2022年10月31日 上午11:47,Matt Fysh 写道: > > Hi there, > > I am running a local test with: > * source = env.from_collection > * sink = datastream.execute_and_collect

OutOfMemoryError (java heap space) on small, local test

2022-10-30 Thread Matt Fysh
Hi there, I am running a local test with: * source = env.from_collection * sink = datastream.execute_and_collect with a map function between, and two very small data points in the collection I'm able to generate an OutOfMemoryError, and due to the nature of this test using simple source and sink,