Thanks for sharing that. I think we should maybe add some checks around this so it’s easier to debug. I’m CCing Bryan who might have some thoughts.
On Tue, Nov 12, 2019 at 7:42 AM gal.benshlomo <gal.benshl...@startapp.com> wrote: > SOLVED! > thanks for the help - I found the issue. it was the version of pyarrow > (0.15.1) which apparently isn't currently stable. Downgrading it solved the > issue for me > > > > -- > Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > > -- Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> YouTube Live Streams: https://www.youtube.com/user/holdenkarau