This is not problem directly caused by Spark, but it's related; thus asking
here. I use spark to read data from parquet and processing some http call with
sttp (https://github.com/softwaremill/sttp). However, spark throws
Caused by: java.io.NotSerializableException:
com.softwaremill.sttp.FollowRedirectsBackend
It's understood why such exception is thrown because
FollowRedirectsBackend is not seralizable. So I would like know in such case -
are there any ways to get around this problem without modifying, recompiling
original code?
Thanks