RDD Caching in SparkRunner

2020-02-26 Thread Ajit Dongre
che/beam/runners/spark/translation/TransformTranslator.java> (line number 413) Want to know what is the need of such kind of caching ? Also SparkRunner option --cacheDisabled is not honoured at this code level. Any specific reason ? Regards, Ajit Dongre

NotSerializableException in Spark runner

2020-11-30 Thread Ajit Dongre
f8c85> is serializable and also I observed that this exception is not coming for all records. Please suggest solution to this problem. Regards, Ajit Dongre

Re: NotSerializableException in Spark runner

2020-12-01 Thread Ajit Dongre
another node with NotSerializableException. Regards, Ajit Dongre From: Alexey Romanenko Reply to: "user@beam.apache.org" Date: Tuesday, 1 December 2020 at 11:35 PM To: "user@beam.apache.org" Subject: EXT: Re: NotSerializableException in Spark runner Could you make sure