Re: [UPDATE] Apache Spark 3.5.0 Release Window

Thank you! Dongjoon On Thu, May 11, 2023 at 5:48 PM Xinrong Meng wrote: > Hi All, > > Apache Spark 3.5.0 Release Window is adjusted by #461 > . > > Please check the latest information on the official website > https://spark.apache.org/versioning

planInputPartitions being called twice

(I posted this on Slack originally) Hey folks, I’m writing a batch connector for an in-house data lake and doing some performance work now… I’ve noticed my ScanBuilder creates a Scan exactly once, but its toBatch method is being called three times, returning the identical object every time, then t