ASF board report draft for May 2022

2022-05-09 Thread Matei Zaharia
Hi all, It’s time to submit our quarterly ASF board report again this Wednesday. I’ve put together the draft below. Let me know if you have any suggestions: === Description: Apache Spark is a fast and general purpose engine for large-scale data processing. It offers high-le

Behaviour of Append & Overwrite modes when table is not present when using df.write in Spark 3

2022-05-09 Thread Sourabh Badhya
Hi team, I would like to know the behaviour of Append & Overwrite modes when table is not present and whether automatic table creation is supported/unsupported when df.write is used in Spark 3 when the underlying custom datasource is using SupportCatalogOptions. As per my knowledge, in the curren