Structured Streaming Programming Guide Improvements + Versionless Docs Update

Hi all, A few months ago, I started a thread about migrating our programming guides to be versionless. I had a POC, and the mostly-positive reception on the thread encouraged me to implement it for real. I did that recently here , but there w

Re: Spark Reads from MapR and Write to MinIO fails for few batches

Hello Spark and User, could you please shed some light ? On Thu, Aug 15, 2024 at 7:15 PM Prem Sahoo wrote: > Hello Spark and User, > we have a Spark project which is a long running Spark session where it > does below > 1. We are reading from Mapr FS and writing to MapR FS. > 2. Another parall

Re: [DISCUSS] Move Variant to Parquet?

As I said on dev@iceberg, it'd be really unfortunate if we end up with two or even more diverging specs for storing variants. It just adds more work for everybody to interop. Parquet would be a great home for this spec as a neutral project that almost all the other important projects in this space