Re: [Connect] Spark connect documentation clarification request

2025-02-03 Thread Nimrod Ofek
Hi, Thanks for the rapid response. I'd appreciate it if there will be some more documentation for this within Spark documentation. For example - I'm a Source/ Output format developer - I should add this. I am an internal company library developer that has this specific logic that does something a

Re: [Connect] Spark connect documentation clarification request

2025-02-03 Thread Herman van Hovell
Hi Nimrod, We are working on this as we speak. There is already a PR out for the extensions use case: https://github.com/apache/spark/pull/49604 Kind regards, Herman On Mon, Feb 3, 2025 at 10:10 AM Nimrod Ofek wrote: > Hi, > > In https://spark.apache.org/spark-connect/ - at the bottom it says