Hi Spark Community, I'm starting a vote on updating Spark to support reading from Spark Connect, including parallel Spark Connect Reads. The original motivation is to support fine grained access controls, but the parallel Spark Connect reads can benefit Spark Connect users in general.
SPIP doc: https://docs.google.com/document/d/1c-Gw6HQn2akq7V2LWrvY8JYTo13CuPKHOa8gUT4QR7Y/edit?usp=sharing Only discussion happened in the doc (but the thread https://lists.apache.org/thread.html/2ym2k633sd7kr1zsx86q9ccg6qn9h039 is at for anyone who wants to verify) The vote will be open for at least 72 hours, but I plan to keep it open a little longer, at least Wednesday @ 5pm pacific to give people time given potential US holiday travel. Vote passes with 3 +1s from PMC and no -1s from PMC ( https://spark.apache.org/improvement-proposals.html) Cheers, Holden :) -- Twitter: https://twitter.com/holdenkarau Fight Health Insurance: https://www.fighthealthinsurance.com/ <https://www.fighthealthinsurance.com/?q=hk_email> Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> YouTube Live Streams: https://www.youtube.com/user/holdenkarau Pronouns: she/her
