ueshin commented on PR #49946: URL: https://github.com/apache/spark/pull/49946#issuecomment-2660079623
Hi @dongjoon-hyun, thanks for the heads-up! I'm afraid we already had a discussion in the dev@spark and voted for that, and the vote passed: - [[DISCUSS] Publish additional Spark distribution with Spark Connect enabled](https://lists.apache.org/thread/loo1r84ovrzpskkn9cfmjfb0vwx4xnrq) - [[VOTE] Publish additional Spark distribution with Spark Connect enabled](https://lists.apache.org/thread/ob3x4s7opzyp31lvclmcf8z04scdk6l8) - [[VOTE][RESULT] Publish additional Spark distribution with Spark Connect enabled](https://lists.apache.org/thread/wbfwn2sgozh9v03hrd4rzxcrtxhqw88w) In the discussion, @cloud-fan mentioned: > - Spark 4.0 will include three PyPI packages: > - pyspark: The classic package. > - pyspark-client: The thin Spark Connect Python client. Note, in the Spark 4.0 preview releases, we have published the pyspark-connect package for the thin client, we will need to rename it in the official 4.0 release. > - pyspark-connect: Spark Connect enabled by default. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
