Re: Should python-2 be supported in Spark 3.0?

2019-05-29 Thread shane knapp
x27;t be expanding. that being said, i will be cracking a bottle of champagne when i can delete all of the ansible and anaconda configs for python2.x. :) shane -- Shane Knapp UC Berkeley EECS Research / RISELab Staff Technical Lead https://rise.cs.berkeley.edu

Re: Should python-2 be supported in Spark 3.0?

2019-05-31 Thread shane knapp
; >>>>> On Thu, May 30, 2019 at 2:18 AM Felix Cheung < >>>>> felixcheun...@hotmail.com> wrote: >>>>> >>>>>> We don’t usually reference a future release on website >>>>>> >>>>>> > Spark websit

Re: [DISCUSS] Remove sorting of fields in PySpark SQL Row construction

2019-11-07 Thread Shane Knapp
being deprecated now, this LegacyRow >>> can also be removed at the same time. There are also other ways to create >>> Rows that will not be affected. I have opened a JIRA [3] to capture this, >>> but I am wondering what others think about fixing this for Spark 3.0? >>> >>> [1] https://github.com/apache/spark/pull/20280 >>> [2] https://www.python.org/dev/peps/pep-0468/ >>> [3] https://issues.apache.org/jira/browse/SPARK-29748 -- Shane Knapp UC Berkeley EECS Research / RISELab Staff Technical Lead https://rise.cs.berkeley.edu - To unsubscribe e-mail: user-unsubscr...@spark.apache.org