Re: [PySpark] Revisiting PySpark type annotations

2020-07-21 Thread zero323
Given a discussion related to SPARK-32320 PR I'd like to resurrect this thread. Is there any interest in migrating annotations to the main repository? -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ ---

Re: [PySpark] Revisiting PySpark type annotations

2020-07-21 Thread zero323
Given a discussion related to SPARK-32320 PR I'd like to resurrect this thread. -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: d

Re: [PySpark] Revisiting PySpark type annotations

2019-01-26 Thread zero323
As already pointed out by Nicholas, there is no Python 2 conflict here. Moreover, despite the fact that I used Python 3 specific feature, Python 2 users can benefit from the annotations as well in some circumstances (already mentioned MyPy is one option, PyCharm another, maybe some other tools as w

Re: Will .count() always trigger an evaluation of each row?

2017-03-10 Thread zero323
Technically speaking it is still possible to: df.createOrReplaceTempView("df") spark.sql("CACHE TABLE df") spark.table("df") -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Will-count-always-trigger-an-evaluation-of-each-row-tp21018p21142.html Sent

Re: welcoming Burak and Holden as committers

2017-01-24 Thread zero323
Kudos! -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/welcoming-Burak-and-Holden-as-committers-tp20726p20746.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. -