Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-26 Thread Hyukjin Kwon
This is already getting too long to follow the original topic. Would be great if we can separate others to a different thread. On Mon, Feb 27, 2023 at 7:41 AM Mich Talebzadeh wrote: > if we are going to do it, we might as well do it all. it is more cost > effective so to speak. > > > HTH > > >

Fwd: 自动回复: Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-26 Thread Mich Talebzadeh
ary damages arising from such loss, damage or destruction. -- Forwarded message - From: xyqiao Date: Sun, 26 Feb 2023 at 22:42 Subject: 自动回复: Re: [DISCUSS] Show Python code examples first in Spark documentation To: Mich Talebzadeh 这是来自QQ邮箱的假期自动回复邮件。 您好,我最近正在休假中,无法亲自回复您的邮件。我将在假期结束后,尽快给您回复。

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-26 Thread Mich Talebzadeh
if we are going to do it, we might as well do it all. it is more cost effective so to speak. HTH view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk. Any and all responsib

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-26 Thread Hyukjin Kwon
Probably it's worthwhile discussing the order for others but I would keep it separate from this thread to focus on Python as the default since that can be done as an incremental improvement. On Mon, Feb 27, 2023 at 3:36 AM Mich Talebzadeh wrote: > > To me as I stated before this is a tangential

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-26 Thread Mich Talebzadeh
To me as I stated before this is a tangential issue. However, if it has to be done, we ought to work out how much effort is needed). Besides, how about others? [image: image.png] what next in the order? 1. Python 2. Scala 3. SQL 4. Java 5. R SQL is still very important and wit

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-25 Thread Matei Zaharia
we > have many `Pinned` python libraries issues. > > Changing documentation is easy, but I hope we can give clear communication > and direction in this effort because this is one of the most user-facing > changes. > > Dongjoon. > > On Wed, Feb 22, 2023 at 5:26 PM 416161.

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-23 Thread Santosh Pingale
this change, I do believe we should test >>>>>>> more versions, etc. At least scheduled jobs like we're doing JDK and >>>>>>> Scala >>>>>>> versions. >>>>>>> >>>>>>> >>>>>>> FWIW,

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-23 Thread Hyukjin Kwon
tats provided) so let's put those >>>>>> examples first :-). >>>>>> >>>>>> >>>>>> On Thu, 23 Feb 2023 at 10:27, Dongjoon Hyun >>>>>> wrote: >>>>>> >>>>>>> I have two ques

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-23 Thread Santosh Pingale
gt; not >>>>>> enforced. In other words, Scala and Java have been the full feature >>>>>> because >>>>>> they are the underlying main developer languages while Python/R/SQL >>>>>> environments were the nice-to-have. >>

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-23 Thread Allan Folting
t;>> 3.11, >>>>> the support matrix for Python library dependency is a problem for the >>>>> Apache Spark community to solve in order to claim that. As we say >>>>> at SPARK-41454, Python language also introduces breaking changes to us >>

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-23 Thread Dongjoon Hyun
s to us >>>> historically and we have many `Pinned` python libraries issues. >>>> >>>> Changing documentation is easy, but I hope we can give clear >>>> communication and direction in this effort because this is one of the most >>>> user-fac

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-23 Thread Allan Folting
>>>> >>>> -- >>>> Ruifeng Zheng >>>> ruife...@foxmail.com >>>> >>>> <https://wx.mail.qq.com/home/index?t=readmail_businesscard_midpage&nocheck=true&name=Ruifeng+Zheng&icon=https%3A%2F%2Fre

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-23 Thread Mich Talebzadeh
/index?t=readmail_businesscard_midpage&nocheck=true&name=Ruifeng+Zheng&icon=https%3A%2F%2Fres.mail.qq.com%2Fzh_CN%2Fhtmledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242&mail=ruifengz%40foxmail.com&code=> >>> >>> >>> >>> -

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-22 Thread Hyukjin Kwon
ledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242&mail=ruifengz%40foxmail.com&code=> >> >> >> >> ---------- Original -- >> *From:* "Xinrong Meng" ; >> *Date:* Thu, Feb 23, 2023 09:17 AM >> *To:* "Allan Fol

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-22 Thread Dongjoon Hyun
> > -- Original -- > *From:* "Xinrong Meng" ; > *Date:* Thu, Feb 23, 2023 09:17 AM > *To:* "Allan Folting"; > *Cc:* "dev"; > *Subject:* Re: [DISCUSS] Show Python code examples first in Spark > documentation > >

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-22 Thread 416161...@qq.com
+1 LGTM Ruifeng Zheng ruife...@foxmail.com   -- Original -- From: "Xinrong Meng"

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-22 Thread Xinrong Meng
+1 Good idea! On Thu, Feb 23, 2023 at 7:41 AM Jack Goodson wrote: > Good idea, at the company I work at we discussed using Scala as our > primary language because technically it is slightly stronger than python > but ultimately chose python in the end as it’s easier for other devs to be > on boa

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-22 Thread Jack Goodson
Good idea, at the company I work at we discussed using Scala as our primary language because technically it is slightly stronger than python but ultimately chose python in the end as it’s easier for other devs to be on boarded to our platform and future hiring for the team etc would be easier On T

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-22 Thread Hyukjin Kwon
+1 I like this idea too. On Thu, Feb 23, 2023 at 6:00 AM Allan Folting wrote: > Hi all, > > I would like to propose that we show Python code examples first in the > Spark documentation where we have multiple programming language examples. > An example is on the Quick Start page: > https://spark.

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-22 Thread Mich Talebzadeh
I have seen many data engineering teams start out with Scala because technically it is the best choice for many given reasons and basically it is what Spark is. I also concur that Python is more popular than Scala because of the advent of data science. A majority of use cases we see these days are

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-22 Thread Sean Owen
FWIW I agree with this. On Wed, Feb 22, 2023 at 2:59 PM Allan Folting wrote: > Hi all, > > I would like to propose that we show Python code examples first in the > Spark documentation where we have multiple programming language examples. > An example is on the Quick Start page: > https://spark.a

[DISCUSS] Show Python code examples first in Spark documentation

2023-02-22 Thread Allan Folting
Hi all, I would like to propose that we show Python code examples first in the Spark documentation where we have multiple programming language examples. An example is on the Quick Start page: https://spark.apache.org/docs/latest/quick-start.html I propose this change because Python has become mor