Re: Vulnerabilities found on pyspark

Hi Kamal , Please check apache spark security advisory all crtical issue mentioned here. https://spark.apache.org/security.html Regards, Vaquar khan On Mon, Nov 18, 2024, 9:37 AM Arnout Engelen wrote: > Hello Kamal et al, > > Thank you for your message! In the future, please

Re: Apache Spark 3.2.3 Release?

+1 On Tue, Oct 18, 2022, 8:58 PM 416161...@qq.com wrote: > +1 > > -- > Ruifeng Zheng > ruife...@foxmail.com > >

Re: Welcome Yikun Jiang as a Spark committer

Congratulations. Regards, Vaquar khan On Sun, Oct 9, 2022, 6:46 AM 叶先进 wrote: > Congrats > > On Oct 9, 2022, at 16:44, XiDuo You wrote: > > Congratulations, Yikun ! > > Maxim Gekk 于2022年10月9日周日 15:59写道： > >> Keep up the great work, Yikun! >> >> On S

Re: Welcoming three new PMC members

Congratulations On Tue, Aug 9, 2022, 11:40 AM Xiao Li wrote: > Hi all, > > The Spark PMC recently voted to add three new PMC members. Join me in > welcoming them to their new roles! > > New PMC members: Huaxin Gao, Gengliang Wang and Maxim Gekk > > The Spark PMC >

Re: [VOTE] Release Apache Spark 2.4.2

+1 Regards, Vaquar khan On Sun, Apr 21, 2019, 11:19 PM Felix Cheung wrote: > +1 > > R tests, package tests on r-hub. Manually check commits under R, doc etc > > > -- > *From:* Sean Owen > *Sent:* Saturday, April 20, 2019 11:27 AM > *To:

Re: time for Apache Spark 3.0?

:02 PM, vaquar khan wrote: > Plz ignore last email link (you tube )not sure how it added . > Apologies not sure how to delete it. > > > On Sat, Jun 16, 2018 at 11:58 AM, vaquar khan > wrote: > >> +1 >> >> https://www.youtube.com/watch?v=-ik7aJ5U6kg >>

Re: time for Apache Spark 3.0?

Plz ignore last email link (you tube )not sure how it added . Apologies not sure how to delete it. On Sat, Jun 16, 2018 at 11:58 AM, vaquar khan wrote: > +1 > > https://www.youtube.com/watch?v=-ik7aJ5U6kg > > Regards, > Vaquar khan > > On Fri, Jun 15, 2018 at 4:5

Re: time for Apache Spark 3.0?

+1 https://www.youtube.com/watch?v=-ik7aJ5U6kg Regards, Vaquar khan On Fri, Jun 15, 2018 at 4:55 PM, Reynold Xin wrote: > Yes. At this rate I think it's better to do 2.4 next, followed by 3.0. > > > On Fri, Jun 15, 2018 at 10:52 AM Mridul Muralidharan > wrote: >

Re: [VOTE] Spark 2.3.0 (RC4)

+1 Regards, Vaquar khan On Mon, Feb 19, 2018 at 10:29 PM, Xiao Li wrote: > +1. > > So far, no function/performance regression in Spark SQL, Core and PySpark. > > Thanks! > > Xiao > > 2018-02-19 19:47 GMT-08:00 Hyukjin Kwon : > >> Ah, I see. For 1), I overl

Re: [Vote] SPIP: Continuous Processing Mode for Structured Streaming

gned properly, we can >> have the same data source API working for both streaming and batch. >> > >> > >> > Following the SPIP process, I'm putting this SPIP up for a vote. >> > >> > +1: Let's go ahead and design / implement the SPIP. >>

Re: [VOTE][SPIP] SPARK-22026 data source v2 write path

+1 Regards, Vaquar khan On Oct 11, 2017 10:14 PM, "Weichen Xu" wrote: +1 On Thu, Oct 12, 2017 at 10:36 AM, Xiao Li wrote: > +1 > > Xiao > > On Mon, 9 Oct 2017 at 7:31 PM Reynold Xin wrote: > >> +1 >> >> One thing with MetadataSupport - It

Re: [VOTE] Spark 2.1.2 (RC4)

+1 (non binding ) tested on Ubuntu ,all test case are passed. Regards, Vaquar khan On Thu, Oct 5, 2017 at 10:46 PM, Hyukjin Kwon wrote: > +1 too. > > > On 6 Oct 2017 10:49 am, "Reynold Xin" wrote: > > +1 > > > On Mon, Oct 2, 2017 at 11:24 PM, Holde

Re: Interested to Contribute in Spark Development

Hi Nishant, 1) Start with helping spark users on mailing list and stack . 2) Start helping build and testing. 3) Once comfortable with code start working on Spark Jira. Regards, Vaquar khan On Oct 4, 2017 11:29 AM, "Kumar Nishant" wrote: > Hi Team, > I am new to Apache

Re: [VOTE] Spark 2.1.2 (RC2)

+1 (non-binding) Regards, Vaquar khan On Fri, Sep 29, 2017 at 1:52 PM, Ryan Blue wrote: > +1 (non-binding) > > Checked all signatures/checksums for binaries and source, spot-checked > maven artifacts. Thanks for fixing the signatures, Holden! > > On Fri, Sep 29, 2017 at 8:2

Re: Welcoming Tejas Patil as a Spark committer

Congrats Tejas Regards, Vaquar khan On Fri, Sep 29, 2017 at 4:33 PM, Mridul Muralidharan wrote: > Congratulations Tejas ! > > Regards, > Mridul > > On Fri, Sep 29, 2017 at 12:58 PM, Matei Zaharia > wrote: > > Hi all, > > > > The Spark PMC recently

Re: [VOTE][SPIP] SPARK-21866 Image support in Apache Spark

+1 looks good, Regards, Vaquar khan On Sat, Sep 23, 2017 at 12:22 PM, Matei Zaharia wrote: > +1; we should consider something similar for multi-dimensional tensors too. > > Matei > > > On Sep 23, 2017, at 7:27 AM, Yanbo Liang wrote: > > > > +1 > > > &

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

+1 Regards, Vaquar khan On Sep 10, 2017 5:18 AM, "Noman Khan" wrote: > +1 > -- > *From:* wangzhenhua (G) > *Sent:* Friday, September 8, 2017 2:20:07 AM > *To:* Dongjoon Hyun; 蒋星博 > *Cc:* Michael Armbrust; Reynold Xin; Andrew Ash; Herman

Re: SPIP: Spark on Kubernetes

+1 (non-binding) Regards, Vaquar khan On Mon, Aug 28, 2017 at 5:09 PM, Erik Erlandson wrote: > > In addition to the engineering & software aspects of the native Kubernetes > community project, we have also worked at building out the community, with > the goal of providing th

Re: How to tune the performance of Tpch query5 within Spark

Verify your configuration, following link covered all Spark tuning points. https://spark.apache.org/docs/latest/tuning.html Regards, Vaquar khan On Jul 17, 2017 6:56 AM, "何文婷" wrote: 2.1.1 发自网易邮箱大师 On 07/17/2017 20:55, vaquar khan wrote: Could you please let us know your Spa

Re: How to tune the performance of Tpch query5 within Spark

Could you please let us know your Spark version? Regards, vaquar khan On Jul 17, 2017 12:18 AM, "163" wrote: > I change the UDF but the performance seems still slow. What can I do else? > > > 在 2017年7月14日，下午8:34，Wenchen Fan 写道： > > Try to replace your UDF with Sp

Re: [VOTE] Apache Spark 2.2.0 (RC4)

+1 non-binding Regards, vaquar khan On Jun 7, 2017 4:32 PM, "Ricardo Almeida" wrote: +1 (non-binding) Built and tested with -Phadoop-2.7 -Dhadoop.version=2.7.3 -Pyarn -Phive -Phive-thriftserver -Pscala-2.11 on - Ubuntu 17.04, Java 8 (OpenJDK 1.8.0_111) - macOS 10.12.5 Jav

Re: [VOTE] Apache Spark 2.1.1 (RC4)

+1 Regards, Vaquar khan On Apr 27, 2017 4:11 PM, "Holden Karau" wrote: +1 (non-binding) PySpark packaging issue from the earlier RC seems to have been fixed. On Thu, Apr 27, 2017 at 1:23 PM, Dong Joon Hyun wrote: > +1 > > I’ve got the same result (Scala/R test) on JDK 1.8

Re: Spark Improvement Proposals

Many of us have issue with "shepherd role " , i think we should go with vote. Regards, Vaquar khan On Thu, Mar 9, 2017 at 11:00 AM, Reynold Xin wrote: > I'm fine without a vote. (are we voting on wether we need a vote?) > > > On Thu, Mar 9, 2017 at 8:55 AM, Sean

Re: Spark Improvement Proposals

I like document and happy to see SPIP draft version however i feel shepherd role is again hurdle in process improvement ,It's like everything depends only on shepherd . Also want to add point that SPIP should be time bound with define SLA else will defeats purpose. Regards, Vaquar khan O

Re: [VOTE] Apache Spark 2.1.0 (RC5)

+1 (non-binding) Regards, vaquar khan On Sun, Dec 18, 2016 at 2:33 PM, Adam Roberts wrote: > +1 (non-binding) > > *Functional*: looks good, tested with OpenJDK 8 (1.8.0_111) and IBM's > latest SDK for Java (8 SR3 FP21). > > Tests run clean on Ubuntu 16 04, 14 04, SUSE 12

Re: [VOTE] Release Apache Spark 2.0.2 (RC3)

0. >>>>> 2-rc3-docs/ >>>>> >>>>> >>>>> Q: How can I help test this release? >>>>> A: If you are a Spark user, you can help us test this release by >>>>> taking an existing Spark workload and running on this release candidate, >>>>> then reporting any regressions from 2.0.1. >>>>> >>>>> Q: What justifies a -1 vote for this release? >>>>> A: This is a maintenance release in the 2.0.x series. Bugs already >>>>> present in 2.0.1, missing features, or bugs related to new features will >>>>> not necessarily block this release. >>>>> >>>>> Q: What fix version should I use for patches merging into branch-2.0 >>>>> from now on? >>>>> A: Please mark the fix version as 2.0.3, rather than 2.0.2. If a new >>>>> RC (i.e. RC4) is cut, I will change the fix version of those patches to >>>>> 2.0.2. >>>>> >>>> >>>> >>> >> > -- Regards, Vaquar Khan +1 -224-436-0783 IT Architect / Lead Consultant Greater Chicago

Re: [VOTE] Release Apache Spark 2.0.2 (RC1)

> > A: Please mark the fix version as 2.0.3, rather than 2.0.2. If a new RC > > (i.e. RC2) is cut, I will change the fix version of those patches to > 2.0.2. > > > > > > - > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org > > -- Regards, Vaquar Khan +1 -224-436-0783 IT Architect / Lead Consultant Greater Chicago

Re: Improving volunteer management / JIRAs (split from Spark Improvement Proposals thread)

because not able to understand where to start. 1) We should assign mentor to enthusiastic to understand issues and help to start as contributor. 2) For high priority old Jira we should create separate group , who give complete analysis in Jira so other can go and fix issue. Reagrds, Vaquar khan

Re: Spark Improvement Proposals

+1 for SIP lebles,waiting for Reynolds detailed proposal . Regards, Vaquar khan On 8 Oct 2016 16:22, "Matei Zaharia" wrote: > Sounds good. Just to comment on the compatibility part: > > > I meant changing public user interfaces. I think the first design is > > u

Re: [VOTE] Release Apache Spark 2.0.1 (RC4)

+1 (non-binding) Regards, Vaquar khan On 29 Sep 2016 23:00, "Denny Lee" wrote: > +1 (non-binding) > > On Thu, Sep 29, 2016 at 9:43 PM Jeff Zhang wrote: > >> +1 >> >> On Fri, Sep 30, 2016 at 9:27 AM, Burak Yavuz wrote: >> >>> +

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

+1 (non-binding) Regards, Vaquar khan On 25 Sep 2016 20:41, "Kousuke Saruta" wrote: > +1 (non-binding) > > On 2016年09月26日 07:26, Herman van Hövell tot Westerflier wrote: > > +1 (non-binding) > > On Sun, Sep 25, 2016 at 2:05 PM, Ricardo Almeida < > ricardo

Re: [VOTE] Release Apache Spark 2.0.1 (RC2)

+1 non binding No issue found. Regards, Vaquar khan On 23 Sep 2016 17:25, "Mark Hamstra" wrote: Similar but not identical configuration (Java 8/macOs 10.12 with build/mvn -Phive -Phive-thriftserver -Phadoop-2.7 -Pyarn clean install); Similar but not identical failure: ... - line wr

Re: renaming "minor release" to "feature release"

manner, and 3. PATCH version when you make backwards-compatible bug fixes. Apart from verbiage "Minor" with "feature" no other changes in versioning policy. regards, Vaquar khan On Thu, Jul 28, 2016 at 6:20 PM, Matei Zaharia wrote: > I also agree with this g

Re: [VOTE] Release Apache Spark 1.6.2 (RC2)

+1 (non-binding Regards, Vaquar khan On 23 Jun 2016 07:50, "Sean Owen" wrote: > I don't think that qualifies as a blocker; not even clear it's a > regression. Even non-binding votes here should focus on whether this > is OK to release as a maintenance update to 1.

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

+1 On 24 Dec 2015 22:01, "Vinay Shukla" wrote: > +1 > Tested on HDP 2.3, YARN cluster mode, spark-shell > > On Wed, Dec 23, 2015 at 6:14 AM, Allen Zhang > wrote: > >> >> +1 (non-binding) >> >> I have just tarball a new binary and tested am.nodelabelexpression and >> executor.nodelabelexpression

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

+1 (non-binding) Regards, Vaquar khan On 25 Sep 2015 18:28, "Eugene Zhulenev" wrote: > +1 > > Running latest build from 1.5 branch, SO much more stable than 1.5.0 > release. > > On Fri, Sep 25, 2015 at 8:55 AM, Doug Balog > wrote: > >> +1 (non-binding)

Re: [VOTE] Release Apache Spark 1.5.0 (RC2)

+1 (1.5.0 RC2)Compiled on Windows with YARN. Regards, Vaquar khan +1 (non-binding, of course) 1. Compiled OSX 10.10 (Yosemite) OK Total time: 42:36 min mvn clean package -Pyarn -Phadoop-2.6 -DskipTests 2. Tested pyspark, mllib 2.1. statistics (min,max,mean,Pearson,Spearman) OK 2.2. Linear

Re: [VOTE] Release Apache Spark 1.4.1

+1 On 2 Jul 2015 18:03, "shenyan zhen" wrote: > +1 > On Jun 30, 2015 8:28 PM, "Reynold Xin" wrote: > >> +1 >> >> On Tue, Jun 23, 2015 at 10:37 PM, Patrick Wendell >> wrote: >> >>> Please vote on releasing the following candidate as Apache Spark version >>> 1.4.1! >>> >>> This release fixes a ha

Re: Contribution in java

Hi Sreenivas, Please read Spark doc first, everything mention in doc , without reading doc how can you contribute ? regards, vaquar khan On Sat, Dec 20, 2014 at 6:00 PM, sreenivas putta wrote: > Hi, > > I want to contribute for spark in java. Does it support java? please let

Re: [VOTE] Release Apache Spark 1.2.0 (RC1)

+1 1> Compiled binaries 2> All Tests Pass Regards, Vaquar khan On 30 Nov 2014 04:21, "Krishna Sankar" wrote: > +1 > 1. Compiled OSX 10.10 (Yosemite) mvn -Pyarn -Phadoop-2.4 > -Dhadoop.version=2.4.0 -DskipTests clean package 16:46 min (slightly slower > connectio

Re: [VOTE] Release Apache Spark 1.1.1 (RC2)

+1 Release this package as Apache Spark 1.1.1 On 20 Nov 2014 04:22, "Andrew Or" wrote: > I will start with a +1 > > 2014-11-19 14:51 GMT-08:00 Andrew Or : > > > Please vote on releasing the following candidate as Apache Spark version > 1 > > .1.1. > > > > This release fixes a number of bugs in Sp

Re: [VOTE] Designating maintainers for some Spark components

+1 (binding) On 8 Nov 2014 07:26, "Davies Liu" wrote: > Sorry for my last email, I misunderstood the proposal here, all the > committer still have equal -1 to all the code changes. > > Also, as mentioned in the proposal, the sign off only happens to > public API and architect, something like disc