Re: [DISCUSS] SPIP: Declarative Pipelines

+1 (non-binding) On Tue, Apr 8, 2025 at 9:53 PM Yuming Wang wrote: > +1 > > On Wed, Apr 9, 2025 at 10:47 AM Jungtaek Lim > wrote: > >> +1 looking forward to seeing this make progress! >> >> On Wed, Apr 9, 2025 at 11:32 AM Yang Jie wrote: >> >>> +1 >>> >>> On 2025/04/09 01:07:57 Hyukjin Kwon wr

Re: [VOTE] SPIP: Declarative Pipelines

+1 (non-binding) On Wed, Apr 9, 2025 at 11:03 Chao Sun wrote: > +1 > > On Wed, Apr 9, 2025 at 10:55 AM L. C. Hsieh wrote: > >> +1 >> >> On Wed, Apr 9, 2025 at 7:22 AM Sandy Ryza wrote: >> > >> > We started to get some votes on the discussion thread, so I'd like to >> move to a formal vote on a

Re: [DISCUSS] Turtle canonical extension type

+1 (non-binding) - especially the rabbit canonical extension! On Thu, Apr 3, 2025 at 06:59 Benjamin Kietzman wrote: > +1 > > On Tue, Apr 1, 2025, 22:07 Gang Wu wrote: > > > +1 (binding) > > > > I'll propose a Rabbit canonical extension type next year. > > > > Best, > > Gang > > > > > > On Wed,

Re: [VOTE] Row lineage required for v3

+1 (non-binding) On Mon, Mar 31, 2025 at 7:27 PM roryqi wrote: > +1. > > Gang Wu 于2025年4月1日周二 09:30写道： > >> +1 (non-binding) >> >> On Tue, Apr 1, 2025 at 5:15 AM Russell Spitzer >> wrote: >> >>> +1 >>> >>> On Mon, Mar 31, 2025 at 2:22 PM Amogh Jahagirdar <2am...@gmail.com> >>> wrote: >>>

Re: [VOTE] Enable GitHub Discussions for apache/arrow-*

+1 (non-binding) On Sat, Mar 22, 2025 at 4:28 PM Matt Topol wrote: > +1 > > On Fri, Mar 21, 2025, 7:42 PM Rok Mihevc wrote: > > > +1 > > > > On Fri, Mar 21, 2025 at 5:23 PM Wes McKinney > wrote: > > > > > +1 > > > > > > On Fri, Mar 21, 2025 at 11:03 AM Bryce Mecum > > wrote: > > > > > > > +1

Re: [VOTE] SPIP: Constraints in DSv2

+1 (non-binding) On Fri, Mar 21, 2025 at 11:52 Gengliang Wang wrote: > +1 > > On Fri, Mar 21, 2025 at 11:46 AM Anton Okolnychyi > wrote: > >> Hi all, >> >> I would like to start a vote on adding support for constraints to DSv2. >> >> *Discussion thread: * >> https://lists.apache.org/thread/njqj

Re: [ANNOUNCE] New Arrow PMC member: Ian Cook

Congratulations, Ian! On Thu, Mar 20, 2025 at 8:39 AM Dewey Dunnington wrote: > Congratulations! > > On Thu, Mar 20, 2025 at 9:41 AM Bryce Mecum wrote: > > > Congratulations Ian! > > > > On Thu, Mar 20, 2025 at 1:05 AM Sutou Kouhei wrote: > > > > > > The Project Management Committee (PMC) for

Re: [ANNOUNCE] Apache Iceberg Pre-Summit Community Meetup in SF

Thanks for organizing, Sung! See y'all in a few weeks :) On Tue, Mar 11, 2025 at 10:48 AM Kevin Liu wrote: > Amazing! Thanks for putting this together. See you there :) > > On Mon, Mar 10, 2025 at 3:17 PM Russell Spitzer > wrote: > >> I'm flying in early enough to join as well! >> >> On Mon, M

Re: [DISCUSS] New Spark Connect Client repository for Swift language

+1 (non-binding) On Mon, Mar 10, 2025 at 9:47 AM Peter Toth wrote: > +1 > > On Mon, Mar 10, 2025 at 5:39 PM Kent Yao wrote: > >> +1 >> >> Kent >> >> 在 2025年3月10日星期一，Max Gekk 写道： >> >>> +1 >>> >>> On Mon, Mar 10, 2025 at 6:17 PM Wenchen Fan wrote: >>> > >>> > +1 >>> > >>> > On Mon, Mar 10, 202

Re: discuss: Forward github discussion to dev list

One of the nice things about using GitHub discussions (we've been doing this for awhile for MLflow, Delta Lake, and Unity Catalog for example) is that it's easier to organize and respond to issues with their own threads. It's also easier from a SEO perspective where folks searching for a particular

Re: [DISCUSS] Apache Arrow Meetup in Europe

+1 (and would love to help support as well) On Thu, Mar 6, 2025 at 07:09 Jean-Baptiste Onofré wrote: > Hi Antoine, > > I think one full day is do-able. The main difference is about the > funding/sponsoring which is obviously higher. > > If we have a consensus, we can start to look for sponsors,

Re: [DISCUSS] Apache Arrow Meetup in Europe

+1 (and would love to help support as well) On Thu, Mar 6, 2025 at 07:09 Jean-Baptiste Onofré wrote: > Hi Antoine, > > I think one full day is do-able. The main difference is about the > funding/sponsoring which is obviously higher. > > If we have a consensus, we can start to look for sponsors,

Re: [VOTE] Release Apache Spark 3.5.5 deprecating `spark.databricks.*` configuration

+1 (non-binding) On Wed, Feb 19, 2025 at 2:22 PM Reynold Xin wrote: > +1 > > On Wed, Feb 19, 2025 at 2:02 PM Zhou Jiang wrote: > >> >> +1 (non-binding) >> >> On Feb 19, 2025, at 04:20, Peter Toth wrote: >> >>  >> +1 >> >> On Wed, Feb 19, 2025 at 10:20 AM Max Gekk wrote: >> >>> +1 >>> >>> On

Re: [VOTE] Add Geometry and Geography types for V3

+1 (non-binding) - super exciting! On Thu, Feb 6, 2025 at 3:52 PM rdb...@gmail.com wrote: > +1 > > Awesome to see this ready to go! > > On Thu, Feb 6, 2025 at 12:01 PM Szehon Ho wrote: > >> Hi everyone >> >> We would like to add Geometry and Geography types to the Iceberg V3 spec: >> >> https:/

Re: Welcome Huaxin Gao as a committer!

Congratulations Huaxin!!! On Thu, Feb 6, 2025 at 7:47 AM Amogh Jahagirdar <2am...@gmail.com> wrote: > Congratulations Huaxin! > > On Thu, Feb 6, 2025 at 8:41 AM Kevin Liu wrote: > >> Congratulations Huaxin!! Looking forward to working together 🎉 >> >> >> Bes

Re: [VOTE] Update partition stats spec for V3

+1 (non-binding) - love this, Anton! On Wed, Feb 5, 2025 at 8:54 AM Prashant Singh wrote: > +1 (non-binding) > Thank you Anton ! > > Best, > Prashant Singh > > On Tue, Feb 4, 2025 at 10:42 PM Jean-Baptiste Onofré > wrote: > >> +1 (non binding) >> >> Regards >> JB >> >> On Sat, Feb 1, 2025 at 3:

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

+1 (non-binding) On Wed, Feb 5, 2025 at 07:11 huaxin gao wrote: > +1 > > On Wed, Feb 5, 2025 at 1:39 AM Mich Talebzadeh > wrote: > >> +1 >> >> Dr Mich Talebzadeh, >> Architect | Data Science | Financial Crime | Forensic Analysis | GDPR >> >>view my Linkedin profile >>

Re: [DISCUSS] Publish additional Spark distribution with Spark Connect enabled

+1 (non-binding) on this proposal. Just as long as there are no schedule concerns - similar to Mridul and Dongjoon’s call outs, then yes, I think this would be helpful for adoption.Thanks! On Tue, Feb 4, 2025 at 18:43 huaxin gao wrote: > I support publishing an additional Spark distributio

Re: Increasing Shading & Relocating for 4.0

t;> teams which build platforms on top of Spark (thinking custom machine >> learning tools or special streaming stuff). >> >> It's sort of that classic problem of building something for the 90% but >> the 10% are the ones with the actual issue your trying to avoid. &g

Re: Re: Increasing Shading & Relocating for 4.0

BTW, one of many reasons Spark Connect was developed was to potentially simplify this process around shading (i.e. not need to do it). I’m wondering if utilizing Spark Connect could be a potential solution here? On Fri, Jan 17, 2025 at 12:27 Holden Karau wrote: > +1 I think this is great. If

Re: Help choose a GraphFrames logo

Thanks Russell, just wanted to give a shout out that this is really cool :) On Wed, Jan 15, 2025 at 1:13 AM Russell Jurney wrote: > GraphFrames needs a logo, so I created a 99designs contest to create one. > There are six finalists. Please vote for the one you like the most :) > > https://99desi

Re: [VOTE] Use plain text logs by default

+1 (non-binding) On Thu, Jan 9, 2025 at 08:41 DB Tsai wrote: > +1 > > DB Tsai | https://www.dbtsai.com/ | PGP 42E5B25A8F7A82C1 > > On Jan 9, 2025, at 12:27 AM, Peter Toth wrote: > > +1 > > On Thu, Jan 9, 2025 at 8:37 AM Allison Wang > wrote: > >> +1 >> >> On Thu, Jan 9, 2025 at 2:45 PM L.

Re: [Announce] Singapore Apache Iceberg Community Meetup

merci beaucoup! :) On Mon, Dec 16, 2024 at 10:50 AM Kevin Liu wrote: > Hey Denny, > > Here's one with a better resolution, > https://drive.google.com/file/d/1H2scgq70fJU8AMLXzOadOdKfVPjHLDH9/view?usp=sharing > > Best, > Kevin Liu > > On Mon, Dec 16, 2024 at 10:

Re: [Announce] Singapore Apache Iceberg Community Meetup

Hey Kevin, Do you have a bigger image for this event so we can help promote the event via social media? Thanks! Denny On Fri, Dec 13, 2024 at 3:06 PM Kevin Liu wrote: > Hey everyone, > > The Iceberg community meetup has expanded to Singapore! The next Singapore > meetup will be on Wednesday,

Re: [外部邮件] Re: Spark Connect the default API in Spark 4.0

+1 (non-binding) On Wed, Nov 27, 2024 at 3:07 AM Martin Grund wrote: > As part of the discussion on this topic, I would love to highlight the > work that the community is currently doing to support SparkML, which is > traditionally very RDD-heavy, natively in Spark Connect. Bobby's awesome > wor

Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?

> If by "at length" you mean ... among very few people, in a very few emails, throughout less than a week. Yes, you're totally right. The implication that this was a rash decision decided by a few people in a short amount of time is incorrect. This discussion all started on the thread "[VOTE] Off

Re: [VOTE] Officialy Deprecate GraphX in Spark 4

+1 (non-binding) On Thu, Oct 3, 2024 at 7:40 AM Wenchen Fan wrote: > +1 > > On Tue, Oct 1, 2024 at 4:20 PM beliefer wrote: > >> +1. >> >> I didn't hear users need it. >> >> >> At 2024-10-01 02:01:17, "Holden Karau" wrote: >> >> I think it has been de-facto deprecated, we haven’t updated it >>

Re: [DISCUSS] Enable GitHub Discussions for DataFusion Comet

A little late to the discussion but i definitely would recommend using GitHub discussions. It allows for tracking/SEO of discussions so if there are frequent questions/FAQs, they are easier to bubble up. For some of the communities I help with, we’ve been actively moving more and more discussion

Re: [VOTE] Move Variant to Parquet

+1 (non-binding) On Tue, Sep 3, 2024 at 17:13 Gengliang Wang wrote: > +1 > > On Tue, Sep 3, 2024 at 4:29 PM rdb...@gmail.com wrote: > >> +1 >> >> On Tue, Sep 3, 2024 at 3:38 PM Gene Pang wrote: >> >>> Hi Micah, >>> >>> I wanted to open this vote to get official alignment on where the Spark >>>

Re: [VOTE] Deprecate SparkR

+1 (non-binding) On Wed, Aug 21, 2024 at 9:50 AM Sean Owen wrote: > +1 > > On Wed, Aug 21, 2024, 11:40 AM Shivaram Venkataraman < > shivaram.venkatara...@gmail.com> wrote: > >> Hi all >> >> Based on the previous discussion thread [1], I hereby call a vote to >> deprecate the SparkR module in Apa

Re: Welcoming a new PMC member

Congrats, Kent! On Tue, Aug 13, 2024 at 9:06 AM Dongjoon Hyun wrote: > Congratulations, Kent. > > Dongjoon. > > On Mon, Aug 12, 2024 at 5:22 PM Xiao Li wrote: > >> Congratulations ! >> >> Hyukjin Kwon 于2024年8月12日周一 17:20写道： >> >>> Hi all, >>> >>> The Spark PMC recently voted to add a new PMC m

Re: [VOTE] Archive Spark Documentations in Apache Archives

+1 (non-binding) On Tue, Aug 13, 2024 at 6:16 AM Gengliang Wang wrote: > +1 > > On Mon, Aug 12, 2024 at 2:01 PM Xiao Li wrote: > >> +1 >> >> Mich Talebzadeh 于2024年8月12日周一 13:11写道： >> >>> Hi Kent, >>> >>> Can you if possible please provide a heuristic estimate of storage >>> reduction that will

Re: Welcome new Apache Spark committers

Congrats Allison, Martin, and Haejoon! On Tue, Aug 13, 2024 at 9:59 AM Jungtaek Lim wrote: > Congrats everyone! > > On Tue, Aug 13, 2024 at 9:21 AM Xiao Li wrote: > >> Congratulations! >> >> Hyukjin Kwon 于2024年8月12日周一 17:19写道： >> >>> Hi all, >>> >>> The Spark PMC recently voted to add three ne

Re: [VOTE] Using Github Issues for Spark-Connect-Go _only_ issues.

+1 (non-binding) On Mon, Aug 12, 2024 at 16:43 Reynold Xin wrote: > +1 > > On Mon, Aug 12, 2024 at 10:28 AM Mich Talebzadeh < > mich.talebza...@gmail.com> wrote: > >> +1 for me >> >> Mich Talebzadeh, >> >> Architect | Data Engineer | Data Science | Financial Crime >> PhD

Re: [DISCUSS] Using Github Issues for Spark-Connect-Go _only_ issues.

+1 (non-binding) to start as a small experiment On Fri, Aug 9, 2024 at 11:56 PM bo yang wrote: > +1 to start small as an experiment to see how people use GitHub issue... > > On Thu, Aug 8, 2024 at 11:54 PM Kent Yao wrote: > >> +1 >> >> On 2024/08/08 23:24:32 Hyukjin Kwon wrote: >> > SGTM >> > >

Re: [VOTE] Differentiate Spark without Spark Connect from Spark Connect

+1 (non-binding) On Tue, Jul 23, 2024 at 12:19 PM Sadha Chilukoori wrote: > +1 (non-binding) > > On Mon, Jul 22, 2024 at 5:56 PM Wenchen Fan wrote: > >> +1 >> >> On Tue, Jul 23, 2024 at 8:40 AM Xinrong Meng wrote: >> >>> +1 >>> >>> Thank you @Hyukjin Kwon ! >>> >>> On Mon, Jul 22, 2024 at 5:2

Re: [DISCUSS] Differentiate Spark without Spark Connect from Spark Connect

+1 for 'Classic' as well :) On Sun, Jul 21, 2024 at 10:15 AM Ruifeng Zheng wrote: > +1 for 'Classic' > > On Sun, Jul 21, 2024 at 8:03 AM Xiao Li wrote: > >> Classic is much better than Legacy. : ) >> >> Hyukjin Kwon 于2024年7月18日周四 16:58写道： >> >>> Hi all, >>> >>> I noticed that we need to standa

Re: [VOTE] Allow GitHub Actions runs for contributors' PRs without approvals in apache/spark-connect-go

+1 (non-binding) On Thu, Jul 4, 2024 at 19:13 Hyukjin Kwon wrote: > Hi all, > > I’d like to start a vote for allowing GitHub Actions runs for > contributors' PRs without approvals in apache/spark-connect-go. > > Please also refer to: > >- Discussion thread: > https://lists.apache.org/thread/

Re: [VOTE] Move Spark Connect server to builtin package (Client API layer stays external)

+1 (non-binding) On Wed, Jul 3, 2024 at 9:11 AM Hyukjin Kwon wrote: > Starting with my own +1. > > On Wed, 3 Jul 2024 at 09:59, Hyukjin Kwon wrote: > >> Hi all, >> >> I’d like to start a vote for moving Spark Connect server to builtin >> package (Client API layer stays external). >> >> Please a

Re: [FYI] SPARK-47993: Drop Python 3.8

+1 (non-binding) On Thu, Apr 25, 2024 at 19:26 Xinrong Meng wrote: > +1 > > On Thu, Apr 25, 2024 at 2:08 PM Holden Karau > wrote: > >> +1 >> >> Twitter: https://twitter.com/holdenkarau >> Books (Learning Spark, High Performance Spark, etc.): >> https://amzn.to/2MaRAG9

Re: [VOTE] SPARK-44444: Use ANSI SQL mode by default

+1 (non-binding) On Sat, Apr 13, 2024 at 7:49 PM huaxin gao wrote: > +1 > > On Sat, Apr 13, 2024 at 4:36 PM L. C. Hsieh wrote: > >> +1 >> >> On Sat, Apr 13, 2024 at 4:12 PM Hyukjin Kwon >> wrote: >> > >> > +1 >> > >> > On Sun, Apr 14, 2024 at 7:46 AM Chao Sun wrote: >> >> >> >> +1. >> >> >> >

Re: [VOTE] SPIP: Pure Python Package in PyPI (Spark Connect)

+1 (non-binding) On Mon, Apr 1, 2024 at 9:24 AM Hussein Awala wrote: > +1(non-binding) I add to the difference will it make that it will also > simplify package maintenance and easily release a bug fix/new feature > without needing to wait for Pyspark to release. > > On Mon, Apr 1, 2024 at 4:56

Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

+1 (non-binding) On Sun, Mar 10, 2024 at 23:36 Gengliang Wang wrote: > Hi all, > > I'd like to start the vote for SPIP: Structured Logging Framework for > Apache Spark > > References: > >- JIRA ticket >- SPIP doc > >

Re: [VOTE] Move Arrow DataFusion Subproject to new Top Level Apache Project

+1 (non-binding) On Fri, Mar 1, 2024 at 18:58 kazuyuki tanimura wrote: > +1 (non-binding) > > Kazu > > > On Mar 1, 2024, at 5:44 PM, L. C. Hsieh wrote: > > > > +1 (binding) > > > > On Fri, Mar 1, 2024 at 1:25 PM Joris Van den Bossche > > wrote: > >> > >> +1 (binding) > >> > >> On Fri, 1 Mar 20

Re: [VOTE] Accept donation of Comet Spark native engine

+1 (non-binding) RAD stack for fast queries, what's not to love! On Sat, Jan 27, 2024 at 9:24 PM Jacob Wujciak-Jens wrote: > +1 (non-binding) > > Jorge Cardoso Leitão schrieb am So., 28. Jan. > 2024, 05:17: > > > +1 > > > > On Sun, 28 Jan 2024, 00:00 Wes McKinney, wrote: > > > > > +1 (binding)

Re: [ANNOUNCE] New Arrow PMC chair: Andy Grove

Congratulations Andy and thanks Andrew! On Mon, Nov 27, 2023 at 5:45 PM Ian Joiner wrote: > Congrats Andy and thanks Andrew! > > > On Monday, November 27, 2023, Yibo Cai wrote: > > > Congrats Andy! > > > > On 11/28/23 06:03, L. C. Hsieh wrote: > > > >> Congrats Andy! > >> > >> Thanks Andrew for

Re: [VOTE] Updating documentation hosted for EOL and maintenance releases

+1 On Tue, Sep 26, 2023 at 10:52 Maciej wrote: > +1 > > Best regards, > Maciej Szymkiewicz > > Web: https://zero323.net > PGP: A30CEF0C31A501EC > > On 9/26/23 17:12, Michel Miotto Barbosa wrote: > > +1 > > A disposição | At your disposal > > Michel Miotto Barbosa > https://www.linkedin.com/in/mi

Re: First Time contribution.

Hi Ram, We have some good guidance at https://spark.apache.org/contributing.html HTH! Denny On Sun, Sep 17, 2023 at 17:18 ram manickam wrote: > > > > Hello All, > Recently, joined this community and would like to contribute. Is there a > guideline or recommendation on tasks that can be picked

Re: First Time contribution.

Hi Ram, We have some good guidance at https://spark.apache.org/contributing.html HTH! Denny On Sun, Sep 17, 2023 at 17:18 ram manickam wrote: > > > > Hello All, > Recently, joined this community and would like to contribute. Is there a > guideline or recommendation on tasks that can be picked

Re: [VOTE][SPIP] Python Data Source API

+1 (non-binding) On Fri, Jul 7, 2023 at 00:50 Maciej wrote: > +0 > > Best regards, > Maciej Szymkiewicz > > Web: https://zero323.net > PGP: A30CEF0C31A501EC > > On 7/6/23 17:41, Xiao Li wrote: > > +1 > > Xiao > > Hyukjin Kwon 于2023年7月5日周三 17:28写道： > >> +1. >> >> See https://youtu.be/yj7XlTB1Jvc

Re: [DISCUSS] SPIP: Python Data Source API

Slightly biased, but per my conversations - this would be awesome to have! On Mon, Jun 19, 2023 at 09:43 Abdeali Kothari wrote: > I would definitely use it - is it's available :) > > On Mon, 19 Jun 2023, 21:56 Jacek Laskowski, wrote: > >> Hi Allison and devs, >> >> Although I was against this i

Re: JDK version support policy?

+1 on dropping Java 8 in Spark 4.0, saying this as a fan of the fast-paced (positive) updates to Arrow, eh?! On Tue, Jun 6, 2023 at 4:02 PM Sean Owen wrote: > I haven't followed this discussion closely, but I think we could/should > drop Java 8 in Spark 4.0, which is up next after 3.5? > > On Tu

Re: [CONNECT] New Clients for Go and Rust

+1 on separate repo allowing different APIs to run at different speeds and ensuring they get community support. On Wed, May 24, 2023 at 00:37 Hyukjin Kwon wrote: > I think we can just start this with a separate repo. > I am fine with the second option too but in this case we would have to > tria

Re: Slack for Spark Community: Merging various threads

ck because all of us agree that this is important? > 2. I'm wondering what ASF misses here if Apache Spark PMC invites all > remaining subscribers of `user@spark` and `dev@spark` mailing lists. > > Thanks, > Dongjoon. > > [image: invitation.png] > [image: invited.png] >

Slack for Spark Community: Merging various threads

There have been a number of threads discussing creating a Slack for the Spark community that I'd like to try to help reconcile. Topic: Slack for Spark Why: Allows for the community to have the option to communicate with each other using Slack; a pretty popular async communication. Discussion poi

Re: Slack for PySpark users

>>>>>> medium size groups it is good and affordable. Alternatives have been >>>>>>> suggested as well so those who like investigative search can agree and >>>>>>> come >>>>>>> up with a freebie one. >>>>

Re: Slack for PySpark users

>>>>>> medium size groups it is good and affordable. Alternatives have been >>>>>>> suggested as well so those who like investigative search can agree and >>>>>>> come >>>>>>> up with a freebie one. >>>>

Re: Slack for PySpark users

>>> wrote: >>>>>> >>>>>>> +1 >>>>>>> >>>>>>> + @d...@spark.apache.org >>>>>>> >>>>>>> This is a good idea. The other Apache projects (e.g., Pinot, Druid, >>&g

Re: Slack for PySpark users

;>>> wrote: >>>>>> >>>>>>> +1 >>>>>>> >>>>>>> + @dev@spark.apache.org >>>>>>> >>>>>>> This is a good idea. The other Apache projects (e.g., Pinot, Druid, >>&g

Re: Slack for PySpark users

+1 I think this is a great idea! On Mon, Mar 27, 2023 at 6:24 PM Hyukjin Kwon wrote: > Yeah, actually I think we should better have a slack channel so we can > easily discuss with users and developers. > > On Tue, 28 Mar 2023 at 03:08, keen wrote: > >> Hi all, >> I really like *Slack *as commun

Re: Topics for Spark online classes & webinars

> disclaimed. The author will in no case be liable for any monetary damages >> arising from such loss, damage or destruction. >> >> >> >> >> On Wed, 15 Mar 2023 at 18:31, Nitin Bhansali >> wrote: >> >> Hello Mich, >> >> My apologies

Re: Topics for Spark online classes & webinars

> disclaimed. The author will in no case be liable for any monetary damages >> arising from such loss, damage or destruction. >> >> >> >> >> On Wed, 15 Mar 2023 at 18:31, Nitin Bhansali >> wrote: >> >> Hello Mich, >> >> My apologies

Re: Topics for Spark online classes & webinars

Thanks Mich for tackling this! I encourage everyone to add to the list so we can have a comprehensive list of topics, eh?! On Wed, Mar 15, 2023 at 10:27 Mich Talebzadeh wrote: > Hi all, > > Thanks to @Denny Lee to give access to > > https://www.linkedin.com/company/apach

Re: Topics for Spark online classes & webinars

Thanks Mich for tackling this! I encourage everyone to add to the list so we can have a comprehensive list of topics, eh?! On Wed, Mar 15, 2023 at 10:27 Mich Talebzadeh wrote: > Hi all, > > Thanks to @Denny Lee to give access to > > https://www.linkedin.com/company/apach

Re: Topics for Spark online classes & webinars

rg or request to leverage the original Spark confluence page <https://cwiki.apache.org/confluence/display/SPARK>.WDYT? On Mon, Mar 13, 2023 at 9:34 AM Mich Talebzadeh wrote: > Well that needs to be created first for this purpose. The appropriate name > etc. to be decided. Maybe @Denny

Re: Topics for Spark online classes & webinars

rg or request to leverage the original Spark confluence page <https://cwiki.apache.org/confluence/display/SPARK>.WDYT? On Mon, Mar 13, 2023 at 9:34 AM Mich Talebzadeh wrote: > Well that needs to be created first for this purpose. The appropriate name > etc. to be decided. Maybe @Denny

Re: Online classes for spark topics

Looks like we have some good topics here - I'm glad to help with setting up the infrastructure to broadcast if it helps? On Thu, Mar 9, 2023 at 6:19 AM neeraj bhadani wrote: > I am happy to be a part of this discussion as well. > > Regards, > Neeraj > > On Wed, 8 Mar 2023 at 22:41, Winston Lai

Re: Online classes for spark topics

We used to run Spark webinars on the Apache Spark LinkedIn group but honestly the turnout was pretty low. We had dove into various features. If there are particular topics that. you would like to discuss during a live session, pleas

Re: Spark on Kube (virtua) coffee/tea/pop times

Woohoo, Holden! I’m in (hopefully my schedule allows me) - PST. On Tue, Feb 7, 2023 at 15:34 Andrew Melo wrote: > I'm Central US time (AKA UTC -6:00) > > On Tue, Feb 7, 2023 at 5:32 PM Holden Karau wrote: > > > > Awesome, I guess I should have asked folks for timezones that they’re in. > > > >

Re: Prometheus with spark

Hi Raja, A little atypical way to respond to your question - please check out the most recent Spark AMA where we discuss this: https://www.linkedin.com/posts/apachespark_apachespark-ama-committers-activity-6989052811397279744-jpWH?utm_source=share&utm_medium=member_ios HTH! Denny On Tue, Oct 2

Re: [VOTE] SPIP: Support Docker Official Image for Spark

+1 (non-binding) On Wed, Sep 21, 2022 at 10:33 PM Ankit Gupta wrote: > +1 > > Regards, > > Ankit Prakash Gupta > > On Thu, Sep 22, 2022 at 10:38 AM Yang,Jie(INF) > wrote: > >> +1 (non-binding) >> >> >> >> Regards, >> >> Yang Jie >> >> >> >> *发件人**: *Gengliang Wang >> *日期**: *2022年9月22日 星期四 12:

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

+1 (non-binding). This is a great idea and we should definitely do this. Count me in to help as well, eh?! :) On Sun, Sep 18, 2022 at 7:24 PM bo zhaobo wrote: > +1 (non-binding) > > This will bring the good experience to customers. So excited about this. > ;-) > > Yuming Wang 于2022年9月19日周一 10

Re: Databricks notebook - cluster taking a long time to get created, often timing out

Hi Karan, You may want to ping Databricks Help or Forums as this is a Databricks specific question. I'm a little surprised that a Databricks cluster would take a long time to create so it may be best to utilize these foru

Re: Append to an existing Delta Lake using structured streaming

Including the Delta Lake Users and Developers DL to help out. Saying this, could you clarify how data is not being added? By any chance do you have any code samples to recreate this? Sent via Superhuman On Wed, Jul 21, 2021 at 2:49 AM, wrote: > Hi

Re: [VOTE] SPIP: Support pandas API layer on PySpark

+1 (non-binding) On Sun, Mar 28, 2021 at 9:06 PM 郑瑞峰 wrote: > +1 (non-binding) > > > -- 原始邮件 -- > *发件人:* "Maxim Gekk" ; > *发送时间:* 2021年3月29日(星期一) 凌晨2:08 > *收件人:* "Matei Zaharia"; > *抄送:* "Gengliang Wang";"Mridul Muralidharan"< > mri...@gmail.com>;"Xiao Li";"Spark

Re: I'm going to be out starting Nov 5th

Best wishes Holden! :) On Sat, Oct 31, 2020 at 11:00 Dongjoon Hyun wrote: > Take care, Holden! I believe everything goes well. > > Bests, > Dongjoon. > > On Sat, Oct 31, 2020 at 10:24 AM Reynold Xin wrote: > >> Take care Holden and best of luck with everything! >> >> >> On Sat, Oct 31 2020 at 1

Re: [vote] Apache Spark 3.0 RC3

+1 (non-binding) On Sun, Jun 7, 2020 at 3:21 PM Jungtaek Lim wrote: > I'm seeing the effort of including the correctness issue SPARK-28067 [1] > to 3.0.0 via SPARK-31894 [2]. That doesn't seem to be a regression so > technically doesn't block the release, so while it'd be good to weigh its > wor

Re: How to unsubscribe

Hi Fred, To unsubscribe, could you please email: user-unsubscr...@spark.apache.org (for more information, please refer to https://spark.apache.org/community.html). Thanks! Denny On Wed, May 6, 2020 at 10:12 AM Fred Liu wrote: > Hi guys > > > > -

Re: can we all help use our expertise to create an IT solution for Covid-19

There are a number of really good datasets already available including (but not limited to): - South Korea COVID-19 Dataset - 2019 Novel Coronavirus COVID-19 (2019-nCoV) Data Repository by Johns Hopkins CSSE

Re: [VOTE] Amend Spark's Semantic Versioning Policy

+1 (non-binding) On Mon, Mar 9, 2020 at 1:59 AM Hyukjin Kwon wrote: > The proposal itself seems good as the factors to consider, Thanks Michael. > > Several concerns mentioned look good points, in particular: > > > ... assuming that this is for public stable APIs, not APIs that are > marked as u

Re: Block a user from spark-website who repeatedly open the invalid same PR

+1 On Sun, Jan 26, 2020 at 09:59 Nicholas Chammas wrote: > +1 > > I think y'all have shown this person more patience than is merited by > their behavior. > > On Sun, Jan 26, 2020 at 5:16 AM Takeshi Yamamuro > wrote: > >> +1 >> >> Bests, >> Takeshi >> >> On Sun, Jan 26, 2020 at 3:05 PM Hyukjin K

Re: Should python-2 be supported in Spark 3.0?

+1 On Fri, May 31, 2019 at 17:58 Holden Karau wrote: > +1 > > On Fri, May 31, 2019 at 5:41 PM Bryan Cutler wrote: > >> +1 and the draft sounds good >> >> On Thu, May 30, 2019, 11:32 AM Xiangrui Meng wrote: >> >>> Here is the draft announcement: >>> >>> === >>> Plan for dropping Python 2 suppor

Re: Should python-2 be supported in Spark 3.0?

+1 On Fri, May 31, 2019 at 17:58 Holden Karau wrote: > +1 > > On Fri, May 31, 2019 at 5:41 PM Bryan Cutler wrote: > >> +1 and the draft sounds good >> >> On Thu, May 30, 2019, 11:32 AM Xiangrui Meng wrote: >> >>> Here is the draft announcement: >>> >>> === >>> Plan for dropping Python 2 suppor

Re: [VOTE] [SPARK-25994] SPIP: DataFrame-based Property Graphs, Cypher Queries, and Algorithms

+1 yay - let's do it! On Tue, Jan 29, 2019 at 6:28 AM Xiangrui Meng wrote: > Hi all, > > I want to call for a vote of SPARK-25994 > . It introduces a new > DataFrame-based component to Spark, which supports property graph > construction, Cypher

Re: [VOTE] SPARK 2.2.3 (RC1)

+1 On Wed, Jan 9, 2019 at 4:30 AM Dongjoon Hyun wrote: > +1 > > Bests, > Dongjoon. > > On Tue, Jan 8, 2019 at 6:30 PM Wenchen Fan wrote: > >> +1 >> >> On Wed, Jan 9, 2019 at 3:37 AM DB Tsai wrote: >> >>> +1 >>> >>> Sincerely, >>> >>> DB Tsai >>> ---

Re: [VOTE] SPARK 2.4.0 (RC5)

+1 On Wed, Oct 31, 2018 at 12:54 PM Chitral Verma wrote: > +1 > > On Wed, 31 Oct 2018 at 11:56, Reynold Xin wrote: > >> +1 >> >> Look forward to the release! >> >> >> >> On Mon, Oct 29, 2018 at 3:22 AM Wenchen Fan wrote: >> >>> Please vote on releasing the following candidate as Apache Spark v

Re: welcome a new batch of committers

Congratulations! On Wed, Oct 3, 2018 at 05:26 Dongjin Lee wrote: > Congratulations to ALL!! > > - Dongjin > > On Wed, Oct 3, 2018 at 7:48 PM Jack Kolokasis > wrote: > >> Congratulations to all !! >> >> -Iacovos >> >> On 03/10/2018 12:54 μμ, Ted Yu wrote: >> >> Congratulations to all ! >> >> ---

Re: [VOTE] SPARK 2.4.0 (RC2)

+1 (non-binding) On Sat, Sep 29, 2018 at 10:24 AM Stavros Kontopoulos < stavros.kontopou...@lightbend.com> wrote: > +1 > > Stavros > > On Sat, Sep 29, 2018 at 5:59 AM, Sean Owen wrote: > >> +1, with comments: >> >> There are 5 critical issues for 2.4, and no blockers: >> SPARK-25378 ArrayData.t

Re: [VOTE] SPARK 2.3.2 (RC6)

+1 On Thu, Sep 20, 2018 at 9:55 AM Xiao Li wrote: > +1 > > > John Zhuge 于2018年9月19日周三 下午1:17写道： > >> +1 (non-binding) >> >> Built on Ubuntu 16.04 with Maven flags: -Phadoop-2.7 -Pmesos -Pyarn >> -Phive-thriftserver -Psparkr -Pkinesis-asl -Phadoop-provided >> >> java version "1.8.0_181" >> Java(

Re: [VOTE] SPARK 2.3.2 (RC3)

+1 (non-binding) On Tue, Jul 17, 2018 at 23:04 John Zhuge wrote: > +1 (non-binding) > > On Mon, Jul 16, 2018 at 8:04 PM Saisai Shao > wrote: > >> I will put my +1 on this RC. >> >> For the test failure fix, I will include it if there's another RC. >> >> Sean Owen 于2018年7月16日周一 下午10:47写道： >> > O

Re: [VOTE] Spark 2.3.1 (RC4)

+1 On Sat, Jun 2, 2018 at 4:53 PM Nicholas Chammas wrote: > I'll give that a try, but I'll still have to figure out what to do if none > of the release builds work with hadoop-aws, since Flintrock deploys Spark > release builds to set up a cluster. Building Spark is slow, so we only do > it if t

Re: Revisiting Online serving of Spark models?

I most likely will not be able to join SF next week but definitely up for a session after Summit in Seattle to dive further into this, eh?! On Wed, May 30, 2018 at 9:32 AM Felix Cheung wrote: > Hi! > > Thank you! Let’s meet then > > June 6 4pm > > Moscone West Convention Center > 800 Howard Stre

Re: Welcome Zhenhua Wang as a Spark committer

Awesome - congrats Zhenhua! On Sun, Apr 1, 2018 at 10:33 PM 叶先进 wrote: > Big congs. > > > On Apr 2, 2018, at 1:28 PM, Wenchen Fan wrote: > > > > Hi all, > > > > The Spark PMC recently added Zhenhua Wang as a committer on the project. > Zhenhua is the major contributor of the CBO project, and ha

Re: [VOTE] Spark 2.3.0 (RC5)

+1 (non-binding) On Fri, Feb 23, 2018 at 07:08 Josh Goldsborough < joshgoldsboroughs...@gmail.com> wrote: > New to testing out Spark RCs for the community but I was able to run some > of the basic unit tests without error so for what it's worth, I'm a +1. > > On Thu, Feb 22, 2018 at 4:23 PM, Same

Re: Does Pyspark Support Graphx?

y, > The pyspark script uses the --packages option to load graphframe library, > what about the SparkLauncher class? > > > > -- Original -- > *From:* Denny Lee > *Date:* Sun,Feb 18,2018 11:07 AM > *To:* 94035420 > *Cc:* user@spark.apa

Re: [VOTE] Spark 2.3.0 (RC4)

+1 (non-binding) Built and tested on macOS and Ubuntu. On Sun, Feb 18, 2018 at 3:19 PM Ricardo Almeida < ricardo.alme...@actnowib.com> wrote: > +1 (non-binding) > > Built and tested on macOS 10.12.6 Java 8 (build 1.8.0_111). No > regressions detected so far. > > > On 18 February 2018 at 16:12,

Re: Does Pyspark Support Graphx?

hX vs. GraphFrames? On Sat, Feb 17, 2018 at 8:26 PM xiaobo wrote: > Thanks Denny, will it be supported in the near future? > > > > -- Original ------ > *From:* Denny Lee > *Date:* Sun,Feb 18,2018 11:05 AM > *To:* 94035420 > *Cc:* user@spark.a

Re: Does Pyspark Support Graphx?

That’s correct - you can use GraphFrames though as it does support PySpark. On Sat, Feb 17, 2018 at 17:36 94035420 wrote: > I can not find anything for graphx module in the python API document, does > it mean it is not supported yet? >

[jira] [Updated] (SPARK-21866) SPIP: Image support in Spark

[ https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denny Lee updated SPARK-21866: -- Description: h2. Background and motivation As Apache Spark is being used more and more in the

Re: [VOTE] Spark 2.1.2 (RC4)

+1 (non-binding) On Wed, Oct 4, 2017 at 11:08 PM Holden Karau wrote: > Awesome, thanks for digging into the packaging on the R side in more > detail. I'll look into how to update the keys file as well. > > On Wed, Oct 4, 2017 at 10:46 PM Felix Cheung > wrote: > >> +1 >> >> Tested SparkR packag

  1   2   3   4   >