Re: [DISCUSS] SPIP: Add llms.txt files to Spark Documentation

While it is not standard per se, it is quickly becoming a common approach. And as you noted per MCP site, they have the llms-full.txt, they also have https://modelcontextprotocol.io/llms.txt On Wed, Sep 10, 2025 at 14:48 Bjørn Jørgensen wrote: > The protocol for this llms.txt is not a standard

Re: [VOTE] SPIP: Add llms.txt files to Spark Documentation

+1 (non-binding) On Mon, Sep 15, 2025 at 6:12 PM Hyukjin Kwon wrote: > +1 > > On Tue, 16 Sept 2025 at 09:53, Augusto Vivaldelli < > augusto.a.vivalde...@gmail.com> wrote: > >> +1 >> >> El lun, 15 de sept de 2025, 19:38, Gengliang Wang >> escribió: >> >>> +1 >>> >>> On Mon, Sep 15, 2025 at 3:25 

Re: [VOTE] Release Apache Spark Connect Swift Client 0.3.0 (RC1)

+1 (non-binding) On Mon, Jun 2, 2025 at 07:44 Sandy Ryza wrote: > +1 (non-binding) > > On Mon, Jun 2, 2025 at 7:20 AM Dongjoon Hyun wrote: > >> +1 >> >> Dongjoon >> >> On 2025/06/02 13:13:45 "Rozov, Vlad" wrote: >> > +1 (non-binding) >> > >> > Thank you, >> > >> > Vlad >> > >> > On Jun 1, 2025

Re: [VOTE] SPIP: Real-Time Mode in Apache Spark Structured Streaming

+1 (non-binding) On Sun, Jun 1, 2025 at 22:18 L. C. Hsieh wrote: > +1 > > On Sun, Jun 1, 2025 at 9:48 PM DB Tsai wrote: > > > > +1 looking forward to seeing real-time mode. > > Sent from my iPhone > > > > On Jun 1, 2025, at 9:47 PM, Xiao Li wrote: > > > >  > > +1 > > > > huaxin gao 于2025年6月1

Re: [DISCUSS] SPIP: Real-Time Mode in Apache Spark Structured Streaming

equency >>>>>> trading,* market data or trade execution commands must be delivered >>>>>> with minimal latency. Even a slight delay can mean missed opportunities >>>>>> or >>>>>> significant financial losses, making a "corr

Re: [DISCUSS] SPIP: Real-Time Mode in Apache Spark Structured Streaming

Hey Mich, Sorry, I may be missing something here but what does your definition here have to do with the SPIP? Perhaps add comments directly to the SPIP to provide context as the code snippet below is a direct copy from the SPIP itself. Thanks, Denny On Wed, May 28, 2025 at 06:48 Mich Talebz

Re: [VOTE] Release Spark 4.0.0 (RC7)

+1 (non-binding) On Mon, May 19, 2025 at 9:02 PM Rozov, Vlad wrote: > +1 (non-binding) > > Vlad > > On May 19, 2025, at 8:56 PM, Jules Damji wrote: > > + 1 (non-binding) > — > Sent from my iPhone > Pardon the dumb thumb typos :) > > On May 19, 2025, at 5:26 PM, Gengliang Wang wrote: > >  > +1

Re: [DISCUSS] New Spark Connect Client repository for Rust language

+1 (non-binding) On Mon, May 19, 2025 at 02:42 Renjie Liu wrote: > +1 （non-binding) > > Hi, Niranjan: > > We also had a discussion when starting different > language implementations(too old and I can't find the link to the original > thread), and eventually we decided to use separate repos. It

Re: [VOTE] Release Spark 4.0.0 (RC6)

+1 (non-binding) On Wed, May 14, 2025 at 10:34 AM Chao Sun wrote: > +1 > > On Wed, May 14, 2025 at 10:30 AM Holden Karau > wrote: > >> +1 >> >> On Wed, May 14, 2025 at 10:10 AM L. C. Hsieh wrote: >> >>> +1 >>> >>> On Tue, May 13, 2025 at 3:28 PM Wenchen Fan wrote: >>> > >>> > Please vote on r

Re: Re: [VOTE] Release Spark 4.0.0 (RC5)

+1 (non-binding) On Tue, May 13, 2025 at 03:38 Peter Toth wrote: > +1 > > On Tue, May 13, 2025 at 12:24 PM beliefer wrote: > >> +1 >> >> >> 在 2025-05-13 16:26:32，"Yuanjian Li" 写道： >> >> +1 >> >> Szehon Ho 于2025年5月12日周一 22:32写道： >> >>> +1 (non binding) >>> >>> Checked license, signature, check

Re: [DISCUSS] New Spark Connect Client repository for Rust language

Hey Renjie, I think this is a great idea and it certainly helps "connect" with the Rust community to collaborate with the Spark community. I would love to help with this particular effort as well, eh?! Thanks for initiating this! Denny On Fri, May 9, 2025 at 1:53 AM Renjie Liu wrote: > Hi,

Re: [VOTE] SPIP: Add geospatial types to Spark

+1 (non-binding) On Mon, May 5, 2025 at 18:03 Wenchen Fan wrote: > +1 > > On Tue, May 6, 2025 at 3:40 AM Reynold Xin > wrote: > >> +1 >> >> >> On Mon, May 5, 2025 at 12:37 PM Bjørn Jørgensen >> wrote: >> >>> +1 >>> >>> man. 5. mai 2025 kl. 21:28 skrev Milan Stefanovic < >>> stefanovic.mila...@

Re: [DISCUSS] SPIP: Declarative Pipelines

+1 (non-binding) On Tue, Apr 8, 2025 at 9:53 PM Yuming Wang wrote: > +1 > > On Wed, Apr 9, 2025 at 10:47 AM Jungtaek Lim > wrote: > >> +1 looking forward to seeing this make progress! >> >> On Wed, Apr 9, 2025 at 11:32 AM Yang Jie wrote: >> >>> +1 >>> >>> On 2025/04/09 01:07:57 Hyukjin Kwon wr

Re: [VOTE] SPIP: Declarative Pipelines

+1 (non-binding) On Wed, Apr 9, 2025 at 11:03 Chao Sun wrote: > +1 > > On Wed, Apr 9, 2025 at 10:55 AM L. C. Hsieh wrote: > >> +1 >> >> On Wed, Apr 9, 2025 at 7:22 AM Sandy Ryza wrote: >> > >> > We started to get some votes on the discussion thread, so I'd like to >> move to a formal vote on a

Re: [VOTE] SPIP: Constraints in DSv2

+1 (non-binding) On Fri, Mar 21, 2025 at 11:52 Gengliang Wang wrote: > +1 > > On Fri, Mar 21, 2025 at 11:46 AM Anton Okolnychyi > wrote: > >> Hi all, >> >> I would like to start a vote on adding support for constraints to DSv2. >> >> *Discussion thread: * >> https://lists.apache.org/thread/njqj

Re: [DISCUSS] New Spark Connect Client repository for Swift language

+1 (non-binding) On Mon, Mar 10, 2025 at 9:47 AM Peter Toth wrote: > +1 > > On Mon, Mar 10, 2025 at 5:39 PM Kent Yao wrote: > >> +1 >> >> Kent >> >> 在 2025年3月10日星期一，Max Gekk 写道： >> >>> +1 >>> >>> On Mon, Mar 10, 2025 at 6:17 PM Wenchen Fan wrote: >>> > >>> > +1 >>> > >>> > On Mon, Mar 10, 202

Re: [VOTE] Release Apache Spark 3.5.5 deprecating `spark.databricks.*` configuration

+1 (non-binding) On Wed, Feb 19, 2025 at 2:22 PM Reynold Xin wrote: > +1 > > On Wed, Feb 19, 2025 at 2:02 PM Zhou Jiang wrote: > >> >> +1 (non-binding) >> >> On Feb 19, 2025, at 04:20, Peter Toth wrote: >> >>  >> +1 >> >> On Wed, Feb 19, 2025 at 10:20 AM Max Gekk wrote: >> >>> +1 >>> >>> On

Re: [VOTE] Publish additional Spark distribution with Spark Connect enabled

+1 (non-binding) On Wed, Feb 5, 2025 at 07:11 huaxin gao wrote: > +1 > > On Wed, Feb 5, 2025 at 1:39 AM Mich Talebzadeh > wrote: > >> +1 >> >> Dr Mich Talebzadeh, >> Architect | Data Science | Financial Crime | Forensic Analysis | GDPR >> >>view my Linkedin profile >>

Re: [DISCUSS] Publish additional Spark distribution with Spark Connect enabled

+1 (non-binding) on this proposal. Just as long as there are no schedule concerns - similar to Mridul and Dongjoon’s call outs, then yes, I think this would be helpful for adoption.Thanks! On Tue, Feb 4, 2025 at 18:43 huaxin gao wrote: > I support publishing an additional Spark distributio

Re: Increasing Shading & Relocating for 4.0

t;> teams which build platforms on top of Spark (thinking custom machine >> learning tools or special streaming stuff). >> >> It's sort of that classic problem of building something for the 90% but >> the 10% are the ones with the actual issue your trying to avoid. &g

Re: Re: Increasing Shading & Relocating for 4.0

BTW, one of many reasons Spark Connect was developed was to potentially simplify this process around shading (i.e. not need to do it). I’m wondering if utilizing Spark Connect could be a potential solution here? On Fri, Jan 17, 2025 at 12:27 Holden Karau wrote: > +1 I think this is great. If

Re: [VOTE] Use plain text logs by default

+1 (non-binding) On Thu, Jan 9, 2025 at 08:41 DB Tsai wrote: > +1 > > DB Tsai | https://www.dbtsai.com/ | PGP 42E5B25A8F7A82C1 > > On Jan 9, 2025, at 12:27 AM, Peter Toth wrote: > > +1 > > On Thu, Jan 9, 2025 at 8:37 AM Allison Wang > wrote: > >> +1 >> >> On Thu, Jan 9, 2025 at 2:45 PM L.

Re: [外部邮件] Re: Spark Connect the default API in Spark 4.0

+1 (non-binding) On Wed, Nov 27, 2024 at 3:07 AM Martin Grund wrote: > As part of the discussion on this topic, I would love to highlight the > work that the community is currently doing to support SparkML, which is > traditionally very RDD-heavy, natively in Spark Connect. Bobby's awesome > wor

Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?

> If by "at length" you mean ... among very few people, in a very few emails, throughout less than a week. Yes, you're totally right. The implication that this was a rash decision decided by a few people in a short amount of time is incorrect. This discussion all started on the thread "[VOTE] Off

Re: [VOTE] Officialy Deprecate GraphX in Spark 4

+1 (non-binding) On Thu, Oct 3, 2024 at 7:40 AM Wenchen Fan wrote: > +1 > > On Tue, Oct 1, 2024 at 4:20 PM beliefer wrote: > >> +1. >> >> I didn't hear users need it. >> >> >> At 2024-10-01 02:01:17, "Holden Karau" wrote: >> >> I think it has been de-facto deprecated, we haven’t updated it >>

Re: [VOTE] Move Variant to Parquet

+1 (non-binding) On Tue, Sep 3, 2024 at 17:13 Gengliang Wang wrote: > +1 > > On Tue, Sep 3, 2024 at 4:29 PM rdb...@gmail.com wrote: > >> +1 >> >> On Tue, Sep 3, 2024 at 3:38 PM Gene Pang wrote: >> >>> Hi Micah, >>> >>> I wanted to open this vote to get official alignment on where the Spark >>>

Re: [VOTE] Deprecate SparkR

+1 (non-binding) On Wed, Aug 21, 2024 at 9:50 AM Sean Owen wrote: > +1 > > On Wed, Aug 21, 2024, 11:40 AM Shivaram Venkataraman < > shivaram.venkatara...@gmail.com> wrote: > >> Hi all >> >> Based on the previous discussion thread [1], I hereby call a vote to >> deprecate the SparkR module in Apa

Re: Welcoming a new PMC member

Congrats, Kent! On Tue, Aug 13, 2024 at 9:06 AM Dongjoon Hyun wrote: > Congratulations, Kent. > > Dongjoon. > > On Mon, Aug 12, 2024 at 5:22 PM Xiao Li wrote: > >> Congratulations ! >> >> Hyukjin Kwon 于2024年8月12日周一 17:20写道： >> >>> Hi all, >>> >>> The Spark PMC recently voted to add a new PMC m

Re: [VOTE] Archive Spark Documentations in Apache Archives

+1 (non-binding) On Tue, Aug 13, 2024 at 6:16 AM Gengliang Wang wrote: > +1 > > On Mon, Aug 12, 2024 at 2:01 PM Xiao Li wrote: > >> +1 >> >> Mich Talebzadeh 于2024年8月12日周一 13:11写道： >> >>> Hi Kent, >>> >>> Can you if possible please provide a heuristic estimate of storage >>> reduction that will

Re: Welcome new Apache Spark committers

Congrats Allison, Martin, and Haejoon! On Tue, Aug 13, 2024 at 9:59 AM Jungtaek Lim wrote: > Congrats everyone! > > On Tue, Aug 13, 2024 at 9:21 AM Xiao Li wrote: > >> Congratulations! >> >> Hyukjin Kwon 于2024年8月12日周一 17:19写道： >> >>> Hi all, >>> >>> The Spark PMC recently voted to add three ne

Re: [VOTE] Using Github Issues for Spark-Connect-Go _only_ issues.

+1 (non-binding) On Mon, Aug 12, 2024 at 16:43 Reynold Xin wrote: > +1 > > On Mon, Aug 12, 2024 at 10:28 AM Mich Talebzadeh < > mich.talebza...@gmail.com> wrote: > >> +1 for me >> >> Mich Talebzadeh, >> >> Architect | Data Engineer | Data Science | Financial Crime >> PhD

Re: [DISCUSS] Using Github Issues for Spark-Connect-Go _only_ issues.

+1 (non-binding) to start as a small experiment On Fri, Aug 9, 2024 at 11:56 PM bo yang wrote: > +1 to start small as an experiment to see how people use GitHub issue... > > On Thu, Aug 8, 2024 at 11:54 PM Kent Yao wrote: > >> +1 >> >> On 2024/08/08 23:24:32 Hyukjin Kwon wrote: >> > SGTM >> > >

Re: [VOTE] Differentiate Spark without Spark Connect from Spark Connect

+1 (non-binding) On Tue, Jul 23, 2024 at 12:19 PM Sadha Chilukoori wrote: > +1 (non-binding) > > On Mon, Jul 22, 2024 at 5:56 PM Wenchen Fan wrote: > >> +1 >> >> On Tue, Jul 23, 2024 at 8:40 AM Xinrong Meng wrote: >> >>> +1 >>> >>> Thank you @Hyukjin Kwon ! >>> >>> On Mon, Jul 22, 2024 at 5:2

Re: [DISCUSS] Differentiate Spark without Spark Connect from Spark Connect

+1 for 'Classic' as well :) On Sun, Jul 21, 2024 at 10:15 AM Ruifeng Zheng wrote: > +1 for 'Classic' > > On Sun, Jul 21, 2024 at 8:03 AM Xiao Li wrote: > >> Classic is much better than Legacy. : ) >> >> Hyukjin Kwon 于2024年7月18日周四 16:58写道： >> >>> Hi all, >>> >>> I noticed that we need to standa

Re: [VOTE] Allow GitHub Actions runs for contributors' PRs without approvals in apache/spark-connect-go

+1 (non-binding) On Thu, Jul 4, 2024 at 19:13 Hyukjin Kwon wrote: > Hi all, > > I’d like to start a vote for allowing GitHub Actions runs for > contributors' PRs without approvals in apache/spark-connect-go. > > Please also refer to: > >- Discussion thread: > https://lists.apache.org/thread/

Re: [VOTE] Move Spark Connect server to builtin package (Client API layer stays external)

+1 (non-binding) On Wed, Jul 3, 2024 at 9:11 AM Hyukjin Kwon wrote: > Starting with my own +1. > > On Wed, 3 Jul 2024 at 09:59, Hyukjin Kwon wrote: > >> Hi all, >> >> I’d like to start a vote for moving Spark Connect server to builtin >> package (Client API layer stays external). >> >> Please a

Re: [FYI] SPARK-47993: Drop Python 3.8

+1 (non-binding) On Thu, Apr 25, 2024 at 19:26 Xinrong Meng wrote: > +1 > > On Thu, Apr 25, 2024 at 2:08 PM Holden Karau > wrote: > >> +1 >> >> Twitter: https://twitter.com/holdenkarau >> Books (Learning Spark, High Performance Spark, etc.): >> https://amzn.to/2MaRAG9

Re: [VOTE] SPARK-44444: Use ANSI SQL mode by default

+1 (non-binding) On Sat, Apr 13, 2024 at 7:49 PM huaxin gao wrote: > +1 > > On Sat, Apr 13, 2024 at 4:36 PM L. C. Hsieh wrote: > >> +1 >> >> On Sat, Apr 13, 2024 at 4:12 PM Hyukjin Kwon >> wrote: >> > >> > +1 >> > >> > On Sun, Apr 14, 2024 at 7:46 AM Chao Sun wrote: >> >> >> >> +1. >> >> >> >

Re: [VOTE] SPIP: Pure Python Package in PyPI (Spark Connect)

+1 (non-binding) On Mon, Apr 1, 2024 at 9:24 AM Hussein Awala wrote: > +1(non-binding) I add to the difference will it make that it will also > simplify package maintenance and easily release a bug fix/new feature > without needing to wait for Pyspark to release. > > On Mon, Apr 1, 2024 at 4:56

Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

+1 (non-binding) On Sun, Mar 10, 2024 at 23:36 Gengliang Wang wrote: > Hi all, > > I'd like to start the vote for SPIP: Structured Logging Framework for > Apache Spark > > References: > >- JIRA ticket >- SPIP doc > >

Re: [VOTE] Updating documentation hosted for EOL and maintenance releases

+1 On Tue, Sep 26, 2023 at 10:52 Maciej wrote: > +1 > > Best regards, > Maciej Szymkiewicz > > Web: https://zero323.net > PGP: A30CEF0C31A501EC > > On 9/26/23 17:12, Michel Miotto Barbosa wrote: > > +1 > > A disposição | At your disposal > > Michel Miotto Barbosa > https://www.linkedin.com/in/mi

Re: First Time contribution.

Hi Ram, We have some good guidance at https://spark.apache.org/contributing.html HTH! Denny On Sun, Sep 17, 2023 at 17:18 ram manickam wrote: > > > > Hello All, > Recently, joined this community and would like to contribute. Is there a > guideline or recommendation on tasks that can be picked

Re: [VOTE][SPIP] Python Data Source API

+1 (non-binding) On Fri, Jul 7, 2023 at 00:50 Maciej wrote: > +0 > > Best regards, > Maciej Szymkiewicz > > Web: https://zero323.net > PGP: A30CEF0C31A501EC > > On 7/6/23 17:41, Xiao Li wrote: > > +1 > > Xiao > > Hyukjin Kwon 于2023年7月5日周三 17:28写道： > >> +1. >> >> See https://youtu.be/yj7XlTB1Jvc

Re: [DISCUSS] SPIP: Python Data Source API

Slightly biased, but per my conversations - this would be awesome to have! On Mon, Jun 19, 2023 at 09:43 Abdeali Kothari wrote: > I would definitely use it - is it's available :) > > On Mon, 19 Jun 2023, 21:56 Jacek Laskowski, wrote: > >> Hi Allison and devs, >> >> Although I was against this i

Re: JDK version support policy?

+1 on dropping Java 8 in Spark 4.0, saying this as a fan of the fast-paced (positive) updates to Arrow, eh?! On Tue, Jun 6, 2023 at 4:02 PM Sean Owen wrote: > I haven't followed this discussion closely, but I think we could/should > drop Java 8 in Spark 4.0, which is up next after 3.5? > > On Tu

Re: [CONNECT] New Clients for Go and Rust

+1 on separate repo allowing different APIs to run at different speeds and ensuring they get community support. On Wed, May 24, 2023 at 00:37 Hyukjin Kwon wrote: > I think we can just start this with a separate repo. > I am fine with the second option too but in this case we would have to > tria

Re: Slack for Spark Community: Merging various threads

ck because all of us agree that this is important? > 2. I'm wondering what ASF misses here if Apache Spark PMC invites all > remaining subscribers of `user@spark` and `dev@spark` mailing lists. > > Thanks, > Dongjoon. > > [image: invitation.png] > [image: invited.png] >

Slack for Spark Community: Merging various threads

There have been a number of threads discussing creating a Slack for the Spark community that I'd like to try to help reconcile. Topic: Slack for Spark Why: Allows for the community to have the option to communicate with each other using Slack; a pretty popular async communication. Discussion poi

Re: Slack for PySpark users

>>>>>> medium size groups it is good and affordable. Alternatives have been >>>>>>> suggested as well so those who like investigative search can agree and >>>>>>> come >>>>>>> up with a freebie one. >>>>

Re: Slack for PySpark users

;>>> wrote: >>>>>> >>>>>>> +1 >>>>>>> >>>>>>> + @dev@spark.apache.org >>>>>>> >>>>>>> This is a good idea. The other Apache projects (e.g., Pinot, Druid, >>&g

Re: Topics for Spark online classes & webinars

> disclaimed. The author will in no case be liable for any monetary damages >> arising from such loss, damage or destruction. >> >> >> >> >> On Wed, 15 Mar 2023 at 18:31, Nitin Bhansali >> wrote: >> >> Hello Mich, >> >> My apologies

Re: Topics for Spark online classes & webinars

Thanks Mich for tackling this! I encourage everyone to add to the list so we can have a comprehensive list of topics, eh?! On Wed, Mar 15, 2023 at 10:27 Mich Talebzadeh wrote: > Hi all, > > Thanks to @Denny Lee to give access to > > https://www.linkedin.com/company/apach

Re: Topics for Spark online classes & webinars

rg or request to leverage the original Spark confluence page <https://cwiki.apache.org/confluence/display/SPARK>.WDYT? On Mon, Mar 13, 2023 at 9:34 AM Mich Talebzadeh wrote: > Well that needs to be created first for this purpose. The appropriate name > etc. to be decided. Maybe @Denny

Re: Spark on Kube (virtua) coffee/tea/pop times

Woohoo, Holden! I’m in (hopefully my schedule allows me) - PST. On Tue, Feb 7, 2023 at 15:34 Andrew Melo wrote: > I'm Central US time (AKA UTC -6:00) > > On Tue, Feb 7, 2023 at 5:32 PM Holden Karau wrote: > > > > Awesome, I guess I should have asked folks for timezones that they’re in. > > > >

Re: [VOTE] SPIP: Support Docker Official Image for Spark

+1 (non-binding) On Wed, Sep 21, 2022 at 10:33 PM Ankit Gupta wrote: > +1 > > Regards, > > Ankit Prakash Gupta > > On Thu, Sep 22, 2022 at 10:38 AM Yang,Jie(INF) > wrote: > >> +1 (non-binding) >> >> >> >> Regards, >> >> Yang Jie >> >> >> >> *发件人**: *Gengliang Wang >> *日期**: *2022年9月22日 星期四 12:

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

+1 (non-binding). This is a great idea and we should definitely do this. Count me in to help as well, eh?! :) On Sun, Sep 18, 2022 at 7:24 PM bo zhaobo wrote: > +1 (non-binding) > > This will bring the good experience to customers. So excited about this. > ;-) > > Yuming Wang 于2022年9月19日周一 10

Re: [VOTE] SPIP: Support pandas API layer on PySpark

+1 (non-binding) On Sun, Mar 28, 2021 at 9:06 PM 郑瑞峰 wrote: > +1 (non-binding) > > > -- 原始邮件 -- > *发件人:* "Maxim Gekk" ; > *发送时间:* 2021年3月29日(星期一) 凌晨2:08 > *收件人:* "Matei Zaharia"; > *抄送:* "Gengliang Wang";"Mridul Muralidharan"< > mri...@gmail.com>;"Xiao Li";"Spark

Re: I'm going to be out starting Nov 5th

Best wishes Holden! :) On Sat, Oct 31, 2020 at 11:00 Dongjoon Hyun wrote: > Take care, Holden! I believe everything goes well. > > Bests, > Dongjoon. > > On Sat, Oct 31, 2020 at 10:24 AM Reynold Xin wrote: > >> Take care Holden and best of luck with everything! >> >> >> On Sat, Oct 31 2020 at 1

Re: [vote] Apache Spark 3.0 RC3

+1 (non-binding) On Sun, Jun 7, 2020 at 3:21 PM Jungtaek Lim wrote: > I'm seeing the effort of including the correctness issue SPARK-28067 [1] > to 3.0.0 via SPARK-31894 [2]. That doesn't seem to be a regression so > technically doesn't block the release, so while it'd be good to weigh its > wor

Re: [VOTE] Amend Spark's Semantic Versioning Policy

+1 (non-binding) On Mon, Mar 9, 2020 at 1:59 AM Hyukjin Kwon wrote: > The proposal itself seems good as the factors to consider, Thanks Michael. > > Several concerns mentioned look good points, in particular: > > > ... assuming that this is for public stable APIs, not APIs that are > marked as u

Re: Block a user from spark-website who repeatedly open the invalid same PR

+1 On Sun, Jan 26, 2020 at 09:59 Nicholas Chammas wrote: > +1 > > I think y'all have shown this person more patience than is merited by > their behavior. > > On Sun, Jan 26, 2020 at 5:16 AM Takeshi Yamamuro > wrote: > >> +1 >> >> Bests, >> Takeshi >> >> On Sun, Jan 26, 2020 at 3:05 PM Hyukjin K

Re: Should python-2 be supported in Spark 3.0?

+1 On Fri, May 31, 2019 at 17:58 Holden Karau wrote: > +1 > > On Fri, May 31, 2019 at 5:41 PM Bryan Cutler wrote: > >> +1 and the draft sounds good >> >> On Thu, May 30, 2019, 11:32 AM Xiangrui Meng wrote: >> >>> Here is the draft announcement: >>> >>> === >>> Plan for dropping Python 2 suppor

Re: [VOTE] [SPARK-25994] SPIP: DataFrame-based Property Graphs, Cypher Queries, and Algorithms

+1 yay - let's do it! On Tue, Jan 29, 2019 at 6:28 AM Xiangrui Meng wrote: > Hi all, > > I want to call for a vote of SPARK-25994 > . It introduces a new > DataFrame-based component to Spark, which supports property graph > construction, Cypher

Re: [VOTE] SPARK 2.2.3 (RC1)

+1 On Wed, Jan 9, 2019 at 4:30 AM Dongjoon Hyun wrote: > +1 > > Bests, > Dongjoon. > > On Tue, Jan 8, 2019 at 6:30 PM Wenchen Fan wrote: > >> +1 >> >> On Wed, Jan 9, 2019 at 3:37 AM DB Tsai wrote: >> >>> +1 >>> >>> Sincerely, >>> >>> DB Tsai >>> ---

Re: [VOTE] SPARK 2.4.0 (RC5)

+1 On Wed, Oct 31, 2018 at 12:54 PM Chitral Verma wrote: > +1 > > On Wed, 31 Oct 2018 at 11:56, Reynold Xin wrote: > >> +1 >> >> Look forward to the release! >> >> >> >> On Mon, Oct 29, 2018 at 3:22 AM Wenchen Fan wrote: >> >>> Please vote on releasing the following candidate as Apache Spark v

Re: welcome a new batch of committers

Congratulations! On Wed, Oct 3, 2018 at 05:26 Dongjin Lee wrote: > Congratulations to ALL!! > > - Dongjin > > On Wed, Oct 3, 2018 at 7:48 PM Jack Kolokasis > wrote: > >> Congratulations to all !! >> >> -Iacovos >> >> On 03/10/2018 12:54 μμ, Ted Yu wrote: >> >> Congratulations to all ! >> >> ---

Re: [VOTE] SPARK 2.4.0 (RC2)

+1 (non-binding) On Sat, Sep 29, 2018 at 10:24 AM Stavros Kontopoulos < stavros.kontopou...@lightbend.com> wrote: > +1 > > Stavros > > On Sat, Sep 29, 2018 at 5:59 AM, Sean Owen wrote: > >> +1, with comments: >> >> There are 5 critical issues for 2.4, and no blockers: >> SPARK-25378 ArrayData.t

Re: [VOTE] SPARK 2.3.2 (RC6)

+1 On Thu, Sep 20, 2018 at 9:55 AM Xiao Li wrote: > +1 > > > John Zhuge 于2018年9月19日周三 下午1:17写道： > >> +1 (non-binding) >> >> Built on Ubuntu 16.04 with Maven flags: -Phadoop-2.7 -Pmesos -Pyarn >> -Phive-thriftserver -Psparkr -Pkinesis-asl -Phadoop-provided >> >> java version "1.8.0_181" >> Java(

Re: [VOTE] SPARK 2.3.2 (RC3)

+1 (non-binding) On Tue, Jul 17, 2018 at 23:04 John Zhuge wrote: > +1 (non-binding) > > On Mon, Jul 16, 2018 at 8:04 PM Saisai Shao > wrote: > >> I will put my +1 on this RC. >> >> For the test failure fix, I will include it if there's another RC. >> >> Sean Owen 于2018年7月16日周一 下午10:47写道： >> > O

Re: [VOTE] Spark 2.3.1 (RC4)

+1 On Sat, Jun 2, 2018 at 4:53 PM Nicholas Chammas wrote: > I'll give that a try, but I'll still have to figure out what to do if none > of the release builds work with hadoop-aws, since Flintrock deploys Spark > release builds to set up a cluster. Building Spark is slow, so we only do > it if t

Re: Revisiting Online serving of Spark models?

I most likely will not be able to join SF next week but definitely up for a session after Summit in Seattle to dive further into this, eh?! On Wed, May 30, 2018 at 9:32 AM Felix Cheung wrote: > Hi! > > Thank you! Let’s meet then > > June 6 4pm > > Moscone West Convention Center > 800 Howard Stre

Re: Welcome Zhenhua Wang as a Spark committer

Awesome - congrats Zhenhua! On Sun, Apr 1, 2018 at 10:33 PM 叶先进 wrote: > Big congs. > > > On Apr 2, 2018, at 1:28 PM, Wenchen Fan wrote: > > > > Hi all, > > > > The Spark PMC recently added Zhenhua Wang as a committer on the project. > Zhenhua is the major contributor of the CBO project, and ha

Re: [VOTE] Spark 2.3.0 (RC5)

+1 (non-binding) On Fri, Feb 23, 2018 at 07:08 Josh Goldsborough < joshgoldsboroughs...@gmail.com> wrote: > New to testing out Spark RCs for the community but I was able to run some > of the basic unit tests without error so for what it's worth, I'm a +1. > > On Thu, Feb 22, 2018 at 4:23 PM, Same

Re: [VOTE] Spark 2.3.0 (RC4)

+1 (non-binding) Built and tested on macOS and Ubuntu. On Sun, Feb 18, 2018 at 3:19 PM Ricardo Almeida < ricardo.alme...@actnowib.com> wrote: > +1 (non-binding) > > Built and tested on macOS 10.12.6 Java 8 (build 1.8.0_111). No > regressions detected so far. > > > On 18 February 2018 at 16:12,

Re: [VOTE] Spark 2.1.2 (RC4)

+1 (non-binding) On Wed, Oct 4, 2017 at 11:08 PM Holden Karau wrote: > Awesome, thanks for digging into the packaging on the R side in more > detail. I'll look into how to update the keys file as well. > > On Wed, Oct 4, 2017 at 10:46 PM Felix Cheung > wrote: > >> +1 >> >> Tested SparkR packag

Re: [VOTE] Spark 2.1.2 (RC2)

+1 (non-binding) On Wed, Sep 27, 2017 at 6:54 AM Sean Owen wrote: > +1 > > I tested the source release. > Hashes and signature (your signature) check out, project builds and tests > pass with -Phadoop-2.7 -Pyarn -Phive -Pmesos on Debian 9. > List of issues look good and there are no open issues

Re: [VOTE][SPIP] SPARK-21866 Image support in Apache Spark

+1 On Thu, Sep 21, 2017 at 11:15 Sean Owen wrote: > Am I right that this doesn't mean other packages would use this > representation, but that they could? > > The representation looked fine to me w.r.t. what DL frameworks need. > > My previous comment was that this is actually quite lightweight.

Re: [VOTE] Spark 2.1.2 (RC1)

+1 (non-binding) On Thu, Sep 14, 2017 at 10:57 PM Felix Cheung wrote: > +1 tested SparkR package on Windows, r-hub, Ubuntu. > > _ > From: Sean Owen > Sent: Thursday, September 14, 2017 3:12 PM > Subject: Re: [VOTE] Spark 2.1.2 (RC1) > To: Holden Karau , > > > > +1 >

Re: Welcoming Hyukjin Kwon and Sameer Agarwal as committers

Congrats!! On Mon, Aug 7, 2017 at 17:39 Yanbo Liang wrote: > Great. > Congratulations, Hyukjin and Sameer! > > On Tue, Aug 8, 2017 at 7:53 AM, Holden Karau wrote: > >> Congrats! >> >> On Mon, Aug 7, 2017 at 3:54 PM Bryan Cutler wrote: >> >>> Great work Hyukjin and Sameer! >>> >>> On Mon, Aug 7

Re: [VOTE] Apache Spark 2.2.0 (RC6)

+1 (non-binding) On Mon, Jul 3, 2017 at 6:45 PM Liang-Chi Hsieh wrote: > +1 > > > Sameer Agarwal wrote > > +1 > > > > On Mon, Jul 3, 2017 at 6:08 AM, Wenchen Fan < > > > cloud0fan@ > > > > wrote: > > > >> +1 > >> > >> On 3 Jul 2017, at 8:22 PM, Nick Pentreath < > > > nick.pentreath@ > > > > > >>

Re: [VOTE] Apache Spark 2.2.0 (RC4)

+1 non-binding Tested on macOS Sierra, Ubuntu 16.04 test suite includes various test cases including Spark SQL, ML, GraphFrames, Structured Streaming On Wed, Jun 7, 2017 at 9:40 PM vaquar khan wrote: > +1 non-binding > > Regards, > vaquar khan > > On Jun 7, 2017 4:32 PM, "Ricardo Almeida" > w

Re: [VOTE] Apache Spark 2.1.1 (RC4)

+1 On Fri, Apr 28, 2017 at 9:17 AM Kazuaki Ishizaki wrote: > +1 (non-binding) > > I tested it on Ubuntu 16.04 and OpenJDK8 on ppc64le. All of the tests for > core have passed.. > > $ java -version > openjdk version "1.8.0_111" > OpenJDK Runtime Environment (build > 1.8.0_111-8u111-b14-2ubuntu0.1

Re: [VOTE] Apache Spark 2.1.1 (RC3)

+1 (non-binding) On Wed, Apr 19, 2017 at 9:23 PM Dong Joon Hyun wrote: > +1 > > I tested RC3 on CentOS 7.3.1611/OpenJDK 1.8.0_121/R 3.3.3 > with `-Pyarn -Phadoop-2.7 -Pkinesis-asl -Phive -Phive-thriftserver > –Psparkr` > > At the end of R test, I saw `Had CRAN check errors; see logs.`, > but te

Re: welcoming Burak and Holden as committers

Awesome! Congrats Burak & Holden!! On Tue, Jan 24, 2017 at 10:39 Joseph Bradley wrote: > Congratulations Burak & Holden! > > On Tue, Jan 24, 2017 at 10:33 AM, Dongjoon Hyun > wrote: > > Great! Congratulations, Burak and Holden. > > Bests, > Dongjoon. > > On 2017-01-24 10:29 (-0800), Nicholas Ch

Re: [VOTE] Apache Spark 2.1.0 (RC5)

+1 (non-binding) On Sat, Dec 17, 2016 at 11:45 PM Liwei Lin wrote: > +1 > > Cheers, > Liwei > > On Sat, Dec 17, 2016 at 10:29 AM, Yuming Wang wrote: > > I hope https://github.com/apache/spark/pull/16252 can be fixed until > release 2.1.0. It's a fix for broadcast cannot fit in memory. > > On S

Re: Handling questions in the mailing lists

tributors with enough reputation to have relevant > privilages. > > For example: creating tags (requires 1500 reputation), edit questions and > answers (2000), create tag synonums (2500), approve tag wiki edits (5000), > access to moderator tools (1, this is required to delete qu

Re: Handling questions in the mailing lists

I know I originally suggested SO, however, if we do not have contributors > with the required privileges and the willingness to help manage everything > then I am not sure this is a good fit. > > Assaf. > > > > *From:* Denny Lee [via Apache Spark Developers List] [mailto:ml-node+

Re: [VOTE] Release Apache Spark 2.0.2 (RC3)

+1 (non binding) On Tue, Nov 8, 2016 at 10:14 PM vaquar khan wrote: > *+1 (non binding)* > > On Tue, Nov 8, 2016 at 10:21 PM, Weiqing Yang > wrote: > > +1 (non binding) > > > Environment: CentOS Linux release 7.0.1406 (Core) / openjdk version > "1.8.0_111" > > > > ./build/mvn -Pyarn -Phadoop

Re: Handling questions in the mailing lists

Here here! :) Completely agree with you - here's the latest updates to Proposed Community Mailing Lists / StackOverflow Changes . Keep them coming though at this point, I'd like to limit new verbiage to prevent

Re: Handling questions in the mailing lists

n issue I see and the one we can’t seem > to get around is dividing between simple questions that the community > should answer and hard questions which only advanced users can answer. > > > > Maybe SO isn’t the correct platform for that but even within it we can try > to fin

Re: Handling questions in the mailing lists

To help track and get the verbiage for the Spark community page and welcome email jump started, here's a working document for us to work with: https://docs.google.com/document/d/1N0pKatcM15cqBPqFWCqIy6jdgNzIoacZlYDCjufBh2s/edit# Hope this will help us collaborate on this stuff a little faster. On

Re: [VOTE] Release Apache Spark 2.0.2 (RC1)

Oh, I forgot to note that when downloading and running against the Spark 2.0.2 without Hadoop binaries, I got a JNI error due to an exception with org / slf4j / logger (i.e. org.slf4j.Logger class is not found). On Mon, Oct 31, 2016 at 4:35 PM Reynold Xin wrote: > OK I will cut a new RC tomorr

Re: [VOTE] Release Apache Spark 2.0.2 (RC1)

+1 (non-binding) On Thu, Oct 27, 2016 at 3:36 PM Ricardo Almeida < ricardo.alme...@actnowib.com> wrote: > +1 (non-binding) > > built and tested without regressions from 2.0.1. > > > > On 27 October 2016 at 19:07, vaquar khan wrote: > > +1 > > > > On Thu, Oct 27, 2016 at 11:56 AM, Davies Liu >

Re: welcoming Xiao Li as a committer

Congrats, Xiao! On Tue, Oct 4, 2016 at 00:00 Takeshi Yamamuro wrote: > congrats, xiao! > > On Tue, Oct 4, 2016 at 3:59 PM, Hyukjin Kwon wrote: > > Congratulations! > > 2016-10-04 15:51 GMT+09:00 Dilip Biswal : > > Hi Xiao, > > Congratulations Xiao !! This is indeed very well deserved !! > > Reg

Re: [VOTE] Release Apache Spark 2.0.1 (RC4)

+1 (non-binding) On Thu, Sep 29, 2016 at 9:43 PM Jeff Zhang wrote: > +1 > > On Fri, Sep 30, 2016 at 9:27 AM, Burak Yavuz wrote: > >> +1 >> >> On Sep 29, 2016 4:33 PM, "Kyle Kelley" wrote: >> >>> +1 >>> >>> On Thu, Sep 29, 2016 at 4:27 PM, Yin Huai wrote: >>> +1 On Thu, Sep 29,

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

; >>>> On Mon, Sep 26, 2016 at 9:54 AM, Davies Liu >>>> wrote: >>>> >>>>> +1 (non-binding) >>>>> >>>>> On Mon, Sep 26, 2016 at 9:36 AM, Joseph Bradley >>>>> wrote: >>>>> > +1 >>>

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

+1 (non-binding) On Sun, Sep 25, 2016 at 23:20 Jeff Zhang wrote: > +1 > > On Mon, Sep 26, 2016 at 2:03 PM, Shixiong(Ryan) Zhu < > shixi...@databricks.com> wrote: > >> ＋1 >> >> On Sun, Sep 25, 2016 at 10:43 PM, Pete Lee wrote: >> >>> +1 >>> >>> >>> On Sun, Sep 25, 2016 at 3:26 PM, Herman van Höve

Re: Welcoming Felix Cheung as a committer

Awesome - congrats Felix! On Mon, Aug 8, 2016 at 9:44 PM Felix Cheung wrote: > Thank you! > Looking forward to work with you all! > > > > > > On Mon, Aug 8, 2016 at 7:41 PM -0700, "Yanbo Liang" > wrote: > > Congrats Felix! > > 2016-08-08 18:21 GMT-07:00 Kai Jiang : > >> Congrats Felix! >> >> On

Re: [GRAPHX] Graph Algorithms and Spark

BTW, we recently had a webinar on GraphFrames at http://go.databricks.com/graphframes-dataframe-based-graphs-for-apache-spark On Thu, Apr 21, 2016 at 14:30 Dimitris Kouzis - Loukas wrote: > This thread is good. Maybe it should make it to doc or the users group > > On Thu, Apr 21, 2016 at 9:25 PM

Re: Welcoming two new committers

Awesome - congratulations Herman and Wenchan! On Mon, Feb 8, 2016 at 10:26 AM Dilip Biswal wrote: > Congratulations Wenchen and Herman !! > > Regards, > Dilip Biswal > Tel: 408-463-4980 > dbis...@us.ibm.com > > > > From:Xiao Li > To:Corey Nolet > Cc:Ted Yu , Matei Zahar

  1   2   >