Re: [VOTE] SPIP: Constraints in DSv2

2025-03-21 Thread Jules Damji
+1 (non-binding) — Sent from my iPhone Pardon the dumb thumb typos :) > On Mar 21, 2025, at 11:47 AM, Anton Okolnychyi wrote: > >  > Hi all, > > I would like to start a vote on adding support for constraints to DSv2. > > Discussion thread: > https://lists.apache.org/thread/njqjcryq0lot9rkbf

Re: [VOTE] SPIP: Constraints in DSv2

2025-03-21 Thread Ángel Álvarez Pascua
-1 (non-binding): Breaks the Chain of Responsibility. Constraints should be defined and enforced by the data sources themselves, not Spark. Spark is a processing engine, and enforcing constraints at this level blurs architectural boundaries, making Spark responsible for something it does not contro

Re: [VOTE] SPIP: Constraints in DSv2

2025-03-21 Thread Anton Okolnychyi
> > -1 (non-binding): Breaks the Chain of Responsibility. Constraints should > be defined and enforced by the data sources themselves, not Spark. Spark is > a processing engine, and enforcing constraints at this level blurs > architectural boundaries, making Spark responsible for something it does

Re: [VOTE] SPIP: Constraints in DSv2

2025-03-21 Thread Zhou Jiang
+1On Mar 21, 2025, at 12:15, huaxin gao wrote:+1On Fri, Mar 21, 2025 at 12:08 PM Denny Lee wrote:+1 (non-binding) On Fri, Mar 21, 2025 at 11:52 Gengliang Wang wrote:+1On Fri, Mar 21, 2025 at 11:46 AM Anton Okolnychyi wrote:Hi all,

Re: [VOTE] SPIP: Constraints in DSv2

2025-03-21 Thread L. C. Hsieh
+1 On Fri, Mar 21, 2025 at 12:13 PM huaxin gao wrote: > > +1 > > On Fri, Mar 21, 2025 at 12:08 PM Denny Lee wrote: >> >> +1 (non-binding) >> >> On Fri, Mar 21, 2025 at 11:52 Gengliang Wang wrote: >>> >>> +1 >>> >>> On Fri, Mar 21, 2025 at 11:46 AM Anton Okolnychyi >>> wrote: Hi all,

Re: [VOTE] SPIP: Constraints in DSv2

2025-03-21 Thread Gengliang Wang
+1 On Fri, Mar 21, 2025 at 11:46 AM Anton Okolnychyi wrote: > Hi all, > > I would like to start a vote on adding support for constraints to DSv2. > > *Discussion thread: * > https://lists.apache.org/thread/njqjcryq0lot9rkbf10mtvf7d1t602bj > *SPIP:* > https://docs.google.com/document/d/1EHjB4W1Lj

[VOTE] SPIP: Constraints in DSv2

2025-03-21 Thread Anton Okolnychyi
Hi all, I would like to start a vote on adding support for constraints to DSv2. *Discussion thread: * https://lists.apache.org/thread/njqjcryq0lot9rkbf10mtvf7d1t602bj *SPIP:* https://docs.google.com/document/d/1EHjB4W1LjiXxsK_G7067j9pPX0y15LUF1Z5DlUPoPIo *PR with the API changes:* https://github.

Re: [VOTE] SPIP: Constraints in DSv2

2025-03-21 Thread Denny Lee
+1 (non-binding) On Fri, Mar 21, 2025 at 11:52 Gengliang Wang wrote: > +1 > > On Fri, Mar 21, 2025 at 11:46 AM Anton Okolnychyi > wrote: > >> Hi all, >> >> I would like to start a vote on adding support for constraints to DSv2. >> >> *Discussion thread: * >> https://lists.apache.org/thread/njqj

Re: [VOTE] Release Spark 4.0.0 (RC3)

2025-03-21 Thread Bobby
I think https://issues.apache.org/jira/browse/SPARK-51537 should be fixed before 4.0.0 release, or else, the executor side will not use global jars added by `--jars` in the connect mode, which could result in deserialization exceptions.