Re: Observability support in spark-kubernetes-operator?

Hi Yasukazu, spark-Kubernetes-operator does support exposing metrics to Prometheus, please refer docs for available metrics and forwarding behavior at https://github.com/apache/spark-kubernetes-operator/blob/main/docs/configuration.md#forward-metrics-to-prometheus Regards, Zhou > On Jun 29, 20

Re: [VOTE] Release Apache Spark K8s Operator 0.3.0 (RC1)

a/projects/SPARK/versions/12355949 > > Thanks, > Dongjoon. > -- *Zhou JIANG*

Re: [VOTE] Release Apache Spark Connect Swift Client 0.3.0 (RC1)

eases/tag/0.3.0-rc.1 > (commit: 60fa9c40174c134c07b1eec8678b7ed4c588e22a) > > RELEASE FILES: > > https://dist.apache.org/repos/dist/dev/spark/spark-connect-swift-0.3.0-rc.1/ > > LIST OF ISSUES: > https://issues.apache.org/jira/projects/SPARK/versions/12355948 > > Thanks, > Dongjoon. > -- *Zhou JIANG*

Re: [VOTE] Release Apache Spark Connect Swift Client 0.2.0 (RC1)

+1 (non-binding)On May 17, 2025, at 16:28, Hyukjin Kwon wrote:+1On Sun, 18 May 2025 at 07:47, L. C. Hsieh wrote:+1 Thanks Dongjoon. On Sat, May 17, 2025 at 5:40 AM Dongjoon Hyun wrote: > > Please vote on releasing the following candidate as Apache Sp

Re: [VOTE] Release Apache Spark K8s Operator 0.2.0 (RC1)

+1 Thanks Dongjoon! *Zhou JIANG* On Sat, May 17, 2025 at 08:30 Dongjoon Hyun wrote: > +1 > > I checked the shasum and signature and tested with K8s v1.32. > > Thanks, > Dongjoon > > On 2025/05/17 15:19:58 Dongjoon Hyun wrote: > > Please vote on releasing the

Re: [VOTE] Release Apache Spark K8s Operator 0.1.0 (RC1)

+1 , thanks for driving this release! *Zhou JIANG* On Sun, May 4, 2025 at 16:58 Dongjoon Hyun wrote: > Please vote on releasing the following candidate as Apache Spark K8s > Operator 0.1.0. This vote is open for the next 72 hours and passes if a > majority +1 PMC votes are cas

Re: [VOTE] SPIP: Constraints in DSv2

+1On Mar 21, 2025, at 12:15, huaxin gao wrote:+1On Fri, Mar 21, 2025 at 12:08 PM Denny Lee wrote:+1 (non-binding) On Fri, Mar 21, 2025 at 11:52 Gengliang Wang wrote:+1On Fri, Mar 21, 2025 at 11:46 AM Anton Okolnychyi wrote:Hi all,

Re: [Discuss] SPIP: Support NanoSecond Timestamps

+1 for the nanosecond support > On Mar 16, 2025, at 16:03, Dongjoon Hyun wrote: > > +1 for supporting NanoSecond Timestamps. > > Thank you, Qi. > > Dongjoon. > > - > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [VOTE] Release Apache Spark 3.5.5 deprecating `spark.databricks.*` configuration

+1 (non-binding)On Feb 19, 2025, at 04:20, Peter Toth wrote:+1On Wed, Feb 19, 2025 at 10:20 AM Max Gekk wrote:+1On Wed, Feb 19, 2025 at 9:15 AM L. C. Hsieh wrote:+1 On Tue, Feb 18, 2025 at 9:46 PM dongjoon.hyun wrote: > > Please v

Re: [VOTE] Release Spark 3.4.4 (RC1)

+1 *Zhou JIANG* On Mon, Oct 21, 2024 at 11:04 Dongjoon Hyun wrote: > +1 > > Dongjoon Hyun. > > On 2024/10/21 06:58:17 Dongjoon Hyun wrote: > > Please vote on releasing the following candidate as Apache Spark version > > 3.4.4. > > > > The vote is open

Re: [VOTE] Release Spark 4.0.0-preview2 (RC1)

+ 1 Sent from my iPhone > On Sep 16, 2024, at 01:04, Dongjoon Hyun wrote: > >  > Please vote on releasing the following candidate as Apache Spark version > 4.0.0-preview2. > > The vote is open until September 20th 1AM (PDT) and passes if a majority +1 > PMC votes are cast, with a minimum of

Re: [VOTE] Release Apache Spark 3.5.3 (RC3)

+1 *Zhou JIANG* On Wed, Sep 11, 2024 at 17:29 Ruifeng Zheng wrote: > +1 > > On Thu, Sep 12, 2024 at 2:36 AM L. C. Hsieh wrote: > >> +1 >> >> Thanks. >> >> On Wed, Sep 11, 2024 at 10:41 AM Dongjoon Hyun >> wrote: >> > >> >

Re: [VOTE] Deprecate SparkR

;> shivaram.venkatara...@gmail.com> wrote: >>> > >>>>> >>> > >>>>>> Hi all >>> > >>>>>> >>> > >>>>>> Based on the previous discussion thread [1], I hereby call a >>> vote to >>> > >>>>>> deprecate the SparkR module in Apache Spark with the upcoming >>> Spark 4 >>> > >>>>>> release and remove it in the next major release Spark 5. >>> > >>>>>> >>> > >>>>>> [ ] +1: Accept the proposal >>> > >>>>>> [ ] +0 >>> > >>>>>> [ ] -1: I don’t think this is a good idea because .. >>> > >>>>>> >>> > >>>>>> This vote will be open for the next 72 hours >>> > >>>>>> >>> > >>>>>> Thanks >>> > >>>>>> Shivaram >>> > >>>>>> >>> > >>>>>> [1] >>> https://lists.apache.org/thread/qjgsgxklvpvyvbzsx1qr8o533j4zjlm5 >>> > >>>>>> >>> > >>>>> >>> > >>> >>> - >>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >>> >>> -- *Zhou JIANG*

Re: [VOTE] Release Spark 3.5.2 (RC5)

+1 (non-binding) - thanks for the new RC!Sent from my iPhoneOn Aug 9, 2024, at 10:06, Gengliang Wang wrote:+1. Thanks for creating this new RC. I confirmed that SPARK-49054 is fixed.On Fri, Aug 9, 2024 at 6:54 AM Wenchen Fan wrote:+1On Fri, Aug 9, 2024 at 6:04 PM Peter Toth

Re: [VOTE] Release Spark 3.5.2 (RC4)

+1 (non-binding) *Zhou JIANG* On Mon, Jul 29, 2024 at 11:06 L. C. Hsieh wrote: > +1 > > On Mon, Jul 29, 2024 at 7:33 AM Wenchen Fan wrote: > > > > +1 > > > > On Sat, Jul 27, 2024 at 10:03 AM Dongjoon Hyun > wrote: > >> > >> +1 > >

Re: [外部邮件] [VOTE] Release Spark 3.5.2 (RC2)

+1 (non-binding) *Zhou JIANG* On Tue, Jul 23, 2024 at 20:41 L. C. Hsieh wrote: > +1 > > Thanks. > > On Tue, Jul 23, 2024 at 8:35 PM Dongjoon Hyun wrote: > > > > +1 > > > > Dongjoon. > > > > On 2024/07/24 03:28:58 Wenchen Fan wrote: > &g

Re: [DISCUSS] Release Apache Spark 3.5.2

;> [2] https://issues.apache.org/jira/projects/SPARK/versions/12353980 >> >> - >> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >> >> -- *Zhou JIANG*

Re: [VOTE] Allow GitHub Actions runs for contributors' PRs without approvals in apache/spark-connect-go

d: > https://lists.apache.org/thread/tsqm0dv01f7jgkv5l4kyvtpw4tc6f420 >- JIRA ticket: https://issues.apache.org/jira/browse/INFRA-25936 > > Please vote on the SPIP for the next 72 hours: > > [ ] +1: Accept the proposal > [ ] +0 > [ ] -1: I don’t think this is a good idea because … > > Thank you! > > -- *Zhou JIANG*

Re: [VOTE] SPIP: Stored Procedures API for Catalogs

SPIP > [ ] +0 > [ ] -1: I don’t think this is a good idea because … > > > Thank you! > > Liang-Chi Hsieh > > ----- > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org > > -- *Zhou JIANG*

Re: [VOTE] SPARK-46122: Set spark.sql.legacy.createHiveTableByDefault to false

e spark.sql.legacy.createHiveTableByDefault because > ... > > > > Thank you in advance. > > > > Dongjoon > > > > - > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org > > -- *Zhou JIANG*

Ready for Review: spark-kubernetes-operator Alpha Release

y of Spark application. We are calling for reviews and inputs on this PR. Please feel free to provide any suggestions, concerns, or feedback that could help to improve the quality and functionality of the project. We look forward to your feedback. -- *Zhou JIANG*

Re: [DISCUSSION] SPIP: An Official Kubernetes Operator for Apache Spark

ponent of the Open Source Spark Project! > > Thanks! > > Shiqi > > On Mon, Nov 13, 2023 at 11:50 PM L. C. Hsieh wrote: > >> Thanks for all the support from the community for the SPIP proposal. >> >> Since all questions/discussion are settled down (if I didn't

Re: [DISCUSSION] SPIP: An Official Kubernetes Operator for Apache Spark

n't see any discussion of the > target scale or plans to achieve it? > > > > On Thu, Nov 9, 2023 at 9:02 PM Zhou Jiang wrote: > >> Hi Spark community, >> >> I'm reaching out to initiate a conversation about the possibility of >> developing a Ja

Re: [DISCUSSION] SPIP: An Official Kubernetes Operator for Apache Spark

at we witness community >>>>>>>> adoption following the release of the Flink Kubernetes operator, >>>>>>>> streamlining Flink deployment on Kubernetes. >>>>>>>> >>>>>>>> A well-maintained official

Re: [DISCUSSION] SPIP: An Official Kubernetes Operator for Apache Spark

ark app to leverage this operator? > > Thanks, > Cheng Pan > > > > On Nov 11, 2023, at 03:21, Zhou Jiang wrote: > > > > Not really - this is not designed to be a replacement for the current > approach. Kubernetes operator fits in the scenario for automation and

[DISCUSSION] SPIP: An Official Kubernetes Operator for Apache Spark

an be achieved in similar scenarios. More details can be found at SPIP doc : Spark Kubernetes Operator https://docs.google.com/document/d/1f5mm9VpSKeWC72Y9IiKN2jbBn32rHxjWKUfLRaGEcLE Thanks, -- *Zhou JIANG*