Re: Allow Spark on K8s to integrate w/ External Log Service

2022-11-02 Thread Cheng Pan
> *To:* spark-dev > *Subject:* Allow Spark on K8s to integrate w/ External Log Service > > > EXTERNAL SENDER. Do not click links or open attachments unless you > recognize the sender and know the content is safe. DO NOT provide your > username or password. > > Hi Spark

Re: Allow Spark on K8s to integrate w/ External Log Service

2022-11-02 Thread Martin Andersson
Pan Sent: Tuesday, November 1, 2022 17:03 To: spark-dev Subject: Allow Spark on K8s to integrate w/ External Log Service EXTERNAL SENDER. Do not click links or open attachments unless you recognize the sender and know the content is safe. DO NOT provide your username or password. Hi Spark commu

Allow Spark on K8s to integrate w/ External Log Service

2022-11-01 Thread Cheng Pan
Hi Spark community, I’m recently working on migrating Spark workloads from Yarn to K8s, and one of the issue I found is that there is no out-of-box log solution for Spark applications on K8s as Yarn has, and Spark even does not provide a way to integrate w/ external log service. Based on the abov