+1 (non-binding)
On Thu, Jan 9, 2025 at 3:02 PM Sakthi wrote:
> +1 (non-binding)
>
> Sakthi
>
> On Thu, Jan 9, 2025 at 9:16 AM Rozov, Vlad
> wrote:
>
>> +1 (non-binding)
>>
>> Vlad
>>
>> On Jan 8, 2025, at 8:28 PM, Wenchen Fan wrote:
>>
>> Hi all,
>>
>> Following the discussion[1], I'd like to
Hi Ofir.
Right now, the push based shuffle within Spark is only supported for Spark
on YARN, with external shuffle service running as auxiliary service in
NodeManager, but not natively on K8s.
As far as I know, there are no recent plans to add the support for Spark on
K8s natively.
For question 2,
+1(non-binding)
On Fri, Nov 24, 2023 at 11:16 Mridul Muralidharan wrote:
>
> +1
>
> Regards,
> Mridul
>
> On Fri, Nov 24, 2023 at 8:21 AM Kent Yao wrote:
>
>> Hi Spark Dev,
>>
>> Following the discussion [1], I'd like to start the vote for the SPIP [2].
>>
>> The SPIP aims to improve the test c
+1(Non-binding)
On Tue, Nov 14, 2023 at 9:42 AM L. C. Hsieh wrote:
> Hi all,
>
> I’d like to start a vote for SPIP: An Official Kubernetes Operator for
> Apache Spark.
>
> The proposal is to develop an official Java-based Kubernetes operator
> for Apache Spark to automate the deployment and simp
+1 non-binding
On Tue, Apr 11, 2023 at 18:40 Ye Zhou wrote:
> Yes, it is not a regression issue. We can fix it after the release.
>
> Thanks
> Ye
>
> On Tue, Apr 11, 2023 at 17:42 Xiao Li wrote:
>
>> Thanks for testing it in your environment!
>>
>>
>
l fix it in 3.4 and the fix will be available in the next
> maintenance releases.
>
> Xiao
>
>
>
> Ye Zhou 于2023年4月11日周二 17:14写道：
>
>> Manually tested the binary in our cluster.
>> Started spark-shell application with some shuffle. Found one issue which
>>
Manually tested the binary in our cluster.
Started spark-shell application with some shuffle. Found one issue which is
related to push based shuffle client side metrics introduced in
https://github.com/apache/spark/pull/36165.
Filed a ticket https://issues.apache.org/jira/browse/SPARK-43100, posted
+1 (non-binding)
Thanks for proposing this improvement to SHS, it resolves the main
performance issue within SHS.
On Wed, Nov 16, 2022 at 1:15 PM Jungtaek Lim
wrote:
> +1
>
> Nice to see the chance for driver to reduce resource usage and increase
> stability, especially the fact that the driver
+1 (non-binding).
Run Maven build, tested within our YARN cluster, in client or cluster mode,
with push based shuffle enabled/disalbled, and shuffling a large amount of
data. Applications ran successfully with expected shuffle behavior.
On Fri, Oct 8, 2021 at 10:06 PM sarutak wrote:
> +1
>
> I
