hat spark in of it self is more of a batch centric
>>>>> technology, however I strongly believe that DRA in the long lived
>>>>> streaming
>>>>> context is possibly even more important than DRA in batch context.
>>>>> Running
>>>&
long lived
>>>>> streaming context is possibly even more important than DRA in batch
>>>>> context. Running a large Hadoop/spark cluster 24x7 is expensive and
>>>>> could really benefit from the functionality that proper streaming work
>>>>>
;>> from the functionality that proper streaming work load based DRA could
>>>> bring.
>>>>
>>>> Also, knowing that the PR author has been running this DRA code in his
>>>> own environment for quite some time now successfully, makes it more
e PR author has been running this DRA code in his
>>> own environment for quite some time now successfully, makes it more
>>> frustrating. The code has essentially been tested externally before the PR
>>> was even raised. It seems to be more than just a theoretical im
has essentially been tested externally before the PR
>> was even raised. It seems to be more than just a theoretical improvement
>> to the codebase.
>>
>>
>>
>> Regards,
>>
>>
>>
>> Adam Hobbs
>>
>>
>>
>>
>> C2 -
oretical improvement
> to the codebase.
>
>
>
> Regards,
>
>
>
> Adam Hobbs
>
>
>
>
> C2 - Internal Use
> From: Jungtaek Lim
> *Sent:* Tuesday, 11 February 2025 8:49 AM
> *To:* adam.ho...@bendigoadelaide.com.au.invalid
> *Cc:* Matei Zah
theoretical improvement to the codebase.
Regards,
Adam Hobbs
C2 - Internal Use
From: Jungtaek Lim
Sent: Tuesday, 11 February 2025 8:49 AM
To: adam.ho...@bendigoadelaide.com.au.invalid
Cc: Matei Zaharia ; Spark dev list
Subject: Re: ASF board report draft for February 2025
CAUTION: This email
352).
>
> This seems like a bit of a failure in the process
> .
> Regards,
>
> Adam Hobbs
>
>
> C2 - Internal Use
> -Original Message-
> From: Matei Zaharia
> Sent: Thursday, 6 February 2025 2:57 PM
> To: Spark dev list
> Cc: priv...@spark.
park-wtf-i-like-it-when-a-plan-comes-together-part-i-48c52a667288>
>>>>>
>>>>> El jue, 6 feb 2025 a las 6:30, Adam Hobbs
>>>>> () escribió:
>>>>>
>>>>>> I'd like to add something around the failure to get any traction o
t;>>>> shepparding of the structured streaming DRA PR. Multiple times now there
>>>>> have been calls for help to get this initiative over the line and the
>>>>> response has been disappointing. The github PR has been closed due to
>>>>> inacti
ve been calls for help to get this initiative over the line and the
>>>> response has been disappointing. The github PR has been closed due to
>>>> inaction (https://github.com/apache/spark/pull/42352).
>>>>
>>>> This seems like a bit of a failure in t
to
>>> inaction (https://github.com/apache/spark/pull/42352).
>>>
>>> This seems like a bit of a failure in the process
>>> .
>>> Regards,
>>>
>>> Adam Hobbs
>>>
>>>
>>> C2 - Internal Use
>>> -O
PR has been closed due to
>> inaction (https://github.com/apache/spark/pull/42352).
>>
>> This seems like a bit of a failure in the process
>> .
>> Regards,
>>
>> Adam Hobbs
>>
>>
>> C2 - Internal Use
>> -Original Message-
Use
> -Original Message-
> From: Matei Zaharia
> Sent: Thursday, 6 February 2025 2:57 PM
> To: Spark dev list
> Cc: priv...@spark.apache.org
> Subject: ASF board report draft for February 2025
>
> CAUTION: This email originated from outside of the organisation. Do not
&g
eport draft for February 2025
CAUTION: This email originated from outside of the organisation. Do not click
links or open attachments unless you recognise the sender's full email address
and know the content is safe.
It’s time to send our next ASF board report again on February 12th.
It’s time to send our next ASF board report again on February 12th. Here’s an
initial draft — feel free to suggest changes:
=
Description:
Apache Spark is a fast and general purpose engine for large-scale data
processing. It offers high-level APIs in Java, Scala, Python, R
16 matches
Mail list logo
