Just submitted the patch: https://github.com/apache/spark/pull/29077
On Tue, Jun 16, 2020 at 3:40 PM Jungtaek Lim
wrote:
> Bump this again. I filed SPARK-31985 [1] and plan to submit a PR in a
> couple of days if there's no voice on the reason we should keep it.
>
> 1. https://issues.apache.org/
Bump this again. I filed SPARK-31985 [1] and plan to submit a PR in a
couple of days if there's no voice on the reason we should keep it.
1. https://issues.apache.org/jira/browse/SPARK-31985
On Thu, May 21, 2020 at 8:54 AM Jungtaek Lim
wrote:
> Let me share the effect on removing the incomplete
Let me share the effect on removing the incomplete and undocumented code
path. I manually tried out removing the code path and here's the change.
https://github.com/HeartSaVioR/spark/commit/aa53e9b1b33c0b8aec37704ad290b42ffb2962d8
1,120 lines deleted without hurting any existing streaming tests,
Hi devs,
during experiment on complete mode I realized we left some incomplete code
parts on supporting aggregation for continuous mode. (shuffle & coalesce)
The work had been occurred around first half of 2018 and stopped, and no
work has been done for around 2 years (so I don't expect anyone is
