I reported the issue as SPARK-22783.
Hope this will be resolved soon.
Regards
Omkar
On Fri, Dec 1, 2017 at 10:55 PM, Marcelo Vanzin wrote:
> There's really no current solution to this. There's a brief discussion
> about it on SPARK-12140.
>
> Here we recommend people disable event logs for st
There's really no current solution to this. There's a brief discussion
about it on SPARK-12140.
Here we recommend people disable event logs for streaming apps, as
sub-optimal as that might be...
On Fri, Dec 1, 2017 at 3:27 AM, kankalapti omkar naidu
wrote:
> Dear spark developers,
>
> I did not
Dear spark developers,
I did not find rolling policy for spark event logs,for long living
streaming applications the event log is becoming huge with in few hours.
The only way I found is fixing the existing event logging spark
listener(EventLoggingListener),
but I believe there should be already a
