;> was the explanation of the developer who made this decision (who's no
>> longer on the team). We're in the process of re-evaluating.
>> --
>> Nick
>>
>> -Original Message-
>> From: Adrian Tanase [mailto:atan...@adobe.com]
>> Sent
cess of re-evaluating.
> --
> Nick
>
> -Original Message-
> From: Adrian Tanase [mailto:atan...@adobe.com]
> Sent: Wednesday, October 28, 2015 4:53 PM
> To: Afshartous, Nick
> Cc: user@spark.apache.org
> Subject: Re: Spark/Kafka Streaming Job Gets Stuck
>
>From: Adrian Tanase [mailto:atan...@adobe.com]
>Sent: Wednesday, October 28, 2015 4:53 PM
>To: Afshartous, Nick
>Cc: user@spark.apache.org
>Subject: Re: Spark/Kafka Streaming Job Gets Stuck
>
>Does it work as expected with smaller batch or smaller load? Could it be that
&g
m]
Sent: Wednesday, October 28, 2015 4:53 PM
To: Afshartous, Nick
Cc: user@spark.apache.org
Subject: Re: Spark/Kafka Streaming Job Gets Stuck
Does it work as expected with smaller batch or smaller load? Could it be that
it's accumulating too many events over 3 minutes?
You could also try increas
Other than @Adrian suggestions, check if the processing delay is more than
the batch processing time.
On Thu, Oct 29, 2015 at 2:23 AM, Adrian Tanase wrote:
> Does it work as expected with smaller batch or smaller load? Could it be
> that it's accumulating too many events over 3 minutes?
>
> You
Does it work as expected with smaller batch or smaller load? Could it be that
it's accumulating too many events over 3 minutes?
You could also try increasing the parallelism via repartition to ensure smaller
tasks that can safely fit in working memory.
Sent from my iPhone
> On 28 Oct 2015, at
