ping .... El mar, 22 abr 2025, 6:05, Ángel Álvarez Pascua < angel.alvarez.pas...@gmail.com> escribió:
> Any news? > > El mié, 16 abr 2025, 16:16, nayan sharma <nayansharm...@gmail.com> > escribió: > >> HI Ángel, >> >> I haven't tried disabling speculation but I will try running in DEBUG >> mode. >> >> Thanks & Regards, >> Nayan Sharma >> *+91-8095382952* >> >> <https://www.linkedin.com/in/nayan-sharma> >> <http://stackoverflow.com/users/3687426/nayan-sharma?tab=profile> >> >> >> On Wed, Apr 16, 2025 at 12:32 PM Ángel Álvarez Pascua < >> angel.alvarez.pas...@gmail.com> wrote: >> >>> Hi Nayan, >>> >>> Yesterday, I tried to reproduce the issue with speculation enabled, but >>> no luck. Even when using threads and performing multiple actions >>> simultaneously, the stages got queued—but they all eventually completed. >>> >>> I'm curious... have you tried disabling speculation? If so, please let >>> me know if you noticed any improvement. >>> >>> Regards, >>> Ángel >>> >>> El lun, 14 abr 2025 a las 9:21, Ángel Álvarez Pascua (< >>> angel.alvarez.pas...@gmail.com>) escribió: >>> >>>> Hi Nayan, >>>> >>>> No worries about the logs. If speculation is enabled, that could >>>> explain everything. I understand it's your production environment, but >>>> would it be possible to disable speculation temporarily and see if the >>>> issue persists? >>>> >>>> Thanks, >>>> >>>> Ángel >>>> >>>> PS: I've started writing an article about this interesting issue. >>>> Thanks again for reporting it. >>>> >>>> El lun, 14 abr 2025 a las 2:55, nayan sharma (<nayansharm...@gmail.com>) >>>> escribió: >>>> >>>>> Hi Ángel, >>>>> Yes, speculation is enabled. I will lower log4j logging and share. It >>>>> will take atleast 24hr before we can capture anything. >>>>> >>>>> Thanks, >>>>> Nayan >>>>> >>>>> Thanks & Regards, >>>>> Nayan Sharma >>>>> *+91-8095382952* >>>>> >>>>> <https://www.linkedin.com/in/nayan-sharma> >>>>> <http://stackoverflow.com/users/3687426/nayan-sharma?tab=profile> >>>>> >>>>> On Mon, 14 Apr, 2025, 1:28 am Ángel Álvarez Pascua, < >>>>> angel.alvarez.pas...@gmail.com> wrote: >>>>> >>>>>> Hi Nayan, >>>>>> >>>>>> Do you happen to have spark.speculation enabled? >>>>>> Could you also lower the Log4j logging level to DEBUG and share the >>>>>> logs with me? >>>>>> >>>>>> I haven’t been able to reproduce the issue—every time a task fails >>>>>> and is retried, Spark correctly marks the stage as complete. >>>>>> >>>>>> Thanks, >>>>>> Ángel >>>>>> >>>>>>>
