Hey Tim!
What are you aiming to achieve exactly?
Regards,
Jevon C
> On Apr 4, 2025, at 3:54 AM, tim wade wrote:
>
> Hello
>
> I am just newbie to spark. I am programming with Java mainly, knowing scala
> very bit.
>
> Can I just write code with java to talk to Spark's java API for submit
inate with the current trigger and not produce the idle event if it somehow starts executing microbatch - this is tricky (as now we are talking about threading), but if there is an easy way to make it work, that would be ideal.Thanks,Jungtaek Lim (HeartSaVioR)On Thu, Mar 27, 2025 at 5:50 AM Jevon C
S Just noticed it’s your onQueryIdle implementation that I’m following
throughout the codebase!
> On Apr 4, 2025, at 10:00 PM, Jevon Cowell wrote:
>
> Hey Jungtaek!
>
> Wanted to update the mailing list on my current approach in case others
> wanted something similar.
> I c
Hello!
This is my first time ever utilizing a mailing list, so I apologize if I’m not
conforming to any standards or rules (and please correct me where obvious). I’m
looking to inquire about Spark’s StreamingQueryListener.
I currently have a Spark Streaming job with a trigger interval of 10 min
e no telling what the end state will be since it won’t be deterministic.
ExecutionContext’s reportTimeTaken method will definitely need to be
synchronized to ensure that each parallel thread writes one at a time.
Is there anything else I’m missing?
Regards,
Jevon Cowell
