I think you have more limitations using Spark Connect than Spark from Java.
I used RDD, registered UDFs, ... from Java without any problems.

El sáb, 5 abr 2025, 9:50, tim wade <di...@openmbox.net> escribió:

> Hello
>
> I only know Java programming. If I use Java to communicate with the
> Spark API and submit tasks to Spark API from Java, I'm not sure what
> disadvantages this might have. I see other people writing tasks in
> Scala, then compiling them and submitting to Spark using spark-submit.
>
> Thanks.
>
>
> On 2025-04-05 09:46, Jevon Cowell wrote:
> > Hey Tim!
> >
> > What are you aiming to achieve exactly?
> >
> > Regards,
> > Jevon C
> >
> >> On Apr 4, 2025, at 3:54 AM, tim wade <di...@openmbox.net> wrote:
> >>
> >> Hello
> >>
> >> I am just newbie to spark. I am programming with Java mainly, knowing
> >> scala very bit.
> >>
> >> Can I just write code with java to talk to Spark's java API for
> >> submitting jobs? (the main job is a stru-streaming job).
> >>
> >> Thanks.
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe e-mail: user-unsubscr...@spark.apache.org
> >>
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscr...@spark.apache.org
>
>

Reply via email to