Tim,
Yes, you can use Java for your Spark workloads just fine.
Cheers
Jules
Excuse the thumb typos
On Fri, 04 Apr 2025 at 12:53 AM, tim wade wrote:
> Hello
>
> I am just newbie to spark. I am programming with Java mainly, knowing
> scala very bit.
>
> Can I just write code with java to talk t
Hi Tim,
We have a large ETL project comprising about forty individual Apache Spark
applications, all built exclusively in Java.
They are executed on three different Spark clusters built on AWS EC2 instances.
The applications are built in Java 17 for Spark 3.5.x.
Cheers,
Steve C
> On 4 Apr 20
Java is very much supported in Spark. In our open source project, we
haven’t done spark connect yet but we do a lot of transformations, ML and
graph stuff using Java with Spark. Never faced the language barrier.
Cheers,
Sonal
https://github.com/zinggAI/zingg
On Sat, 5 Apr 2025 at 4:42 PM, Ángel
I think you have more limitations using Spark Connect than Spark from Java.
I used RDD, registered UDFs, ... from Java without any problems.
El sáb, 5 abr 2025, 9:50, tim wade escribió:
> Hello
>
> I only know Java programming. If I use Java to communicate with the
> Spark API and submit tasks t
Hello
I only know Java programming. If I use Java to communicate with the
Spark API and submit tasks to Spark API from Java, I'm not sure what
disadvantages this might have. I see other people writing tasks in
Scala, then compiling them and submitting to Spark using spark-submit.
Thanks.
O
I think I did that some years ago in Spark 2.4 on a Hortonworks cluster
with SSL and Kerberos enabled. It worked, but never went into production.
El vie, 4 abr 2025, 9:54, tim wade escribió:
> Hello
>
> I am just newbie to spark. I am programming with Java mainly, knowing
> scala very bit.
>
> C
Hey Tim!
What are you aiming to achieve exactly?
Regards,
Jevon C
> On Apr 4, 2025, at 3:54 AM, tim wade wrote:
>
> Hello
>
> I am just newbie to spark. I am programming with Java mainly, knowing scala
> very bit.
>
> Can I just write code with java to talk to Spark's java API for submit
