For sure, but, that is what Maven/SBT do. It resolves your project dependencies, looking at all their transitive dependencies, according to some rules. You do not need to re-declare Spark's dependencies in your project, no. I'm not quite sure what you mean.
On Tue, Jun 3, 2025 at 12:55 PM Nimrod Ofek <ofek.nim...@gmail.com> wrote: > Thanks Sean. > There are other dependencies that you need to align with Spark if you need > to use them as well - like Guava, Jackson etc. > I find them more difficult to use - because you need to go to Spark repo > to check the correct version used - and if there are upgrades between > versions you need to check that to upgrade as well. > What do you think? >
