Re: Spark Docker image with added packages

2024-10-17 Thread Damien Hawes
ns here will > result with both conflicting. > > How can one add packages to their Spark (during the build process of the > Docker image) - without causing unresolved conflicts? > > Thanks! > Nimrod > > > On Tue, Oct 15, 2024 at 6:53 PM Damien Hawes > wrote: >

Fwd: [SparkListener] Accessing classes loaded via the '--packages' option

2024-05-04 Thread Damien Hawes
Hi folks, I'm contributing to the OpenLineage project, specifically the Apache Spark integration. My current focus is on extending the project to support data lineage extraction for Spark Streaming, beginning with Apache Kafka sources and sinks. I've encountered an obstacle when attempting to acc