nblagodarnyi commented on issue #864: URL: https://github.com/apache/datafusion-comet/issues/864#issuecomment-2315711325
`spark.[driver|executor].extraClassPath` should be a semicolon-separated list of local jars with absolute local paths. spark-submit silently ignores errors in this config. That's why spark cannot find mentioned class in its classpath. This example works for me ``` export JARS_LOCAL="/opt/spark-3.5.1/jars_ext/comet-spark-spark3.5_2.12-0.2.0-SNAPSHOT-210824.jar:/opt/spark-3.5.1/jars_ext/spark-metrics-3.5-1.0.0.jar"; spark-shell \ ... --conf spark.plugins=org.apache.spark.CometPlugin \ --conf spark.driver.extraClassPath=$JARS_LOCAL \ --conf spark.executor.extraClassPath=$JARS_LOCAL ... ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
