LuciferYang commented on PR #47297: URL: https://github.com/apache/spark/pull/47297#issuecomment-2231142709
> `Scala 2.13 build with SBT` failed: > > ``` > [error] /home/runner/work/spark/spark/mllib-local/src/main/scala/org/apache/spark/ml/stat/distribution/MultivariateGaussian.scala:117:34: Symbol 'type scala.collection.compat.package.IterableOnce' is missing from the classpath. > [error] This symbol is required by 'type breeze.linalg.support.LowPrioCanTraverseValues.X'. > [error] Make sure that type IterableOnce is in your classpath and check for conflicting dependencies with `-Ylog-classpath`. > [error] A full rebuild may help if 'LowPrioCanTraverseValues.class' was compiled against an incompatible version of scala.collection.compat.package. > [error] val tol = Utils.EPSILON * max(d) * d.length > [error] ^ > [error] one error found > ``` > > @LuciferYang Do you have any idea why `mllib` module doesnt't have the depdency of `scala-collection-compat` since we have already directly managed that dependecy in `core` module? > > ``` > [INFO] --- dependency:3.6.0:tree (default-cli) @ spark-mllib_2.13 --- > [INFO] org.apache.spark:spark-mllib_2.13:jar:3.5.2-SNAPSHOT > [INFO] +- org.scala-lang.modules:scala-parser-combinators_2.13:jar:2.3.0:compile > [INFO] +- org.apache.spark:spark-core_2.13:jar:3.5.2-SNAPSHOT:compile > [INFO] | \- org.scala-lang.modules:scala-xml_2.13:jar:2.1.0:compile > [INFO] \- org.scala-lang.modules:scala-parallel-collections_2.13:jar:1.0.4:compile > ``` I reset to 45286ca locally, then ran `build/sbt "mllib/dependencyTree" -Pscala-2.13`. In the dependency tree, I can see `[info] | +-org.scala-lang.modules:scala-collection-compat_2.13:2.7.0 [S]`, so I still have no clue about this issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
