Neuw84 commented on issue #1583: URL: https://github.com/apache/datafusion-comet/issues/1583#issuecomment-2778657089
Hi, I am testing Comet on Amazon EMR Serverless ( although I am getting trouble with the libraries) and was planning to publish a blogpost and a corresponding Github repo. I could collaborate on this one! I got a working version although now I am getting this on `org.apache.datafusion:comet-spark-spark3.5_2.12:0.7.0` In my case I am using the [Glue Generator](https://aws.amazon.com/marketplace/pp/prodview-xtty6azr4xgey) for the TPCDS. ``` An error was encountered: An error occurred while calling o225.showString. : java.util.NoSuchElementException: next on empty iterator at scala.collection.Iterator$$anon$2.next(Iterator.scala:41) at scala.collection.Iterator$$anon$2.next(Iterator.scala:39) at scala.collection.IterableLike.head(IterableLike.scala:109) at scala.collection.IterableLike.head$(IterableLike.scala:108) at scala.collection.mutable.ArrayOps$ofBoolean.scala$collection$IndexedSeqOptimized$$super$head(ArrayOps.scala:294) at scala.collection.IndexedSeqOptimized.head(IndexedSeqOptimized.scala:129) at scala.collection.IndexedSeqOptimized.head$(IndexedSeqOptimized.scala:129) at scala.collection.mutable.ArrayOps$ofBoolean.head(ArrayOps.scala:294) at org.apache.comet.shims.ShimQueryPlanSerde.getFailOnError(ShimQueryPlanSerde.scala:37) at org.apache.comet.shims.ShimQueryPlanSerde.getFailOnError$(ShimQueryPlanSerde.scala:29) at org.apache.comet.serde.CometSum$.getFailOnError(aggregates.scala:184) at org.apache.comet.serde.CometSum$.convert(aggregates.scala:210) at org.apache.comet.serde.QueryPlanSerde$.aggExprToProto(QueryPlanSerde.scala:381) at org.apache.comet.serde.QueryPlanSerde$.$anonfun$operator2Proto$37(QueryPlanSerde.scala:2559) at scala.collection.immutable.List.map(List.scala:293) at org.apache.comet.serde.QueryPlanSerde$.operator2Proto(QueryPlanSerde.scala:2559) ``` Trying to figure why this happens although seems a bug?... (trying other spark versions). Will try to figure it out. Let me know! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
