surnaik commented on issue #10502:
URL:
https://github.com/apache/incubator-gluten/issues/10502#issuecomment-3209090463
**Test logs with Temurin JDK 11**
Test fails
JDK information:
```
openjdk 11.0.28 2025-07-15
OpenJDK Runtime Environment Temurin-11.0.28+6 (build 11.0.28+6)
OpenJDK 64-Bit Server VM Temurin-11.0.28+6 (build 11.0.28+6, mixed mode)
```
Failure logs:
```
/usr/lib/jvm/temurin-11-jdk-amd64/bin/java
-javaagent:/opt/idea/lib/idea_rt.jar=37835 -Dfile.encoding=UTF-8 -classpath
/root/.local/share/JetBrains/IdeaIC2025.1/Scala/lib/runners.jar:/root/incubator-gluten/backends-velox/target/scala-2.12/test-classes:/root/incubator-gluten/backends-velox/target/scala-2.12/classes:/root/incubator-gluten/gluten-substrait/target/scala-2.12/classes:/root/incubator-gluten/gluten-core/target/scala-2.12/classes:/root/incubator-gluten/gluten-ras/common/target/scala-2.12/classes:/root/incubator-gluten/shims/spark353/target/classes:/root/incubator-gluten/shims/common/target/classes:/root/incubator-gluten/gluten-ui/target/scala-2.12/classes:/root/.m2/repository/io/glutenproject/protobuf-java-util/3.23.4-0/protobuf-java-util-3.23.4-0.jar:/root/.m2/repository/com/google/errorprone/error_prone_annotations/2.5.1/error_prone_annotations-2.5.1.jar:/root/.m2/repository/com/google/j2objc/j2objc-annotations/2.8/j2objc-annotations-2.8.jar:/root/.m2/repository/com/goo
gle/code/gson/gson/2.8.9/gson-2.8.9.jar:/root/.m2/repository/io/glutenproject/protobuf-java/3.23.4-0/protobuf-java-3.23.4-0.jar:/root/incubator-gluten/gluten-substrait/target/scala-2.12/test-classes:/root/incubator-gluten/gluten-ras/common/target/scala-2.12/test-classes:/root/.m2/repository/org/apache/spark/spark-core_2.12/3.5.3/spark-core_2.12-3.5.3.jar:/root/.m2/repository/org/apache/avro/avro/1.11.2/avro-1.11.2.jar:/root/.m2/repository/org/apache/avro/avro-mapred/1.11.2/avro-mapred-1.11.2.jar:/root/.m2/repository/org/apache/avro/avro-ipc/1.11.2/avro-ipc-1.11.2.jar:/root/.m2/repository/org/tukaani/xz/1.9/xz-1.9.jar:/root/.m2/repository/com/twitter/chill_2.12/0.10.0/chill_2.12-0.10.0.jar:/root/.m2/repository/com/esotericsoftware/kryo-shaded/4.0.2/kryo-shaded-4.0.2.jar:/root/.m2/repository/com/esotericsoftware/minlog/1.3.0/minlog-1.3.0.jar:/root/.m2/repository/com/twitter/chill-java/0.10.0/chill-java-0.10.0.jar:/root/.m2/repository/org/apache/xbean/xbean-asm9-shaded/4.23/xbean-asm9-
shaded-4.23.jar:/root/.m2/repository/org/apache/spark/spark-launcher_2.12/3.5.3/spark-launcher_2.12-3.5.3.jar:/root/.m2/repository/org/apache/spark/spark-kvstore_2.12/3.5.3/spark-kvstore_2.12-3.5.3.jar:/root/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/root/.m2/repository/org/apache/spark/spark-network-common_2.12/3.5.3/spark-network-common_2.12-3.5.3.jar:/root/.m2/repository/com/google/crypto/tink/tink/1.9.0/tink-1.9.0.jar:/root/.m2/repository/org/apache/spark/spark-network-shuffle_2.12/3.5.3/spark-network-shuffle_2.12-3.5.3.jar:/root/.m2/repository/org/apache/spark/spark-unsafe_2.12/3.5.3/spark-unsafe_2.12-3.5.3.jar:/root/.m2/repository/org/apache/spark/spark-common-utils_2.12/3.5.3/spark-common-utils_2.12-3.5.3.jar:/root/.m2/repository/org/slf4j/jul-to-slf4j/2.0.7/jul-to-slf4j-2.0.7.jar:/root/.m2/repository/org/slf4j/jcl-over-slf4j/2.0.7/jcl-over-slf4j-2.0.7.jar:/root/.m2/repository/org/apache/logging/log4j/log4j-1.2-api/2.20.0/log4j-1.2-api
-2.20.0.jar:/root/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar:/root/.m2/repository/org/apache/zookeeper/zookeeper/3.6.3/zookeeper-3.6.3.jar:/root/.m2/repository/org/apache/zookeeper/zookeeper-jute/3.6.3/zookeeper-jute-3.6.3.jar:/root/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/root/.m2/repository/jakarta/servlet/jakarta.servlet-api/4.0.3/jakarta.servlet-api-4.0.3.jar:/root/.m2/repository/commons-codec/commons-codec/1.16.1/commons-codec-1.16.1.jar:/root/.m2/repository/org/apache/commons/commons-compress/1.23.0/commons-compress-1.23.0.jar:/root/.m2/repository/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar:/root/.m2/repository/org/apache/commons/commons-math3/3.6.1/commons-math3-3.6.1.jar:/root/.m2/repository/org/apache/commons/commons-text/1.10.0/commons-text-1.10.0.jar:/root/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/root/.m2/repository/org/apach
e/commons/commons-collections4/4.4/commons-collections4-4.4.jar:/root/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/root/.m2/repository/com/ning/compress-lzf/1.1.2/compress-lzf-1.1.2.jar:/root/.m2/repository/org/xerial/snappy/snappy-java/1.1.10.5/snappy-java-1.1.10.5.jar:/root/.m2/repository/org/lz4/lz4-java/1.8.0/lz4-java-1.8.0.jar:/root/.m2/repository/com/github/luben/zstd-jni/1.5.5-4/zstd-jni-1.5.5-4.jar:/root/.m2/repository/org/roaringbitmap/RoaringBitmap/0.9.45/RoaringBitmap-0.9.45.jar:/root/.m2/repository/org/roaringbitmap/shims/0.9.45/shims-0.9.45.jar:/root/.m2/repository/org/scala-lang/modules/scala-xml_2.12/2.1.0/scala-xml_2.12-2.1.0.jar:/root/.m2/repository/org/scala-lang/modules/scala-collection-compat_2.12/2.7.0/scala-collection-compat_2.12-2.7.0.jar:/root/.m2/repository/org/scala-lang/scala-reflect/2.12.18/scala-reflect-2.12.18.jar:/root/.m2/repository/org/json4s/json4s-jackson_2.12/3.7.0-M11/json4s-jackson_2.12-3.7.0-M11.jar:/root/.m2/repositor
y/org/json4s/json4s-core_2.12/3.7.0-M11/json4s-core_2.12-3.7.0-M11.jar:/root/.m2/repository/org/json4s/json4s-ast_2.12/3.7.0-M11/json4s-ast_2.12-3.7.0-M11.jar:/root/.m2/repository/org/json4s/json4s-scalap_2.12/3.7.0-M11/json4s-scalap_2.12-3.7.0-M11.jar:/root/.m2/repository/org/glassfish/jersey/core/jersey-client/2.40/jersey-client-2.40.jar:/root/.m2/repository/jakarta/ws/rs/jakarta.ws.rs-api/2.1.6/jakarta.ws.rs-api-2.1.6.jar:/root/.m2/repository/org/glassfish/hk2/external/jakarta.inject/2.6.1/jakarta.inject-2.6.1.jar:/root/.m2/repository/org/glassfish/jersey/core/jersey-common/2.40/jersey-common-2.40.jar:/root/.m2/repository/jakarta/annotation/jakarta.annotation-api/1.3.5/jakarta.annotation-api-1.3.5.jar:/root/.m2/repository/org/glassfish/hk2/osgi-resource-locator/1.0.3/osgi-resource-locator-1.0.3.jar:/root/.m2/repository/org/glassfish/jersey/core/jersey-server/2.40/jersey-server-2.40.jar:/root/.m2/repository/jakarta/validation/jakarta.validation-api/2.0.2/jakarta.validation-api-2.0
.2.jar:/root/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet/2.40/jersey-container-servlet-2.40.jar:/root/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet-core/2.40/jersey-container-servlet-core-2.40.jar:/root/.m2/repository/org/glassfish/jersey/inject/jersey-hk2/2.40/jersey-hk2-2.40.jar:/root/.m2/repository/org/glassfish/hk2/hk2-locator/2.6.1/hk2-locator-2.6.1.jar:/root/.m2/repository/org/glassfish/hk2/external/aopalliance-repackaged/2.6.1/aopalliance-repackaged-2.6.1.jar:/root/.m2/repository/org/glassfish/hk2/hk2-api/2.6.1/hk2-api-2.6.1.jar:/root/.m2/repository/org/glassfish/hk2/hk2-utils/2.6.1/hk2-utils-2.6.1.jar:/root/.m2/repository/org/javassist/javassist/3.29.2-GA/javassist-3.29.2-GA.jar:/root/.m2/repository/io/netty/netty-all/4.1.96.Final/netty-all-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-buffer/4.1.96.Final/netty-buffer-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-codec/4.1.96.Final/netty-codec-4.1.96.Final.j
ar:/root/.m2/repository/io/netty/netty-codec-http/4.1.96.Final/netty-codec-http-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-codec-http2/4.1.96.Final/netty-codec-http2-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-codec-socks/4.1.96.Final/netty-codec-socks-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-common/4.1.96.Final/netty-common-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-handler/4.1.96.Final/netty-handler-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-transport-native-unix-common/4.1.96.Final/netty-transport-native-unix-common-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-handler-proxy/4.1.96.Final/netty-handler-proxy-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-resolver/4.1.96.Final/netty-resolver-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-transport/4.1.96.Final/netty-transport-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-transport-classes-epoll/4.1.96.Final/netty-transport-classes-epoll-4.1.96.Final.jar:/r
oot/.m2/repository/io/netty/netty-transport-classes-kqueue/4.1.96.Final/netty-transport-classes-kqueue-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-transport-native-epoll/4.1.96.Final/netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar:/root/.m2/repository/io/netty/netty-transport-native-epoll/4.1.96.Final/netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar:/root/.m2/repository/io/netty/netty-transport-native-kqueue/4.1.96.Final/netty-transport-native-kqueue-4.1.96.Final-osx-aarch_64.jar:/root/.m2/repository/io/netty/netty-transport-native-kqueue/4.1.96.Final/netty-transport-native-kqueue-4.1.96.Final-osx-x86_64.jar:/root/.m2/repository/com/clearspring/analytics/stream/2.9.6/stream-2.9.6.jar:/root/.m2/repository/io/dropwizard/metrics/metrics-core/4.2.19/metrics-core-4.2.19.jar:/root/.m2/repository/io/dropwizard/metrics/metrics-jvm/4.2.19/metrics-jvm-4.2.19.jar:/root/.m2/repository/io/dropwizard/metrics/metrics-json/4.2.19/metrics-json-4.2.19.jar:/root/.m2/rep
ository/io/dropwizard/metrics/metrics-graphite/4.2.19/metrics-graphite-4.2.19.jar:/root/.m2/repository/io/dropwizard/metrics/metrics-jmx/4.2.19/metrics-jmx-4.2.19.jar:/root/.m2/repository/org/apache/ivy/ivy/2.5.1/ivy-2.5.1.jar:/root/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar:/root/.m2/repository/net/razorvine/pickle/1.3/pickle-1.3.jar:/root/.m2/repository/net/sf/py4j/py4j/0.10.9.7/py4j-0.10.9.7.jar:/root/.m2/repository/org/apache/spark/spark-tags_2.12/3.5.3/spark-tags_2.12-3.5.3.jar:/root/.m2/repository/org/apache/commons/commons-crypto/1.1.0/commons-crypto-1.1.0.jar:/root/.m2/repository/org/apache/spark/spark-catalyst_2.12/3.5.3/spark-catalyst_2.12-3.5.3.jar:/root/.m2/repository/org/apache/spark/spark-sql-api_2.12/3.5.3/spark-sql-api_2.12-3.5.3.jar:/root/.m2/repository/org/scala-lang/modules/scala-parser-combinators_2.12/2.3.0/scala-parser-combinators_2.12-2.3.0.jar:/root/.m2/repository/org/antlr/antlr4-runtime/4.9.3/antlr4-runtime-4.9.3.jar:/root/.m2/repository/org/apache/spark/sp
ark-sketch_2.12/3.5.3/spark-sketch_2.12-3.5.3.jar:/root/.m2/repository/org/codehaus/janino/janino/3.1.9/janino-3.1.9.jar:/root/.m2/repository/org/codehaus/janino/commons-compiler/3.1.9/commons-compiler-3.1.9.jar:/root/.m2/repository/com/univocity/univocity-parsers/2.9.1/univocity-parsers-2.9.1.jar:/root/.m2/repository/org/apache/datasketches/datasketches-java/3.3.0/datasketches-java-3.3.0.jar:/root/.m2/repository/org/apache/datasketches/datasketches-memory/2.1.0/datasketches-memory-2.1.0.jar:/root/.m2/repository/org/apache/spark/spark-hive_2.12/3.5.3/spark-hive_2.12-3.5.3.jar:/root/.m2/repository/org/apache/spark/spark-sql_2.12/3.5.3/spark-sql_2.12-3.5.3.jar:/root/.m2/repository/org/apache/hive/hive-common/2.3.9/hive-common-2.3.9.jar:/root/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/root/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/root/.m2/repository/jline/jline/2.12/jline-2.12.jar:/root/.m2/repository/com/tdunning/json/1.8/json-1.8.jar:/ro
ot/.m2/repository/com/github/joshelser/dropwizard-metrics-hadoop-metrics2-reporter/0.1.2/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar:/root/.m2/repository/org/apache/hive/hive-exec/2.3.9/hive-exec-2.3.9-core.jar:/root/.m2/repository/org/antlr/antlr-runtime/3.5.2/antlr-runtime-3.5.2.jar:/root/.m2/repository/org/antlr/ST4/4.0.4/ST4-4.0.4.jar:/root/.m2/repository/stax/stax-api/1.0.1/stax-api-1.0.1.jar:/root/.m2/repository/org/apache/hive/hive-metastore/2.3.9/hive-metastore-2.3.9.jar:/root/.m2/repository/javolution/javolution/5.5.1/javolution-5.5.1.jar:/root/.m2/repository/com/jolbox/bonecp/0.8.0.RELEASE/bonecp-0.8.0.RELEASE.jar:/root/.m2/repository/com/zaxxer/HikariCP/2.5.1/HikariCP-2.5.1.jar:/root/.m2/repository/org/datanucleus/datanucleus-api-jdo/4.2.4/datanucleus-api-jdo-4.2.4.jar:/root/.m2/repository/org/datanucleus/datanucleus-rdbms/4.1.19/datanucleus-rdbms-4.1.19.jar:/root/.m2/repository/commons-pool/commons-pool/1.5.4/commons-pool-1.5.4.jar:/root/.m2/repository/commons-
dbcp/commons-dbcp/1.4/commons-dbcp-1.4.jar:/root/.m2/repository/javax/jdo/jdo-api/3.0.1/jdo-api-3.0.1.jar:/root/.m2/repository/javax/transaction/jta/1.1/jta-1.1.jar:/root/.m2/repository/org/datanucleus/javax.jdo/3.2.0-m3/javax.jdo-3.2.0-m3.jar:/root/.m2/repository/javax/transaction/transaction-api/1.1/transaction-api-1.1.jar:/root/.m2/repository/org/apache/hive/hive-serde/2.3.9/hive-serde-2.3.9.jar:/root/.m2/repository/net/sf/opencsv/opencsv/2.3/opencsv-2.3.jar:/root/.m2/repository/org/apache/hive/hive-shims/2.3.9/hive-shims-2.3.9.jar:/root/.m2/repository/org/apache/hive/shims/hive-shims-common/2.3.9/hive-shims-common-2.3.9.jar:/root/.m2/repository/org/apache/hive/shims/hive-shims-0.23/2.3.9/hive-shims-0.23-2.3.9.jar:/root/.m2/repository/org/apache/hive/shims/hive-shims-scheduler/2.3.9/hive-shims-scheduler-2.3.9.jar:/root/.m2/repository/org/apache/hive/hive-llap-common/2.3.9/hive-llap-common-2.3.9.jar:/root/.m2/repository/org/apache/hive/hive-llap-client/2.3.9/hive-llap-client-2.3.9
.jar:/root/.m2/repository/org/apache/httpcomponents/httpclient/4.5.14/httpclient-4.5.14.jar:/root/.m2/repository/org/apache/httpcomponents/httpcore/4.4.16/httpcore-4.4.16.jar:/root/.m2/repository/commons-logging/commons-logging/1.2/commons-logging-1.2.jar:/root/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/root/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/root/.m2/repository/joda-time/joda-time/2.12.5/joda-time-2.12.5.jar:/root/.m2/repository/org/jodd/jodd-core/3.5.2/jodd-core-3.5.2.jar:/root/.m2/repository/org/datanucleus/datanucleus-core/4.1.17/datanucleus-core-4.1.17.jar:/root/.m2/repository/org/apache/thrift/libthrift/0.12.0/libthrift-0.12.0.jar:/root/.m2/repository/org/apache/thrift/libfb303/0.9.3/libfb303-0.9.3.jar:/root/.m2/repository/org/apache/derby/derby/10.14.2.0/derby-10.14.2.0.jar:/root/incubator-gluten/gluten-arrow/target/scala-2.12/classes:/root/.m2/repository/org/apache/arrow/a
rrow-memory-unsafe/15.0.0-gluten/arrow-memory-unsafe-15.0.0-gluten.jar:/root/.m2/repository/org/apache/arrow/arrow-compression/15.0.0-gluten/arrow-compression-15.0.0-gluten.jar:/root/.m2/repository/org/apache/arrow/arrow-memory-core/15.0.0-gluten/arrow-memory-core-15.0.0-gluten.jar:/root/.m2/repository/org/apache/arrow/arrow-vector/15.0.0-gluten/arrow-vector-15.0.0-gluten.jar:/root/.m2/repository/org/apache/arrow/arrow-format/15.0.0-gluten/arrow-format-15.0.0-gluten.jar:/root/.m2/repository/com/fasterxml/jackson/datatype/jackson-datatype-jsr310/2.15.1/jackson-datatype-jsr310-2.15.1.jar:/root/.m2/repository/com/google/flatbuffers/flatbuffers-java/23.5.26/flatbuffers-java-23.5.26.jar:/root/.m2/repository/org/eclipse/collections/eclipse-collections/11.1.0/eclipse-collections-11.1.0.jar:/root/.m2/repository/org/eclipse/collections/eclipse-collections-api/11.1.0/eclipse-collections-api-11.1.0.jar:/root/.m2/repository/org/apache/arrow/arrow-c-data/15.0.0-gluten/arrow-c-data-15.0.0-gluten.
jar:/root/.m2/repository/org/apache/arrow/arrow-dataset/15.0.0-gluten/arrow-dataset-15.0.0-gluten.jar:/root/.m2/repository/org/scalacheck/scalacheck_2.12/1.17.0/scalacheck_2.12-1.17.0.jar:/root/.m2/repository/org/scala-sbt/test-interface/1.0/test-interface-1.0.jar:/root/.m2/repository/org/scala-lang/scala-library/2.12.15/scala-library-2.12.15.jar:/root/.m2/repository/org/scalatest/scalatest_2.12/3.2.16/scalatest_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-core_2.12/3.2.16/scalatest-core_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-compatible/3.2.16/scalatest-compatible-3.2.16.jar:/root/.m2/repository/org/scalactic/scalactic_2.12/3.2.16/scalactic_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-featurespec_2.12/3.2.16/scalatest-featurespec_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-flatspec_2.12/3.2.16/scalatest-flatspec_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-freespec_2.12/3.2.16/scalatest-freespec_2
.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-funsuite_2.12/3.2.16/scalatest-funsuite_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-funspec_2.12/3.2.16/scalatest-funspec_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-propspec_2.12/3.2.16/scalatest-propspec_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-refspec_2.12/3.2.16/scalatest-refspec_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-wordspec_2.12/3.2.16/scalatest-wordspec_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-diagrams_2.12/3.2.16/scalatest-diagrams_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-matchers-core_2.12/3.2.16/scalatest-matchers-core_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-shouldmatchers_2.12/3.2.16/scalatest-shouldmatchers_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-mustmatchers_2.12/3.2.16/scalatest-mustmatchers_2.12-3.2.16.jar:/root/.m2/repository/org/mockito/mockito-core/2
.23.4/mockito-core-2.23.4.jar:/root/.m2/repository/net/bytebuddy/byte-buddy/1.9.3/byte-buddy-1.9.3.jar:/root/.m2/repository/net/bytebuddy/byte-buddy-agent/1.9.3/byte-buddy-agent-1.9.3.jar:/root/.m2/repository/org/objenesis/objenesis/2.6/objenesis-2.6.jar:/root/.m2/repository/junit/junit/4.13.1/junit-4.13.1.jar:/root/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/root/.m2/repository/org/scalatestplus/scalatestplus-mockito_2.12/1.0.0-M2/scalatestplus-mockito_2.12-1.0.0-M2.jar:/root/.m2/repository/org/scalatestplus/scalatestplus-scalacheck_2.12/3.1.0.0-RC2/scalatestplus-scalacheck_2.12-3.1.0.0-RC2.jar:/root/.m2/repository/org/apache/hadoop/hadoop-client/3.3.4/hadoop-client-3.3.4.jar:/root/.m2/repository/org/apache/hadoop/hadoop-common/3.3.4/hadoop-common-3.3.4.jar:/root/.m2/repository/org/apache/hadoop/thirdparty/hadoop-shaded-protobuf_3_7/1.1.1/hadoop-shaded-protobuf_3_7-1.1.1.jar:/root/.m2/repository/org/apache/hadoop/thirdparty/hadoop-shaded-guava/1.1.1/hadoop-
shaded-guava-1.1.1.jar:/root/.m2/repository/commons-net/commons-net/3.6/commons-net-3.6.jar:/root/.m2/repository/jakarta/activation/jakarta.activation-api/1.2.1/jakarta.activation-api-1.2.1.jar:/root/.m2/repository/org/eclipse/jetty/jetty-servlet/9.4.43.v20210629/jetty-servlet-9.4.43.v20210629.jar:/root/.m2/repository/org/eclipse/jetty/jetty-security/9.4.43.v20210629/jetty-security-9.4.43.v20210629.jar:/root/.m2/repository/org/eclipse/jetty/jetty-util-ajax/9.4.43.v20210629/jetty-util-ajax-9.4.43.v20210629.jar:/root/.m2/repository/org/eclipse/jetty/jetty-webapp/9.4.43.v20210629/jetty-webapp-9.4.43.v20210629.jar:/root/.m2/repository/org/eclipse/jetty/jetty-xml/9.4.43.v20210629/jetty-xml-9.4.43.v20210629.jar:/root/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/root/.m2/repository/com/sun/jersey/jersey-servlet/1.19/jersey-servlet-1.19.jar:/root/.m2/repository/ch/qos/reload4j/reload4j/1.2.22/reload4j-1.2.22.jar:/root/.m2/repository/commons-beanutils/commons-beanutils/1.9.4
/commons-beanutils-1.9.4.jar:/root/.m2/repository/org/apache/commons/commons-configuration2/2.1.1/commons-configuration2-2.1.1.jar:/root/.m2/repository/org/slf4j/slf4j-reload4j/1.7.36/slf4j-reload4j-1.7.36.jar:/root/.m2/repository/com/google/re2j/re2j/1.1/re2j-1.1.jar:/root/.m2/repository/org/apache/hadoop/hadoop-auth/3.3.4/hadoop-auth-3.3.4.jar:/root/.m2/repository/com/nimbusds/nimbus-jose-jwt/9.8.1/nimbus-jose-jwt-9.8.1.jar:/root/.m2/repository/com/github/stephenc/jcip/jcip-annotations/1.0-1/jcip-annotations-1.0-1.jar:/root/.m2/repository/net/minidev/json-smart/2.4.7/json-smart-2.4.7.jar:/root/.m2/repository/net/minidev/accessors-smart/2.4.7/accessors-smart-2.4.7.jar:/root/.m2/repository/org/ow2/asm/asm/9.1/asm-9.1.jar:/root/.m2/repository/org/apache/curator/curator-framework/4.2.0/curator-framework-4.2.0.jar:/root/.m2/repository/org/apache/kerby/kerb-simplekdc/1.0.1/kerb-simplekdc-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerb-client/1.0.1/kerb-client-1.0.1.jar:/root/.m2/re
pository/org/apache/kerby/kerby-config/1.0.1/kerby-config-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerb-common/1.0.1/kerb-common-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerb-crypto/1.0.1/kerb-crypto-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerb-util/1.0.1/kerb-util-1.0.1.jar:/root/.m2/repository/org/apache/kerby/token-provider/1.0.1/token-provider-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerb-admin/1.0.1/kerb-admin-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerb-server/1.0.1/kerb-server-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerb-identity/1.0.1/kerb-identity-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerby-xdr/1.0.1/kerby-xdr-1.0.1.jar:/root/.m2/repository/org/apache/curator/curator-client/4.2.0/curator-client-4.2.0.jar:/root/.m2/repository/org/apache/curator/curator-recipes/4.2.0/curator-recipes-4.2.0.jar:/root/.m2/repository/org/apache/kerby/kerb-core/1.0.1/kerb-core-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerby-pkix/1.0.1/ke
rby-pkix-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerby-asn1/1.0.1/kerby-asn1-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerby-util/1.0.1/kerby-util-1.0.1.jar:/root/.m2/repository/org/codehaus/woodstox/stax2-api/4.2.1/stax2-api-4.2.1.jar:/root/.m2/repository/com/fasterxml/woodstox/woodstox-core/5.3.0/woodstox-core-5.3.0.jar:/root/.m2/repository/dnsjava/dnsjava/2.1.7/dnsjava-2.1.7.jar:/root/.m2/repository/org/apache/hadoop/hadoop-hdfs-client/3.3.4/hadoop-hdfs-client-3.3.4.jar:/root/.m2/repository/org/apache/hadoop/hadoop-yarn-api/3.3.4/hadoop-yarn-api-3.3.4.jar:/root/.m2/repository/javax/xml/bind/jaxb-api/2.2.11/jaxb-api-2.2.11.jar:/root/.m2/repository/org/apache/hadoop/hadoop-yarn-client/3.3.4/hadoop-yarn-client-3.3.4.jar:/root/.m2/repository/org/eclipse/jetty/websocket/websocket-client/9.4.43.v20210629/websocket-client-9.4.43.v20210629.jar:/root/.m2/repository/org/eclipse/jetty/jetty-client/9.4.43.v20210629/jetty-client-9.4.43.v20210629.jar:/root/.m2/repository/org/ecli
pse/jetty/jetty-http/9.4.43.v20210629/jetty-http-9.4.43.v20210629.jar:/root/.m2/repository/org/eclipse/jetty/jetty-util/9.4.43.v20210629/jetty-util-9.4.43.v20210629.jar:/root/.m2/repository/org/eclipse/jetty/jetty-io/9.4.43.v20210629/jetty-io-9.4.43.v20210629.jar:/root/.m2/repository/org/eclipse/jetty/websocket/websocket-common/9.4.43.v20210629/websocket-common-9.4.43.v20210629.jar:/root/.m2/repository/org/eclipse/jetty/websocket/websocket-api/9.4.43.v20210629/websocket-api-9.4.43.v20210629.jar:/root/.m2/repository/org/jline/jline/3.9.0/jline-3.9.0.jar:/root/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/3.3.4/hadoop-mapreduce-client-core-3.3.4.jar:/root/.m2/repository/org/apache/hadoop/hadoop-yarn-common/3.3.4/hadoop-yarn-common-3.3.4.jar:/root/.m2/repository/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar:/root/.m2/repository/com/sun/jersey/jersey-core/1.19/jersey-core-1.19.jar:/root/.m2/repository/javax/ws/rs/jsr311-api/1.1.1/jsr311-api-1.1.1.jar:
/root/.m2/repository/com/sun/jersey/jersey-client/1.19/jersey-client-1.19.jar:/root/.m2/repository/com/fasterxml/jackson/module/jackson-module-jaxb-annotations/2.12.7/jackson-module-jaxb-annotations-2.12.7.jar:/root/.m2/repository/jakarta/xml/bind/jakarta.xml.bind-api/2.3.2/jakarta.xml.bind-api-2.3.2.jar:/root/.m2/repository/com/fasterxml/jackson/jaxrs/jackson-jaxrs-json-provider/2.12.7/jackson-jaxrs-json-provider-2.12.7.jar:/root/.m2/repository/com/fasterxml/jackson/jaxrs/jackson-jaxrs-base/2.12.7/jackson-jaxrs-base-2.12.7.jar:/root/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/3.3.4/hadoop-mapreduce-client-jobclient-3.3.4.jar:/root/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/3.3.4/hadoop-mapreduce-client-common-3.3.4.jar:/root/.m2/repository/org/apache/hadoop/hadoop-annotations/3.3.4/hadoop-annotations-3.3.4.jar:/root/.m2/repository/commons-io/commons-io/2.14.0/commons-io-2.14.0.jar:/root/.m2/repository/org/apache/spark/spark-core_2.12/3.5.
3/spark-core_2.12-3.5.3-tests.jar:/root/.m2/repository/org/apache/spark/spark-hive_2.12/3.5.3/spark-hive_2.12-3.5.3-tests.jar:/root/.m2/repository/org/apache/hadoop/hadoop-client-runtime/3.3.4/hadoop-client-runtime-3.3.4.jar:/root/.m2/repository/org/apache/hadoop/hadoop-client-api/3.3.4/hadoop-client-api-3.3.4.jar:/root/.m2/repository/org/apache/spark/spark-sql_2.12/3.5.3/spark-sql_2.12-3.5.3-tests.jar:/root/.m2/repository/org/rocksdb/rocksdbjni/8.3.2/rocksdbjni-8.3.2.jar:/root/.m2/repository/org/apache/orc/orc-core/1.9.4/orc-core-1.9.4-shaded-protobuf.jar:/root/.m2/repository/org/apache/orc/orc-shims/1.9.4/orc-shims-1.9.4.jar:/root/.m2/repository/io/airlift/aircompressor/0.27/aircompressor-0.27.jar:/root/.m2/repository/org/jetbrains/annotations/17.0.0/annotations-17.0.0.jar:/root/.m2/repository/org/threeten/threeten-extra/1.7.1/threeten-extra-1.7.1.jar:/root/.m2/repository/org/apache/orc/orc-mapreduce/1.9.4/orc-mapreduce-1.9.4-shaded-protobuf.jar:/root/.m2/repository/org/apache/hiv
e/hive-storage-api/2.8.1/hive-storage-api-2.8.1.jar:/root/.m2/repository/org/apache/parquet/parquet-column/1.13.1/parquet-column-1.13.1.jar:/root/.m2/repository/org/apache/parquet/parquet-common/1.13.1/parquet-common-1.13.1.jar:/root/.m2/repository/org/apache/parquet/parquet-encoding/1.13.1/parquet-encoding-1.13.1.jar:/root/.m2/repository/org/apache/parquet/parquet-hadoop/1.13.1/parquet-hadoop-1.13.1.jar:/root/.m2/repository/org/apache/parquet/parquet-format-structures/1.13.1/parquet-format-structures-1.13.1.jar:/root/.m2/repository/org/apache/parquet/parquet-jackson/1.13.1/parquet-jackson-1.13.1.jar:/root/.m2/repository/org/apache/spark/spark-catalyst_2.12/3.5.3/spark-catalyst_2.12-3.5.3-tests.jar:/root/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.15.1/jackson-databind-2.15.1.jar:/root/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.15.1/jackson-annotations-2.15.1.jar:/root/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.15.1/jackson-core-2.
15.1.jar:/root/.m2/repository/com/fasterxml/jackson/module/jackson-module-scala_2.12/2.15.1/jackson-module-scala_2.12-2.15.1.jar:/root/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/root/.m2/repository/com/google/jimfs/jimfs/1.3.0/jimfs-1.3.0.jar:/root/.m2/repository/com/google/guava/guava/32.1.1-jre/guava-32.1.1-jre.jar:/root/.m2/repository/com/google/guava/failureaccess/1.0.1/failureaccess-1.0.1.jar:/root/.m2/repository/com/google/guava/listenablefuture/9999.0-empty-to-avoid-conflict-with-guava/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/root/.m2/repository/org/checkerframework/checker-qual/3.33.0/checker-qual-3.33.0.jar:/root/.m2/repository/com/github/javafaker/javafaker/1.0.2/javafaker-1.0.2.jar:/root/.m2/repository/org/yaml/snakeyaml/1.23/snakeyaml-1.23-android.jar:/root/.m2/repository/com/github/mifmif/generex/1.0.2/generex-1.0.2.jar:/root/.m2/repository/dk/brics/automaton/automaton/1.11-8/automaton-1.11-8.jar:/root/.m2/repositor
y/org/slf4j/slf4j-api/2.0.7/slf4j-api-2.0.7.jar:/root/.m2/repository/org/apache/logging/log4j/log4j-slf4j2-impl/2.20.0/log4j-slf4j2-impl-2.20.0.jar:/root/.m2/repository/org/apache/logging/log4j/log4j-api/2.20.0/log4j-api-2.20.0.jar:/root/.m2/repository/org/apache/logging/log4j/log4j-core/2.20.0/log4j-core-2.20.0.jar
org.jetbrains.plugins.scala.testingSupport.scalaTest.ScalaTestRunner -s
org.apache.gluten.execution.VeloxTPCHV2Suite -testName "JDK Crash Repro"
-showProgressMessages true
Testing started at 7:42 AM ...
Using Spark's default log4j profile:
org/apache/spark/log4j2-defaults.properties
25/08/21 07:42:15 INFO SparkContext: Running Spark version 3.5.3
25/08/21 07:42:15 INFO SparkContext: OS info Linux, 6.12.27-1rodete1-amd64,
amd64
25/08/21 07:42:15 INFO SparkContext: Java version 11.0.28
25/08/21 07:42:16 WARN NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
25/08/21 07:42:16 INFO ResourceUtils:
==============================================================
25/08/21 07:42:16 INFO ResourceUtils: No custom resources configured for
spark.driver.
25/08/21 07:42:16 INFO ResourceUtils:
==============================================================
25/08/21 07:42:16 INFO SparkContext: Submitted application: test-sql-context
25/08/21 07:42:16 INFO ResourceProfile: Default ResourceProfile created,
executor resources: Map(cores -> name: cores, amount: 1, script: , vendor: ,
memory -> name: memory, amount: 1024, script: , vendor: , offHeap -> name:
offHeap, amount: 2048, script: , vendor: ), task resources: Map(cpus -> name:
cpus, amount: 1.0)
25/08/21 07:42:16 INFO ResourceProfile: Limiting resource is cpu
25/08/21 07:42:16 INFO ResourceProfileManager: Added ResourceProfile id: 0
25/08/21 07:42:16 INFO SecurityManager: Changing view acls to: root
25/08/21 07:42:16 INFO SecurityManager: Changing modify acls to: root
25/08/21 07:42:16 INFO SecurityManager: Changing view acls groups to:
25/08/21 07:42:16 INFO SecurityManager: Changing modify acls groups to:
25/08/21 07:42:16 INFO SecurityManager: SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: root; groups with view
permissions: EMPTY; users with modify permissions: root; groups with modify
permissions: EMPTY
25/08/21 07:42:16 INFO Utils: Successfully started service 'sparkDriver' on
port 44121.
25/08/21 07:42:16 INFO SparkEnv: Registering MapOutputTracker
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform
(file:/root/.m2/repository/org/apache/spark/spark-unsafe_2.12/3.5.3/spark-unsafe_2.12-3.5.3.jar)
to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal
reflective access operations
WARNING: All illegal access operations will be denied in a future release
25/08/21 07:42:16 INFO SparkEnv: Registering BlockManagerMaster
25/08/21 07:42:16 INFO BlockManagerMasterEndpoint: Using
org.apache.spark.storage.DefaultTopologyMapper for getting topology information
25/08/21 07:42:16 INFO BlockManagerMasterEndpoint:
BlockManagerMasterEndpoint up
25/08/21 07:42:16 INFO SparkEnv: Registering BlockManagerMasterHeartbeat
25/08/21 07:42:16 INFO DiskBlockManager: Created local directory at
/tmp/blockmgr-5d2cbe8b-8e03-4b2a-825c-658a8b9d52db
25/08/21 07:42:16 INFO MemoryStore: MemoryStore started with capacity 19.5
GiB
25/08/21 07:42:16 INFO SparkEnv: Registering OutputCommitCoordinator
25/08/21 07:42:16 INFO Discovery: Start discovering components in the
current classpath...
25/08/21 07:42:16 INFO Discovery: Discovered component files:
META-INF/gluten-components/org.apache.gluten.backendsapi.velox.VeloxBackend.
Duration: 160 ms.
25/08/21 07:42:16 INFO package: Components registered within order: velox
25/08/21 07:42:16 INFO GlutenDriverPlugin: Gluten build info:
==============================================================
Components: Velox
Component Velox Branch: gluten-1.3.0
Component Velox Revision: 6af292c63804fb79e8b0da6d69ca265833148e8a
Component Velox Revision Time: 2025-07-08 01:11:09 -0700
Gluten Version: 1.3.0
GCC Version: GCC: (Debian 12.2.0-14+deb12u1) 12.2.0
Java Version: 11
Scala Version: 2.12.15
Spark Version: 3.5.3
Hadoop Version: 3.3.4
Gluten Branch: v1.3.0
Gluten Revision: 646329de0411c32547947777fd4bd7875657f946
Gluten Revision Time: 2025-07-25 08:35:19 -0700
Gluten Build Time: 2025-08-21T05:38:35Z
Gluten Repo URL: sso://internal-repo/third_party/apache/incubator-gluten
==============================================================
25/08/21 07:42:16 INFO VeloxListenerApi: Memory overhead is not set. Setting
it to 644245094 automatically. Gluten doesn't follow Spark's calculation on
default value of this option because the actual required memory overhead will
depend on off-heap usage than on on-heap usage.
25/08/21 07:42:16 WARN VeloxListenerApi: Memory overhead is set to 643825664
which is smaller than the recommended size 644245094. This may cause OOM.
25/08/21 07:42:16 INFO SparkDirectoryUtil: Created local directory at
/tmp/gluten-7917b052-c4e6-4f3a-8dfd-0df4d7c3ac31
25/08/21 07:42:17 INFO JniWorkspace: Creating JNI workspace in root
directory
/tmp/gluten-7917b052-c4e6-4f3a-8dfd-0df4d7c3ac31/jni/38a25f28-f7f7-422f-aaef-911d04f447bc
25/08/21 07:42:17 INFO JniWorkspace: JNI workspace
/tmp/gluten-7917b052-c4e6-4f3a-8dfd-0df4d7c3ac31/jni/38a25f28-f7f7-422f-aaef-911d04f447bc/gluten-14171279871868968514
created in root directory
/tmp/gluten-7917b052-c4e6-4f3a-8dfd-0df4d7c3ac31/jni/38a25f28-f7f7-422f-aaef-911d04f447bc
25/08/21 07:42:17 INFO JniLibLoader: Read real path
/tmp/gluten-7917b052-c4e6-4f3a-8dfd-0df4d7c3ac31/jni/38a25f28-f7f7-422f-aaef-911d04f447bc/gluten-14171279871868968514/linux/amd64/libgluten.so
for libPath
/tmp/gluten-7917b052-c4e6-4f3a-8dfd-0df4d7c3ac31/jni/38a25f28-f7f7-422f-aaef-911d04f447bc/gluten-14171279871868968514/linux/amd64/libgluten.so
25/08/21 07:42:17 INFO JniLibLoader: Library
/tmp/gluten-7917b052-c4e6-4f3a-8dfd-0df4d7c3ac31/jni/38a25f28-f7f7-422f-aaef-911d04f447bc/gluten-14171279871868968514/linux/amd64/libgluten.so
has been loaded using path-loading method
25/08/21 07:42:17 INFO JniLibLoader: Library
/tmp/gluten-7917b052-c4e6-4f3a-8dfd-0df4d7c3ac31/jni/38a25f28-f7f7-422f-aaef-911d04f447bc/gluten-14171279871868968514/linux/amd64/libgluten.so
has been loaded
25/08/21 07:42:17 INFO JniLibLoader: Successfully loaded library
linux/amd64/libgluten.so
25/08/21 07:42:21 INFO JniLibLoader: Read real path
/tmp/gluten-7917b052-c4e6-4f3a-8dfd-0df4d7c3ac31/jni/38a25f28-f7f7-422f-aaef-911d04f447bc/gluten-14171279871868968514/linux/amd64/libvelox.so
for libPath
/tmp/gluten-7917b052-c4e6-4f3a-8dfd-0df4d7c3ac31/jni/38a25f28-f7f7-422f-aaef-911d04f447bc/gluten-14171279871868968514/linux/amd64/libvelox.so
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20250821 07:42:24.916617 138608 VeloxJniWrapper.cc:68] Loaded Velox backend.
25/08/21 07:42:24 INFO JniLibLoader: Library
/tmp/gluten-7917b052-c4e6-4f3a-8dfd-0df4d7c3ac31/jni/38a25f28-f7f7-422f-aaef-911d04f447bc/gluten-14171279871868968514/linux/amd64/libvelox.so
has been loaded using path-loading method
25/08/21 07:42:24 INFO JniLibLoader: Library
/tmp/gluten-7917b052-c4e6-4f3a-8dfd-0df4d7c3ac31/jni/38a25f28-f7f7-422f-aaef-911d04f447bc/gluten-14171279871868968514/linux/amd64/libvelox.so
has been loaded
25/08/21 07:42:24 INFO JniLibLoader: Successfully loaded library
linux/amd64/libvelox.so
I20250821 07:42:24.996636 138608 VeloxBackend.cc:97] VeloxBackend config:
[spark.hadoop.fs.s3a.use.instance.credentials, false]
[spark.hadoop.input.connect.timeout, 180000]
[spark.gluten.velox.fs.s3a.retry.mode, legacy]
[spark.memory.offHeap.enabled, true]
[spark.hadoop.fs.s3a.connection.ssl.enabled, false]
[spark.hadoop.dfs.client.log.severity, INFO]
[spark.gluten.velox.fs.s3a.connect.timeout, 200s]
[spark.gluten.sql.columnar.backend.velox.fileHandleCacheEnabled, false]
[spark.gluten.sql.columnar.backend.velox.IOThreads, 2]
[spark.gluten.sql.columnar.shuffle.codec, ]
[spark.hadoop.fs.s3a.path.style.access, true]
[spark.gluten.velox.awsSdkLogLevel, FATAL]
[spark.gluten.memory.task.offHeap.size.in.bytes, 1073741824]
[spark.gluten.sql.columnar.shuffle.codecBackend, ]
[spark.sql.decimalOperations.allowPrecisionLoss, true]
[spark.sql.orc.compression.codec, snappy]
[spark.gluten.memory.offHeap.size.in.bytes, 2147483648]
[spark.hadoop.input.read.timeout, 180000]
[spark.gluten.sql.columnar.backend.velox.memInitCapacity, 1048576]
[spark.gluten.sql.debug, true]
[spark.hadoop.fs.s3a.connection.maximum, 15]
[spark.hadoop.fs.s3a.retry.limit, 20]
[spark.gluten.memoryOverhead.size.in.bytes, 643825664]
[spark.hadoop.input.write.timeout, 180000]
I20250821 07:42:24.997723 138608 HiveConnector.cpp:61] Hive connector
test-hive created with file handle cache disabled
I20250821 07:42:25.215499 138608 VeloxBackend.cc:186] Setting global Velox
memory manager with capacity: 482869248
W20250821 07:42:25.215973 138608 MemoryArbitrator.cpp:84] Query memory
capacity[460.50MB] is set for NOOP arbitrator which has no capacity enforcement
25/08/21 07:42:25 INFO DriverPluginContainer: Initialized driver component
for plugin org.apache.gluten.GlutenPlugin.
25/08/21 07:42:25 INFO Executor: Starting executor ID driver on host
docker-host.com
25/08/21 07:42:25 INFO Executor: OS info Linux, 6.12.27-1rodete1-amd64, amd64
25/08/21 07:42:25 INFO Executor: Java version 11.0.28
25/08/21 07:42:25 INFO Executor: Starting executor with user classpath
(userClassPathFirst = false): ''
25/08/21 07:42:25 INFO Executor: Created or updated repl class loader
org.apache.spark.util.MutableURLClassLoader@7d42542 for default.
25/08/21 07:42:25 INFO VeloxListenerApi: Gluten is running with Spark local
mode. Skip running static initializer for executor.
25/08/21 07:42:25 INFO ExecutorPluginContainer: Initialized executor
component for plugin org.apache.gluten.GlutenPlugin.
25/08/21 07:42:25 INFO Utils: Successfully started service
'org.apache.spark.network.netty.NettyBlockTransferService' on port 46479.
25/08/21 07:42:25 INFO NettyBlockTransferService: Server created on
docker-host.com:46479
25/08/21 07:42:25 INFO BlockManager: Using
org.apache.spark.storage.RandomBlockReplicationPolicy for block replication
policy
25/08/21 07:42:25 INFO BlockManagerMaster: Registering BlockManager
BlockManagerId(driver, docker-host.com, 46479, None)
25/08/21 07:42:25 INFO BlockManagerMasterEndpoint: Registering block manager
docker-host.com:46479 with 19.5 GiB RAM, BlockManagerId(driver,
docker-host.com, 46479, None)
25/08/21 07:42:25 INFO BlockManagerMaster: Registered BlockManager
BlockManagerId(driver, docker-host.com, 46479, None)
25/08/21 07:42:25 INFO BlockManager: Initialized BlockManager:
BlockManagerId(driver, docker-host.com, 46479, None)
25/08/21 07:42:25 INFO SparkShimLoader: Loading Spark Shims for version:
3.5.3
25/08/21 07:42:25 INFO SparkShimLoader: Using Shim provider:
List(org.apache.gluten.sql.shims.spark353.SparkShimProvider@32ea16b7)
I20250821 07:42:30.431332 138608 VeloxJniWrapper.cc:127]
################################################## received substrait::Plan:
for validation
I20250821 07:42:30.431367 138608 VeloxJniWrapper.cc:128]
{"extensions":[{"extensionFunction":{"functionAnchor":2,"name":"not:bool"}},{"extensionFunction":{"name":"and:bool_bool"}},{"extensionFunction":{"functionAnchor":1,"name":"is_not_null:fp64"}},{"extensionFunction":{"functionAnchor":3,"name":"equal:fp64_fp64"}},{"extensionFunction":{"functionAnchor":4,"name":"gt:fp64_fp64"}}],"relations":[{"root":{"input":{"read":{"common":{"direct":{}},"baseSchema":{"names":["l_orderkey"],"struct":{"types":[{"fp64":{"nullability":"NULLABILITY_NULLABLE"}}]},"columnTypes":["NORMAL_COL"]},"filter":{"scalarFunction":{"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"scalarFunction":{"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"scalarFunction":{"functionReference":1,"outputType":{"bool":{"nullability":"NULLABILITY_REQUIRED"}},"arguments":[{"value":{"selection":{"directReference":{"structField":{}}}}}]}}},{"value":{"scalarFu
nction":{"functionReference":2,"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"scalarFunction":{"functionReference":3,"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"selection":{"directReference":{"structField":{}}}}},{"value":{"literal":{"fp64":"NaN"}}}]}}}]}}}]}}},{"value":{"scalarFunction":{"functionReference":4,"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"selection":{"directReference":{"structField":{}}}}},{"value":{"literal":{"fp64":0}}}]}}}]}},"advancedExtension":{"optimization":{"@type":"/google.protobuf.StringValue","value":"isMergeTree=0\n"}}}}}}]}
I20250821 07:42:30.471360 138608 VeloxJniWrapper.cc:127]
################################################## received substrait::Plan:
for validation
I20250821 07:42:30.471388 138608 VeloxJniWrapper.cc:128]
{"extensions":[{"extensionFunction":{"functionAnchor":2,"name":"not:bool"}},{"extensionFunction":{"name":"and:bool_bool"}},{"extensionFunction":{"functionAnchor":1,"name":"is_not_null:fp64"}},{"extensionFunction":{"functionAnchor":3,"name":"equal:fp64_fp64"}},{"extensionFunction":{"functionAnchor":4,"name":"gt:fp64_fp64"}}],"relations":[{"root":{"input":{"read":{"common":{"direct":{}},"baseSchema":{"names":["l_orderkey"],"struct":{"types":[{"fp64":{"nullability":"NULLABILITY_NULLABLE"}}]},"columnTypes":["NORMAL_COL"]},"filter":{"scalarFunction":{"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"scalarFunction":{"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"scalarFunction":{"functionReference":1,"outputType":{"bool":{"nullability":"NULLABILITY_REQUIRED"}},"arguments":[{"value":{"selection":{"directReference":{"structField":{}}}}}]}}},{"value":{"scalarFu
nction":{"functionReference":2,"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"scalarFunction":{"functionReference":3,"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"selection":{"directReference":{"structField":{}}}}},{"value":{"literal":{"fp64":"NaN"}}}]}}}]}}}]}}},{"value":{"scalarFunction":{"functionReference":4,"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"selection":{"directReference":{"structField":{}}}}},{"value":{"literal":{"fp64":0}}}]}}}]}},"advancedExtension":{"optimization":{"@type":"/google.protobuf.StringValue","value":"isMergeTree=0\n"}}}}}}]}
I20250821 07:42:30.731308 138798 VeloxRuntime.cc:74]
################################################## received substrait::Plan:
[Stage: 9 TID: 9]
{"extensions":[{"extensionFunction":{"functionAnchor":2,"name":"not:bool"}},{"extensionFunction":{"name":"and:bool_bool"}},{"extensionFunction":{"functionAnchor":1,"name":"is_not_null:fp64"}},{"extensionFunction":{"functionAnchor":3,"name":"equal:fp64_fp64"}},{"extensionFunction":{"functionAnchor":4,"name":"gt:fp64_fp64"}}],"relations":[{"root":{"input":{"read":{"common":{"direct":{}},"baseSchema":{"names":["l_orderkey"],"struct":{"types":[{"fp64":{"nullability":"NULLABILITY_NULLABLE"}}]},"columnTypes":["NORMAL_COL"]},"filter":{"scalarFunction":{"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"scalarFunction":{"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"scalarFunction":{"functionReference":1,"outputType":{"bool":{"nullability":"NULLABILITY_REQUIRED"}},"arguments":[{"value":{"selection":{"directReference":{"structField":{}}}}}]}}},{"value":{"scalarFunction":{"functionReference":2,"outputType":{"bool":{"nul
lability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"scalarFunction":{"functionReference":3,"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"selection":{"directReference":{"structField":{}}}}},{"value":{"literal":{"fp64":"NaN"}}}]}}}]}}}]}}},{"value":{"scalarFunction":{"functionReference":4,"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"selection":{"directReference":{"structField":{}}}}},{"value":{"literal":{"fp64":0}}}]}}}]}},"advancedExtension":{"optimization":{"@type":"/google.protobuf.StringValue","value":"isMergeTree=0\n"}}}},"names":["l_orderkey#128"]}}]}
I20250821 07:42:30.731662 138798 VeloxRuntime.cc:88]
################################################## received
substrait::ReadRel.LocalFiles: [Stage: 9 TID: 9]
{"items":[{"uriFile":"file:///root/incubator-gluten/test/gluten-part-9b412adb-10ab-432d-8bd1-8b9818e12c17.snappy.parquet","length":"148348","parquet":{},"schema":{},"metadataColumns":[{"key":"input_file_name","value":"file:///root/incubator-gluten/test/gluten-part-9b412adb-10ab-432d-8bd1-8b9818e12c17.snappy.parquet"},{"key":"input_file_block_length","value":"148348"},{"key":"input_file_block_start","value":"0"}],"properties":{"fileSize":"148348","modificationTime":"1753709617410"}}]}
I20250821 07:42:30.731959 138798 VeloxRuntime.cc:139] VeloxRuntime session
config:
[spark.gluten.sql.session.timeZone.default, America/Los_Angeles]
[spark.gluten.memory.task.offHeap.size.in.bytes, 1073741824]
[spark.unsafe.sorter.spill.reader.buffer.size, 1048576]
[spark.gluten.memory.backtrace.allocation, false]
[spark.gluten.ugi.username, root]
[spark.gluten.ugi.tokens, ]
[spark.gluten.sql.columnar.backend.velox.memInitCapacity, 1048576]
[spark.sql.legacy.timeParserPolicy, EXCEPTION]
[spark.sql.files.ignoreMissingFiles, false]
[spark.shuffle.spill.diskWriteBufferSize, 1048576]
[spark.sql.caseSensitive, false]
[spark.shuffle.spill.compress, true]
[spark.gluten.sql.columnarToRowMemoryThreshold, 67108864]
[spark.gluten.sql.debug, true]
I20250821 07:42:30.733016 138798 VeloxPlanConverter.cc:128] Plan Node:
-- TableScan[0][table: hive_table, remaining filter:
(and(and(isnotnull("l_orderkey"),not(equalto("l_orderkey","NaN"))),greaterthan("l_orderkey",0)))]
-> n0_0:DOUBLE
I20250821 07:42:30.735363 138798 FileSystems.cpp:193] LocalFileSystem::mkdir
/tmp/gluten-7917b052-c4e6-4f3a-8dfd-0df4d7c3ac31/gluten-spill/8a3f5611-3431-453d-b319-66aeb306e765
I20250821 07:42:30.755749 138798 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeDOUBLE
I20250821 07:42:30.755805 138798 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeBOOLEAN
I20250821 07:42:30.755817 138798 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeBOOLEAN
I20250821 07:42:30.755825 138798 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeBOOLEAN
I20250821 07:42:30.755832 138798 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeDOUBLE
I20250821 07:42:30.755841 138798 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeBOOLEAN
I20250821 07:42:30.755847 138798 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeBOOLEAN
I20250821 07:42:30.755854 138798 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeDOUBLE
I20250821 07:42:30.755861 138798 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeDOUBLE
I20250821 07:42:30.755869 138798 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeBOOLEAN
I20250821 07:42:30.755877 138798 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeDOUBLE
I20250821 07:42:30.755883 138798 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeDOUBLE
E20250821 07:42:30.757530 138798 Exceptions.h:66] Line:
/root/incubator-gluten/ep/build-velox/build/velox_ep/./velox/type/Filter.h:1360,
Function:FloatingPointRange, Expression: upperUnbounded || !std::isnan(upper_)
, Source: RUNTIME, ErrorCode: INVALID_STATE
Process finished with exit code 134 (interrupted by signal 6:SIGABRT)
terminate called after throwing an instance of
'facebook::velox::VeloxRuntimeError'
what(): Exception: VeloxRuntimeError
Error Source: RUNTIME
Error Code: INVALID_STATE
Retriable: False
Expression: upperUnbounded || !std::isnan(upper_)
Context: Operator: TableScan[0] 0
Function: FloatingPointRange
File:
/root/incubator-gluten/ep/build-velox/build/velox_ep/./velox/type/Filter.h
Line: 1360
Stack trace:
# 0 std::shared_ptr<facebook::velox::VeloxException::State const>
facebook::velox::VeloxException::State::make<facebook::velox::VeloxException::make(char
const*, unsigned long, char const*, std::basic_string_view<char,
std::char_traits<char> >, std::basic_string_view<char, std::char_traits<char>
>, std::basic_string_view<char, std::char_traits<char> >,
std::basic_string_view<char, std::char_traits<char> >, bool,
facebook::velox::VeloxException::Type, std::basic_string_view<char,
std::char_traits<char>
>)::{lambda(auto:1&)#1}>(facebook::velox::VeloxException::Type,
facebook::velox::VeloxException::make(char const*, unsigned long, char const*,
std::basic_string_view<char, std::char_traits<char> >,
std::basic_string_view<char, std::char_traits<char> >,
std::basic_string_view<char, std::char_traits<char> >,
std::basic_string_view<char, std::char_traits<char> >, bool,
facebook::velox::VeloxException::Type, std::basic_string_view<char,
std::char_traits<char> >)::{lambda(auto:1&)#1})
# 1 facebook::velox::VeloxException::VeloxException(char const*, unsigned
long, char const*, std::basic_string_view<char, std::char_traits<char> >,
std::basic_string_view<char, std::char_traits<char> >,
std::basic_string_view<char, std::char_traits<char> >,
std::basic_string_view<char, std::char_traits<char> >, bool,
facebook::velox::VeloxException::Type, std::basic_string_view<char,
std::char_traits<char> >)
# 2 facebook::velox::VeloxRuntimeError::VeloxRuntimeError(char const*,
unsigned long, char const*, std::basic_string_view<char, std::char_traits<char>
>, std::basic_string_view<char, std::char_traits<char> >,
std::basic_string_view<char, std::char_traits<char> >,
std::basic_string_view<char, std::char_traits<char> >, bool,
std::basic_string_view<char, std::char_traits<char> >)
# 3 void
facebook::velox::detail::veloxCheckFail<facebook::velox::VeloxRuntimeError,
facebook::velox::detail::CompileTimeEmptyString>(facebook::velox::detail::VeloxCheckFailArgs
const&, facebook::velox::detail::CompileTimeEmptyString)
# 4
facebook::velox::common::FloatingPointRange<double>::FloatingPointRange(double,
bool, bool, double, bool, bool, bool)
# 5 std::_MakeUniq<facebook::velox::common::FloatingPointRange<double>
>::__single_object
std::make_unique<facebook::velox::common::FloatingPointRange<double>, double,
bool, bool, double&, bool, bool, bool&>(double&&, bool&&, bool&&, double&,
bool&&, bool&&, bool&)
# 6 facebook::velox::exec::lessThanDouble(double, bool)
# 7
facebook::velox::exec::ExprToSubfieldFilterParser::makeLessThanFilter(std::shared_ptr<facebook::velox::core::ITypedExpr
const> const&, facebook::velox::core::ExpressionEvaluator*)
# 8
facebook::velox::exec::ExprToSubfieldFilterParser::makeNotEqualFilter(std::shared_ptr<facebook::velox::core::ITypedExpr
const> const&, facebook::velox::core::ExpressionEvaluator*)
# 9
gluten::SparkExprToSubfieldFilterParser::leafCallToSubfieldFilter(facebook::velox::core::CallTypedExpr
const&, facebook::velox::common::Subfield&,
facebook::velox::core::ExpressionEvaluator*, bool)
# 10
facebook::velox::connector::hive::extractFiltersFromRemainingFilter(std::shared_ptr<facebook::velox::core::ITypedExpr
const> const&, facebook::velox::core::ExpressionEvaluator*, bool,
std::unordered_map<facebook::velox::common::Subfield,
std::unique_ptr<facebook::velox::common::Filter,
std::default_delete<facebook::velox::common::Filter> >,
std::hash<facebook::velox::common::Subfield>,
std::equal_to<facebook::velox::common::Subfield>,
std::allocator<std::pair<facebook::velox::common::Subfield const,
std::unique_ptr<facebook::velox::common::Filter,
std::default_delete<facebook::velox::common::Filter> > > > >&, double&)
# 11
facebook::velox::connector::hive::extractFiltersFromRemainingFilter(std::shared_ptr<facebook::velox::core::ITypedExpr
const> const&, facebook::velox::core::ExpressionEvaluator*, bool,
std::unordered_map<facebook::velox::common::Subfield,
std::unique_ptr<facebook::velox::common::Filter,
std::default_delete<facebook::velox::common::Filter> >,
std::hash<facebook::velox::common::Subfield>,
std::equal_to<facebook::velox::common::Subfield>,
std::allocator<std::pair<facebook::velox::common::Subfield const,
std::unique_ptr<facebook::velox::common::Filter,
std::default_delete<facebook::velox::common::Filter> > > > >&, double&)
# 12
facebook::velox::connector::hive::extractFiltersFromRemainingFilter(std::shared_ptr<facebook::velox::core::ITypedExpr
const> const&, facebook::velox::core::ExpressionEvaluator*, bool,
std::unordered_map<facebook::velox::common::Subfield,
std::unique_ptr<facebook::velox::common::Filter,
std::default_delete<facebook::velox::common::Filter> >,
std::hash<facebook::velox::common::Subfield>,
std::equal_to<facebook::velox::common::Subfield>,
std::allocator<std::pair<facebook::velox::common::Subfield const,
std::unique_ptr<facebook::velox::common::Filter,
std::default_delete<facebook::velox::common::Filter> > > > >&, double&)
# 13
facebook::velox::connector::hive::extractFiltersFromRemainingFilter(std::shared_ptr<facebook::velox::core::ITypedExpr
const> const&, facebook::velox::core::ExpressionEvaluator*, bool,
std::unordered_map<facebook::velox::common::Subfield,
std::unique_ptr<facebook::velox::common::Filter,
std::default_delete<facebook::velox::common::Filter> >,
std::hash<facebook::velox::common::Subfield>,
std::equal_to<facebook::velox::common::Subfield>,
std::allocator<std::pair<facebook::velox::common::Subfield const,
std::unique_ptr<facebook::velox::common::Filter,
std::default_delete<facebook::velox::common::Filter> > > > >&, double&)
# 14
facebook::velox::connector::hive::HiveDataSource::HiveDataSource(std::shared_ptr<facebook::velox::RowType
const> const&,
std::shared_ptr<facebook::velox::connector::ConnectorTableHandle> const&,
std::unordered_map<std::__cxx11::basic_string<char, std::char_traits<char>,
std::allocator<char> >,
std::shared_ptr<facebook::velox::connector::ColumnHandle>,
std::hash<std::__cxx11::basic_string<char, std::char_traits<char>,
std::allocator<char> > >, std::equal_to<std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> > >,
std::allocator<std::pair<std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> > const,
std::shared_ptr<facebook::velox::connector::ColumnHandle> > > > const&,
facebook::velox::CachedFactory<std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> >, facebook::velox::FileHandle,
facebook::velox::FileHandleGenerator, facebook::velox::FileProperties,
facebook::velox::FileHandleSizer, std::equal_to<st
d::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >
>, std::hash<std::__cxx11::basic_string<char, std::char_traits<char>,
std::allocator<char> > > >*, folly::Executor*,
facebook::velox::connector::ConnectorQueryCtx const*,
std::shared_ptr<facebook::velox::connector::hive::HiveConfig> const&)
# 15
std::_MakeUniq<facebook::velox::connector::hive::HiveDataSource>::__single_object
std::make_unique<facebook::velox::connector::hive::HiveDataSource,
std::shared_ptr<facebook::velox::RowType const> const&,
std::shared_ptr<facebook::velox::connector::ConnectorTableHandle> const&,
std::unordered_map<std::__cxx11::basic_string<char, std::char_traits<char>,
std::allocator<char> >,
std::shared_ptr<facebook::velox::connector::ColumnHandle>,
std::hash<std::__cxx11::basic_string<char, std::char_traits<char>,
std::allocator<char> > >, std::equal_to<std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> > >,
std::allocator<std::pair<std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> > const,
std::shared_ptr<facebook::velox::connector::ColumnHandle> > > > const&,
facebook::velox::CachedFactory<std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> >, facebook::velox::FileHandle,
facebook::velox::FileHandleGenerator,
facebook::velox::FileProperties, facebook::velox::FileHandleSizer,
std::equal_to<std::__cxx11::basic_string<char, std::char_traits<char>,
std::allocator<char> > >, std::hash<std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> > > >*, folly::Executor*&,
facebook::velox::connector::ConnectorQueryCtx*&,
std::shared_ptr<facebook::velox::connector::hive::HiveConfig>
const&>(std::shared_ptr<facebook::velox::RowType const> const&,
std::shared_ptr<facebook::velox::connector::ConnectorTableHandle> const&,
std::unordered_map<std::__cxx11::basic_string<char, std::char_traits<char>,
std::allocator<char> >,
std::shared_ptr<facebook::velox::connector::ColumnHandle>,
std::hash<std::__cxx11::basic_string<char, std::char_traits<char>,
std::allocator<char> > >, std::equal_to<std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> > >,
std::allocator<std::pair<std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> > const, std::sh
ared_ptr<facebook::velox::connector::ColumnHandle> > > > con
# 16
facebook::velox::connector::hive::HiveConnector::createDataSource(std::shared_ptr<facebook::velox::RowType
const> const&,
std::shared_ptr<facebook::velox::connector::ConnectorTableHandle> const&,
std::unordered_map<std::__cxx11::basic_string<char, std::char_traits<char>,
std::allocator<char> >,
std::shared_ptr<facebook::velox::connector::ColumnHandle>,
std::hash<std::__cxx11::basic_string<char, std::char_traits<char>,
std::allocator<char> > >, std::equal_to<std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> > >,
std::allocator<std::pair<std::__cxx11::basic_string<char,
std::char_traits<char>, std::allocator<char> > const,
std::shared_ptr<facebook::velox::connector::ColumnHandle> > > > const&,
facebook::velox::connector::ConnectorQueryCtx*)
# 17 facebook::velox::exec::TableScan::getOutput()
# 18
facebook::velox::exec::Driver::runInternal(std::shared_ptr<facebook::velox::exec::Driver>&,
std::shared_ptr<facebook::velox::exec::BlockingState>&,
std::shared_ptr<facebook::velox::RowVector>&)::{lambda()#10}::operator()() const
# 19 void
facebook::velox::exec::Driver::withDeltaCpuWallTimer<facebook::velox::exec::Driver::runInternal(std::shared_ptr<facebook::velox::exec::Driver>&,
std::shared_ptr<facebook::velox::exec::BlockingState>&,
std::shared_ptr<facebook::velox::RowVector>&)::{lambda()#10}>(facebook::velox::exec::Operator*,
facebook::velox::CpuWallTiming facebook::velox::exec::OperatorStats::*,
facebook::velox::exec::Driver::runInternal(std::shared_ptr<facebook::velox::exec::Driver>&,
std::shared_ptr<facebook::velox::exec::BlockingState>&,
std::shared_ptr<facebook::velox::RowVector>&)::{lambda()#10}&&)
# 20
facebook::velox::exec::Driver::runInternal(std::shared_ptr<facebook::velox::exec::Driver>&,
std::shared_ptr<facebook::velox::exec::BlockingState>&,
std::shared_ptr<facebook::velox::RowVector>&)
# 21 facebook::velox::exec::Driver::next(folly::SemiFuture<folly::Unit>*)
# 22 facebook::velox::exec::Task::next(folly::SemiFuture<folly::Unit>*)
# 23 gluten::WholeStageResultIterator::next()
# 24 gluten::ResultIterator::getNext()
# 25 gluten::ResultIterator::hasNext()
# 26 Java_org_apache_gluten_vectorized_ColumnarBatchOutIterator_nativeHasNext
# 27 0x00007fbce460fa0f
# 28 0x00007fbce4609a0f
# 29 0x00007fbce4609a0f
# 30 0x00007fbce5422593
# 31 0x00007fbce4609a54
# 32 0x00007fbce4609a54
# 33 0x00007fbce4609a54
# 34 0x00007fbce4609a54
# 35 0x00007fbce4609a54
# 36 0x00007fbce4609a0f
# 37 0x00007fbce4609a0f
# 38 0x00007fbce4609a54
# 39 0x00007fbce4609fbf
# 40 0x00007fbce4609fbf
# 41 0x00007fbce460a0a1
# 42 0x00007fbce4609fbf
# 43 0x00007fbce4609fbf
# 44 0x00007fbce460a0a1
# 45 0x00007fbce4609fbf
# 46 0x00007fbce4609fbf
# 47 0x00007fbce4609fbf
# 48 0x00007fbce4609fbf
# 49 0x00007fbce4609fbf
# 50 0x00007fbce4609fbf
# 51 0x00007fbce4609fbf
# 52 0x00007fbce4609fbf
# 53 0x00007fbce4609fbf
# 54 0x00007fbce4609fbf
# 55 0x00007fbce460a0a1
# 56 0x00007fbce4609fbf
# 57 0x00007fbce4609fbf
# 58 0x00007fbce4609fbf
# 59 0x00007fbce460a2ab
# 60 0x00007fbce460a266
# 61 0x00007fbce460a2ab
# 62 0x00007fbce4600cc8
# 63 JavaCalls::call_helper(JavaValue*, methodHandle const&,
JavaCallArguments*, Thread*)
# 64 JavaCalls::call_virtual(JavaValue*, Klass*, Symbol*, Symbol*,
JavaCallArguments*, Thread*)
# 65 JavaCalls::call_virtual(JavaValue*, Handle, Klass*, Symbol*, Symbol*,
Thread*)
# 66 thread_entry(JavaThread*, Thread*)
# 67 JavaThread::thread_main_inner()
# 68 Thread::call_run()
# 69 thread_native_entry(Thread*)
# 70 0x0000000000094ac2
# 71 0x000000000012684f
Process finished with exit code 134 (interrupted by signal 6:SIGABRT)
```
**Test logs with OpenJDK 11**
Test passes successfully
JDK information:
```
openjdk 11.0.24 2024-07-16
OpenJDK Runtime Environment (build 11.0.24+8-post-Debian-2deb11u1)
OpenJDK 64-Bit Server VM (build 11.0.24+8-post-Debian-2deb11u1, mixed mode,
sharing)
```
Test logs:
```
/usr/lib/jvm/java-11-openjdk-amd64/bin/java
-javaagent:/opt/idea/lib/idea_rt.jar=45655 -Dfile.encoding=UTF-8 -classpath
/root/.local/share/JetBrains/IdeaIC2025.1/Scala/lib/runners.jar:/root/incubator-gluten/backends-velox/target/scala-2.12/test-classes:/root/incubator-gluten/backends-velox/target/scala-2.12/classes:/root/incubator-gluten/gluten-substrait/target/scala-2.12/classes:/root/incubator-gluten/gluten-core/target/scala-2.12/classes:/root/incubator-gluten/gluten-ras/common/target/scala-2.12/classes:/root/incubator-gluten/shims/spark353/target/classes:/root/incubator-gluten/shims/common/target/classes:/root/incubator-gluten/gluten-ui/target/scala-2.12/classes:/root/.m2/repository/io/glutenproject/protobuf-java-util/3.23.4-0/protobuf-java-util-3.23.4-0.jar:/root/.m2/repository/com/google/errorprone/error_prone_annotations/2.5.1/error_prone_annotations-2.5.1.jar:/root/.m2/repository/com/google/j2objc/j2objc-annotations/2.8/j2objc-annotations-2.8.jar:/root/.m2/repository/com/go
ogle/code/gson/gson/2.8.9/gson-2.8.9.jar:/root/.m2/repository/io/glutenproject/protobuf-java/3.23.4-0/protobuf-java-3.23.4-0.jar:/root/incubator-gluten/gluten-substrait/target/scala-2.12/test-classes:/root/incubator-gluten/gluten-ras/common/target/scala-2.12/test-classes:/root/.m2/repository/org/apache/spark/spark-core_2.12/3.5.3/spark-core_2.12-3.5.3.jar:/root/.m2/repository/org/apache/avro/avro/1.11.2/avro-1.11.2.jar:/root/.m2/repository/org/apache/avro/avro-mapred/1.11.2/avro-mapred-1.11.2.jar:/root/.m2/repository/org/apache/avro/avro-ipc/1.11.2/avro-ipc-1.11.2.jar:/root/.m2/repository/org/tukaani/xz/1.9/xz-1.9.jar:/root/.m2/repository/com/twitter/chill_2.12/0.10.0/chill_2.12-0.10.0.jar:/root/.m2/repository/com/esotericsoftware/kryo-shaded/4.0.2/kryo-shaded-4.0.2.jar:/root/.m2/repository/com/esotericsoftware/minlog/1.3.0/minlog-1.3.0.jar:/root/.m2/repository/com/twitter/chill-java/0.10.0/chill-java-0.10.0.jar:/root/.m2/repository/org/apache/xbean/xbean-asm9-shaded/4.23/xbean-asm9
-shaded-4.23.jar:/root/.m2/repository/org/apache/spark/spark-launcher_2.12/3.5.3/spark-launcher_2.12-3.5.3.jar:/root/.m2/repository/org/apache/spark/spark-kvstore_2.12/3.5.3/spark-kvstore_2.12-3.5.3.jar:/root/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/root/.m2/repository/org/apache/spark/spark-network-common_2.12/3.5.3/spark-network-common_2.12-3.5.3.jar:/root/.m2/repository/com/google/crypto/tink/tink/1.9.0/tink-1.9.0.jar:/root/.m2/repository/org/apache/spark/spark-network-shuffle_2.12/3.5.3/spark-network-shuffle_2.12-3.5.3.jar:/root/.m2/repository/org/apache/spark/spark-unsafe_2.12/3.5.3/spark-unsafe_2.12-3.5.3.jar:/root/.m2/repository/org/apache/spark/spark-common-utils_2.12/3.5.3/spark-common-utils_2.12-3.5.3.jar:/root/.m2/repository/org/slf4j/jul-to-slf4j/2.0.7/jul-to-slf4j-2.0.7.jar:/root/.m2/repository/org/slf4j/jcl-over-slf4j/2.0.7/jcl-over-slf4j-2.0.7.jar:/root/.m2/repository/org/apache/logging/log4j/log4j-1.2-api/2.20.0/log4j-1.2-ap
i-2.20.0.jar:/root/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar:/root/.m2/repository/org/apache/zookeeper/zookeeper/3.6.3/zookeeper-3.6.3.jar:/root/.m2/repository/org/apache/zookeeper/zookeeper-jute/3.6.3/zookeeper-jute-3.6.3.jar:/root/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/root/.m2/repository/jakarta/servlet/jakarta.servlet-api/4.0.3/jakarta.servlet-api-4.0.3.jar:/root/.m2/repository/commons-codec/commons-codec/1.16.1/commons-codec-1.16.1.jar:/root/.m2/repository/org/apache/commons/commons-compress/1.23.0/commons-compress-1.23.0.jar:/root/.m2/repository/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar:/root/.m2/repository/org/apache/commons/commons-math3/3.6.1/commons-math3-3.6.1.jar:/root/.m2/repository/org/apache/commons/commons-text/1.10.0/commons-text-1.10.0.jar:/root/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/root/.m2/repository/org/apac
he/commons/commons-collections4/4.4/commons-collections4-4.4.jar:/root/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/root/.m2/repository/com/ning/compress-lzf/1.1.2/compress-lzf-1.1.2.jar:/root/.m2/repository/org/xerial/snappy/snappy-java/1.1.10.5/snappy-java-1.1.10.5.jar:/root/.m2/repository/org/lz4/lz4-java/1.8.0/lz4-java-1.8.0.jar:/root/.m2/repository/com/github/luben/zstd-jni/1.5.5-4/zstd-jni-1.5.5-4.jar:/root/.m2/repository/org/roaringbitmap/RoaringBitmap/0.9.45/RoaringBitmap-0.9.45.jar:/root/.m2/repository/org/roaringbitmap/shims/0.9.45/shims-0.9.45.jar:/root/.m2/repository/org/scala-lang/modules/scala-xml_2.12/2.1.0/scala-xml_2.12-2.1.0.jar:/root/.m2/repository/org/scala-lang/modules/scala-collection-compat_2.12/2.7.0/scala-collection-compat_2.12-2.7.0.jar:/root/.m2/repository/org/scala-lang/scala-reflect/2.12.18/scala-reflect-2.12.18.jar:/root/.m2/repository/org/json4s/json4s-jackson_2.12/3.7.0-M11/json4s-jackson_2.12-3.7.0-M11.jar:/root/.m2/reposito
ry/org/json4s/json4s-core_2.12/3.7.0-M11/json4s-core_2.12-3.7.0-M11.jar:/root/.m2/repository/org/json4s/json4s-ast_2.12/3.7.0-M11/json4s-ast_2.12-3.7.0-M11.jar:/root/.m2/repository/org/json4s/json4s-scalap_2.12/3.7.0-M11/json4s-scalap_2.12-3.7.0-M11.jar:/root/.m2/repository/org/glassfish/jersey/core/jersey-client/2.40/jersey-client-2.40.jar:/root/.m2/repository/jakarta/ws/rs/jakarta.ws.rs-api/2.1.6/jakarta.ws.rs-api-2.1.6.jar:/root/.m2/repository/org/glassfish/hk2/external/jakarta.inject/2.6.1/jakarta.inject-2.6.1.jar:/root/.m2/repository/org/glassfish/jersey/core/jersey-common/2.40/jersey-common-2.40.jar:/root/.m2/repository/jakarta/annotation/jakarta.annotation-api/1.3.5/jakarta.annotation-api-1.3.5.jar:/root/.m2/repository/org/glassfish/hk2/osgi-resource-locator/1.0.3/osgi-resource-locator-1.0.3.jar:/root/.m2/repository/org/glassfish/jersey/core/jersey-server/2.40/jersey-server-2.40.jar:/root/.m2/repository/jakarta/validation/jakarta.validation-api/2.0.2/jakarta.validation-api-2.
0.2.jar:/root/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet/2.40/jersey-container-servlet-2.40.jar:/root/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet-core/2.40/jersey-container-servlet-core-2.40.jar:/root/.m2/repository/org/glassfish/jersey/inject/jersey-hk2/2.40/jersey-hk2-2.40.jar:/root/.m2/repository/org/glassfish/hk2/hk2-locator/2.6.1/hk2-locator-2.6.1.jar:/root/.m2/repository/org/glassfish/hk2/external/aopalliance-repackaged/2.6.1/aopalliance-repackaged-2.6.1.jar:/root/.m2/repository/org/glassfish/hk2/hk2-api/2.6.1/hk2-api-2.6.1.jar:/root/.m2/repository/org/glassfish/hk2/hk2-utils/2.6.1/hk2-utils-2.6.1.jar:/root/.m2/repository/org/javassist/javassist/3.29.2-GA/javassist-3.29.2-GA.jar:/root/.m2/repository/io/netty/netty-all/4.1.96.Final/netty-all-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-buffer/4.1.96.Final/netty-buffer-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-codec/4.1.96.Final/netty-codec-4.1.96.Final.
jar:/root/.m2/repository/io/netty/netty-codec-http/4.1.96.Final/netty-codec-http-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-codec-http2/4.1.96.Final/netty-codec-http2-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-codec-socks/4.1.96.Final/netty-codec-socks-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-common/4.1.96.Final/netty-common-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-handler/4.1.96.Final/netty-handler-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-transport-native-unix-common/4.1.96.Final/netty-transport-native-unix-common-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-handler-proxy/4.1.96.Final/netty-handler-proxy-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-resolver/4.1.96.Final/netty-resolver-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-transport/4.1.96.Final/netty-transport-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-transport-classes-epoll/4.1.96.Final/netty-transport-classes-epoll-4.1.96.Final.jar:/
root/.m2/repository/io/netty/netty-transport-classes-kqueue/4.1.96.Final/netty-transport-classes-kqueue-4.1.96.Final.jar:/root/.m2/repository/io/netty/netty-transport-native-epoll/4.1.96.Final/netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar:/root/.m2/repository/io/netty/netty-transport-native-epoll/4.1.96.Final/netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar:/root/.m2/repository/io/netty/netty-transport-native-kqueue/4.1.96.Final/netty-transport-native-kqueue-4.1.96.Final-osx-aarch_64.jar:/root/.m2/repository/io/netty/netty-transport-native-kqueue/4.1.96.Final/netty-transport-native-kqueue-4.1.96.Final-osx-x86_64.jar:/root/.m2/repository/com/clearspring/analytics/stream/2.9.6/stream-2.9.6.jar:/root/.m2/repository/io/dropwizard/metrics/metrics-core/4.2.19/metrics-core-4.2.19.jar:/root/.m2/repository/io/dropwizard/metrics/metrics-jvm/4.2.19/metrics-jvm-4.2.19.jar:/root/.m2/repository/io/dropwizard/metrics/metrics-json/4.2.19/metrics-json-4.2.19.jar:/root/.m2/re
pository/io/dropwizard/metrics/metrics-graphite/4.2.19/metrics-graphite-4.2.19.jar:/root/.m2/repository/io/dropwizard/metrics/metrics-jmx/4.2.19/metrics-jmx-4.2.19.jar:/root/.m2/repository/org/apache/ivy/ivy/2.5.1/ivy-2.5.1.jar:/root/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar:/root/.m2/repository/net/razorvine/pickle/1.3/pickle-1.3.jar:/root/.m2/repository/net/sf/py4j/py4j/0.10.9.7/py4j-0.10.9.7.jar:/root/.m2/repository/org/apache/spark/spark-tags_2.12/3.5.3/spark-tags_2.12-3.5.3.jar:/root/.m2/repository/org/apache/commons/commons-crypto/1.1.0/commons-crypto-1.1.0.jar:/root/.m2/repository/org/apache/spark/spark-catalyst_2.12/3.5.3/spark-catalyst_2.12-3.5.3.jar:/root/.m2/repository/org/apache/spark/spark-sql-api_2.12/3.5.3/spark-sql-api_2.12-3.5.3.jar:/root/.m2/repository/org/scala-lang/modules/scala-parser-combinators_2.12/2.3.0/scala-parser-combinators_2.12-2.3.0.jar:/root/.m2/repository/org/antlr/antlr4-runtime/4.9.3/antlr4-runtime-4.9.3.jar:/root/.m2/repository/org/apache/spark/s
park-sketch_2.12/3.5.3/spark-sketch_2.12-3.5.3.jar:/root/.m2/repository/org/codehaus/janino/janino/3.1.9/janino-3.1.9.jar:/root/.m2/repository/org/codehaus/janino/commons-compiler/3.1.9/commons-compiler-3.1.9.jar:/root/.m2/repository/com/univocity/univocity-parsers/2.9.1/univocity-parsers-2.9.1.jar:/root/.m2/repository/org/apache/datasketches/datasketches-java/3.3.0/datasketches-java-3.3.0.jar:/root/.m2/repository/org/apache/datasketches/datasketches-memory/2.1.0/datasketches-memory-2.1.0.jar:/root/.m2/repository/org/apache/spark/spark-hive_2.12/3.5.3/spark-hive_2.12-3.5.3.jar:/root/.m2/repository/org/apache/spark/spark-sql_2.12/3.5.3/spark-sql_2.12-3.5.3.jar:/root/.m2/repository/org/apache/hive/hive-common/2.3.9/hive-common-2.3.9.jar:/root/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/root/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/root/.m2/repository/jline/jline/2.12/jline-2.12.jar:/root/.m2/repository/com/tdunning/json/1.8/json-1.8.jar:/r
oot/.m2/repository/com/github/joshelser/dropwizard-metrics-hadoop-metrics2-reporter/0.1.2/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar:/root/.m2/repository/org/apache/hive/hive-exec/2.3.9/hive-exec-2.3.9-core.jar:/root/.m2/repository/org/antlr/antlr-runtime/3.5.2/antlr-runtime-3.5.2.jar:/root/.m2/repository/org/antlr/ST4/4.0.4/ST4-4.0.4.jar:/root/.m2/repository/stax/stax-api/1.0.1/stax-api-1.0.1.jar:/root/.m2/repository/org/apache/hive/hive-metastore/2.3.9/hive-metastore-2.3.9.jar:/root/.m2/repository/javolution/javolution/5.5.1/javolution-5.5.1.jar:/root/.m2/repository/com/jolbox/bonecp/0.8.0.RELEASE/bonecp-0.8.0.RELEASE.jar:/root/.m2/repository/com/zaxxer/HikariCP/2.5.1/HikariCP-2.5.1.jar:/root/.m2/repository/org/datanucleus/datanucleus-api-jdo/4.2.4/datanucleus-api-jdo-4.2.4.jar:/root/.m2/repository/org/datanucleus/datanucleus-rdbms/4.1.19/datanucleus-rdbms-4.1.19.jar:/root/.m2/repository/commons-pool/commons-pool/1.5.4/commons-pool-1.5.4.jar:/root/.m2/repository/commons
-dbcp/commons-dbcp/1.4/commons-dbcp-1.4.jar:/root/.m2/repository/javax/jdo/jdo-api/3.0.1/jdo-api-3.0.1.jar:/root/.m2/repository/javax/transaction/jta/1.1/jta-1.1.jar:/root/.m2/repository/org/datanucleus/javax.jdo/3.2.0-m3/javax.jdo-3.2.0-m3.jar:/root/.m2/repository/javax/transaction/transaction-api/1.1/transaction-api-1.1.jar:/root/.m2/repository/org/apache/hive/hive-serde/2.3.9/hive-serde-2.3.9.jar:/root/.m2/repository/net/sf/opencsv/opencsv/2.3/opencsv-2.3.jar:/root/.m2/repository/org/apache/hive/hive-shims/2.3.9/hive-shims-2.3.9.jar:/root/.m2/repository/org/apache/hive/shims/hive-shims-common/2.3.9/hive-shims-common-2.3.9.jar:/root/.m2/repository/org/apache/hive/shims/hive-shims-0.23/2.3.9/hive-shims-0.23-2.3.9.jar:/root/.m2/repository/org/apache/hive/shims/hive-shims-scheduler/2.3.9/hive-shims-scheduler-2.3.9.jar:/root/.m2/repository/org/apache/hive/hive-llap-common/2.3.9/hive-llap-common-2.3.9.jar:/root/.m2/repository/org/apache/hive/hive-llap-client/2.3.9/hive-llap-client-2.3.
9.jar:/root/.m2/repository/org/apache/httpcomponents/httpclient/4.5.14/httpclient-4.5.14.jar:/root/.m2/repository/org/apache/httpcomponents/httpcore/4.4.16/httpcore-4.4.16.jar:/root/.m2/repository/commons-logging/commons-logging/1.2/commons-logging-1.2.jar:/root/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/root/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/root/.m2/repository/joda-time/joda-time/2.12.5/joda-time-2.12.5.jar:/root/.m2/repository/org/jodd/jodd-core/3.5.2/jodd-core-3.5.2.jar:/root/.m2/repository/org/datanucleus/datanucleus-core/4.1.17/datanucleus-core-4.1.17.jar:/root/.m2/repository/org/apache/thrift/libthrift/0.12.0/libthrift-0.12.0.jar:/root/.m2/repository/org/apache/thrift/libfb303/0.9.3/libfb303-0.9.3.jar:/root/.m2/repository/org/apache/derby/derby/10.14.2.0/derby-10.14.2.0.jar:/root/incubator-gluten/gluten-arrow/target/scala-2.12/classes:/root/.m2/repository/org/apache/arrow/
arrow-memory-unsafe/15.0.0-gluten/arrow-memory-unsafe-15.0.0-gluten.jar:/root/.m2/repository/org/apache/arrow/arrow-compression/15.0.0-gluten/arrow-compression-15.0.0-gluten.jar:/root/.m2/repository/org/apache/arrow/arrow-memory-core/15.0.0-gluten/arrow-memory-core-15.0.0-gluten.jar:/root/.m2/repository/org/apache/arrow/arrow-vector/15.0.0-gluten/arrow-vector-15.0.0-gluten.jar:/root/.m2/repository/org/apache/arrow/arrow-format/15.0.0-gluten/arrow-format-15.0.0-gluten.jar:/root/.m2/repository/com/fasterxml/jackson/datatype/jackson-datatype-jsr310/2.15.1/jackson-datatype-jsr310-2.15.1.jar:/root/.m2/repository/com/google/flatbuffers/flatbuffers-java/23.5.26/flatbuffers-java-23.5.26.jar:/root/.m2/repository/org/eclipse/collections/eclipse-collections/11.1.0/eclipse-collections-11.1.0.jar:/root/.m2/repository/org/eclipse/collections/eclipse-collections-api/11.1.0/eclipse-collections-api-11.1.0.jar:/root/.m2/repository/org/apache/arrow/arrow-c-data/15.0.0-gluten/arrow-c-data-15.0.0-gluten
.jar:/root/.m2/repository/org/apache/arrow/arrow-dataset/15.0.0-gluten/arrow-dataset-15.0.0-gluten.jar:/root/.m2/repository/org/scalacheck/scalacheck_2.12/1.17.0/scalacheck_2.12-1.17.0.jar:/root/.m2/repository/org/scala-sbt/test-interface/1.0/test-interface-1.0.jar:/root/.m2/repository/org/scala-lang/scala-library/2.12.15/scala-library-2.12.15.jar:/root/.m2/repository/org/scalatest/scalatest_2.12/3.2.16/scalatest_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-core_2.12/3.2.16/scalatest-core_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-compatible/3.2.16/scalatest-compatible-3.2.16.jar:/root/.m2/repository/org/scalactic/scalactic_2.12/3.2.16/scalactic_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-featurespec_2.12/3.2.16/scalatest-featurespec_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-flatspec_2.12/3.2.16/scalatest-flatspec_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-freespec_2.12/3.2.16/scalatest-freespec_
2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-funsuite_2.12/3.2.16/scalatest-funsuite_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-funspec_2.12/3.2.16/scalatest-funspec_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-propspec_2.12/3.2.16/scalatest-propspec_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-refspec_2.12/3.2.16/scalatest-refspec_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-wordspec_2.12/3.2.16/scalatest-wordspec_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-diagrams_2.12/3.2.16/scalatest-diagrams_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-matchers-core_2.12/3.2.16/scalatest-matchers-core_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-shouldmatchers_2.12/3.2.16/scalatest-shouldmatchers_2.12-3.2.16.jar:/root/.m2/repository/org/scalatest/scalatest-mustmatchers_2.12/3.2.16/scalatest-mustmatchers_2.12-3.2.16.jar:/root/.m2/repository/org/mockito/mockito-core/
2.23.4/mockito-core-2.23.4.jar:/root/.m2/repository/net/bytebuddy/byte-buddy/1.9.3/byte-buddy-1.9.3.jar:/root/.m2/repository/net/bytebuddy/byte-buddy-agent/1.9.3/byte-buddy-agent-1.9.3.jar:/root/.m2/repository/org/objenesis/objenesis/2.6/objenesis-2.6.jar:/root/.m2/repository/junit/junit/4.13.1/junit-4.13.1.jar:/root/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar:/root/.m2/repository/org/scalatestplus/scalatestplus-mockito_2.12/1.0.0-M2/scalatestplus-mockito_2.12-1.0.0-M2.jar:/root/.m2/repository/org/scalatestplus/scalatestplus-scalacheck_2.12/3.1.0.0-RC2/scalatestplus-scalacheck_2.12-3.1.0.0-RC2.jar:/root/.m2/repository/org/apache/hadoop/hadoop-client/3.3.4/hadoop-client-3.3.4.jar:/root/.m2/repository/org/apache/hadoop/hadoop-common/3.3.4/hadoop-common-3.3.4.jar:/root/.m2/repository/org/apache/hadoop/thirdparty/hadoop-shaded-protobuf_3_7/1.1.1/hadoop-shaded-protobuf_3_7-1.1.1.jar:/root/.m2/repository/org/apache/hadoop/thirdparty/hadoop-shaded-guava/1.1.1/hadoop
-shaded-guava-1.1.1.jar:/root/.m2/repository/commons-net/commons-net/3.6/commons-net-3.6.jar:/root/.m2/repository/jakarta/activation/jakarta.activation-api/1.2.1/jakarta.activation-api-1.2.1.jar:/root/.m2/repository/org/eclipse/jetty/jetty-servlet/9.4.43.v20210629/jetty-servlet-9.4.43.v20210629.jar:/root/.m2/repository/org/eclipse/jetty/jetty-security/9.4.43.v20210629/jetty-security-9.4.43.v20210629.jar:/root/.m2/repository/org/eclipse/jetty/jetty-util-ajax/9.4.43.v20210629/jetty-util-ajax-9.4.43.v20210629.jar:/root/.m2/repository/org/eclipse/jetty/jetty-webapp/9.4.43.v20210629/jetty-webapp-9.4.43.v20210629.jar:/root/.m2/repository/org/eclipse/jetty/jetty-xml/9.4.43.v20210629/jetty-xml-9.4.43.v20210629.jar:/root/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/root/.m2/repository/com/sun/jersey/jersey-servlet/1.19/jersey-servlet-1.19.jar:/root/.m2/repository/ch/qos/reload4j/reload4j/1.2.22/reload4j-1.2.22.jar:/root/.m2/repository/commons-beanutils/commons-beanutils/1.9.
4/commons-beanutils-1.9.4.jar:/root/.m2/repository/org/apache/commons/commons-configuration2/2.1.1/commons-configuration2-2.1.1.jar:/root/.m2/repository/org/slf4j/slf4j-reload4j/1.7.36/slf4j-reload4j-1.7.36.jar:/root/.m2/repository/com/google/re2j/re2j/1.1/re2j-1.1.jar:/root/.m2/repository/org/apache/hadoop/hadoop-auth/3.3.4/hadoop-auth-3.3.4.jar:/root/.m2/repository/com/nimbusds/nimbus-jose-jwt/9.8.1/nimbus-jose-jwt-9.8.1.jar:/root/.m2/repository/com/github/stephenc/jcip/jcip-annotations/1.0-1/jcip-annotations-1.0-1.jar:/root/.m2/repository/net/minidev/json-smart/2.4.7/json-smart-2.4.7.jar:/root/.m2/repository/net/minidev/accessors-smart/2.4.7/accessors-smart-2.4.7.jar:/root/.m2/repository/org/ow2/asm/asm/9.1/asm-9.1.jar:/root/.m2/repository/org/apache/curator/curator-framework/4.2.0/curator-framework-4.2.0.jar:/root/.m2/repository/org/apache/kerby/kerb-simplekdc/1.0.1/kerb-simplekdc-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerb-client/1.0.1/kerb-client-1.0.1.jar:/root/.m2/r
epository/org/apache/kerby/kerby-config/1.0.1/kerby-config-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerb-common/1.0.1/kerb-common-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerb-crypto/1.0.1/kerb-crypto-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerb-util/1.0.1/kerb-util-1.0.1.jar:/root/.m2/repository/org/apache/kerby/token-provider/1.0.1/token-provider-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerb-admin/1.0.1/kerb-admin-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerb-server/1.0.1/kerb-server-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerb-identity/1.0.1/kerb-identity-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerby-xdr/1.0.1/kerby-xdr-1.0.1.jar:/root/.m2/repository/org/apache/curator/curator-client/4.2.0/curator-client-4.2.0.jar:/root/.m2/repository/org/apache/curator/curator-recipes/4.2.0/curator-recipes-4.2.0.jar:/root/.m2/repository/org/apache/kerby/kerb-core/1.0.1/kerb-core-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerby-pkix/1.0.1/k
erby-pkix-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerby-asn1/1.0.1/kerby-asn1-1.0.1.jar:/root/.m2/repository/org/apache/kerby/kerby-util/1.0.1/kerby-util-1.0.1.jar:/root/.m2/repository/org/codehaus/woodstox/stax2-api/4.2.1/stax2-api-4.2.1.jar:/root/.m2/repository/com/fasterxml/woodstox/woodstox-core/5.3.0/woodstox-core-5.3.0.jar:/root/.m2/repository/dnsjava/dnsjava/2.1.7/dnsjava-2.1.7.jar:/root/.m2/repository/org/apache/hadoop/hadoop-hdfs-client/3.3.4/hadoop-hdfs-client-3.3.4.jar:/root/.m2/repository/org/apache/hadoop/hadoop-yarn-api/3.3.4/hadoop-yarn-api-3.3.4.jar:/root/.m2/repository/javax/xml/bind/jaxb-api/2.2.11/jaxb-api-2.2.11.jar:/root/.m2/repository/org/apache/hadoop/hadoop-yarn-client/3.3.4/hadoop-yarn-client-3.3.4.jar:/root/.m2/repository/org/eclipse/jetty/websocket/websocket-client/9.4.43.v20210629/websocket-client-9.4.43.v20210629.jar:/root/.m2/repository/org/eclipse/jetty/jetty-client/9.4.43.v20210629/jetty-client-9.4.43.v20210629.jar:/root/.m2/repository/org/ecl
ipse/jetty/jetty-http/9.4.43.v20210629/jetty-http-9.4.43.v20210629.jar:/root/.m2/repository/org/eclipse/jetty/jetty-util/9.4.43.v20210629/jetty-util-9.4.43.v20210629.jar:/root/.m2/repository/org/eclipse/jetty/jetty-io/9.4.43.v20210629/jetty-io-9.4.43.v20210629.jar:/root/.m2/repository/org/eclipse/jetty/websocket/websocket-common/9.4.43.v20210629/websocket-common-9.4.43.v20210629.jar:/root/.m2/repository/org/eclipse/jetty/websocket/websocket-api/9.4.43.v20210629/websocket-api-9.4.43.v20210629.jar:/root/.m2/repository/org/jline/jline/3.9.0/jline-3.9.0.jar:/root/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/3.3.4/hadoop-mapreduce-client-core-3.3.4.jar:/root/.m2/repository/org/apache/hadoop/hadoop-yarn-common/3.3.4/hadoop-yarn-common-3.3.4.jar:/root/.m2/repository/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar:/root/.m2/repository/com/sun/jersey/jersey-core/1.19/jersey-core-1.19.jar:/root/.m2/repository/javax/ws/rs/jsr311-api/1.1.1/jsr311-api-1.1.1.jar
:/root/.m2/repository/com/sun/jersey/jersey-client/1.19/jersey-client-1.19.jar:/root/.m2/repository/com/fasterxml/jackson/module/jackson-module-jaxb-annotations/2.12.7/jackson-module-jaxb-annotations-2.12.7.jar:/root/.m2/repository/jakarta/xml/bind/jakarta.xml.bind-api/2.3.2/jakarta.xml.bind-api-2.3.2.jar:/root/.m2/repository/com/fasterxml/jackson/jaxrs/jackson-jaxrs-json-provider/2.12.7/jackson-jaxrs-json-provider-2.12.7.jar:/root/.m2/repository/com/fasterxml/jackson/jaxrs/jackson-jaxrs-base/2.12.7/jackson-jaxrs-base-2.12.7.jar:/root/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/3.3.4/hadoop-mapreduce-client-jobclient-3.3.4.jar:/root/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/3.3.4/hadoop-mapreduce-client-common-3.3.4.jar:/root/.m2/repository/org/apache/hadoop/hadoop-annotations/3.3.4/hadoop-annotations-3.3.4.jar:/root/.m2/repository/commons-io/commons-io/2.14.0/commons-io-2.14.0.jar:/root/.m2/repository/org/apache/spark/spark-core_2.12/3.5
.3/spark-core_2.12-3.5.3-tests.jar:/root/.m2/repository/org/apache/spark/spark-hive_2.12/3.5.3/spark-hive_2.12-3.5.3-tests.jar:/root/.m2/repository/org/apache/hadoop/hadoop-client-runtime/3.3.4/hadoop-client-runtime-3.3.4.jar:/root/.m2/repository/org/apache/hadoop/hadoop-client-api/3.3.4/hadoop-client-api-3.3.4.jar:/root/.m2/repository/org/apache/spark/spark-sql_2.12/3.5.3/spark-sql_2.12-3.5.3-tests.jar:/root/.m2/repository/org/rocksdb/rocksdbjni/8.3.2/rocksdbjni-8.3.2.jar:/root/.m2/repository/org/apache/orc/orc-core/1.9.4/orc-core-1.9.4-shaded-protobuf.jar:/root/.m2/repository/org/apache/orc/orc-shims/1.9.4/orc-shims-1.9.4.jar:/root/.m2/repository/io/airlift/aircompressor/0.27/aircompressor-0.27.jar:/root/.m2/repository/org/jetbrains/annotations/17.0.0/annotations-17.0.0.jar:/root/.m2/repository/org/threeten/threeten-extra/1.7.1/threeten-extra-1.7.1.jar:/root/.m2/repository/org/apache/orc/orc-mapreduce/1.9.4/orc-mapreduce-1.9.4-shaded-protobuf.jar:/root/.m2/repository/org/apache/hi
ve/hive-storage-api/2.8.1/hive-storage-api-2.8.1.jar:/root/.m2/repository/org/apache/parquet/parquet-column/1.13.1/parquet-column-1.13.1.jar:/root/.m2/repository/org/apache/parquet/parquet-common/1.13.1/parquet-common-1.13.1.jar:/root/.m2/repository/org/apache/parquet/parquet-encoding/1.13.1/parquet-encoding-1.13.1.jar:/root/.m2/repository/org/apache/parquet/parquet-hadoop/1.13.1/parquet-hadoop-1.13.1.jar:/root/.m2/repository/org/apache/parquet/parquet-format-structures/1.13.1/parquet-format-structures-1.13.1.jar:/root/.m2/repository/org/apache/parquet/parquet-jackson/1.13.1/parquet-jackson-1.13.1.jar:/root/.m2/repository/org/apache/spark/spark-catalyst_2.12/3.5.3/spark-catalyst_2.12-3.5.3-tests.jar:/root/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.15.1/jackson-databind-2.15.1.jar:/root/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.15.1/jackson-annotations-2.15.1.jar:/root/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.15.1/jackson-core-2
.15.1.jar:/root/.m2/repository/com/fasterxml/jackson/module/jackson-module-scala_2.12/2.15.1/jackson-module-scala_2.12-2.15.1.jar:/root/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/root/.m2/repository/com/google/jimfs/jimfs/1.3.0/jimfs-1.3.0.jar:/root/.m2/repository/com/google/guava/guava/32.1.1-jre/guava-32.1.1-jre.jar:/root/.m2/repository/com/google/guava/failureaccess/1.0.1/failureaccess-1.0.1.jar:/root/.m2/repository/com/google/guava/listenablefuture/9999.0-empty-to-avoid-conflict-with-guava/listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar:/root/.m2/repository/org/checkerframework/checker-qual/3.33.0/checker-qual-3.33.0.jar:/root/.m2/repository/com/github/javafaker/javafaker/1.0.2/javafaker-1.0.2.jar:/root/.m2/repository/org/yaml/snakeyaml/1.23/snakeyaml-1.23-android.jar:/root/.m2/repository/com/github/mifmif/generex/1.0.2/generex-1.0.2.jar:/root/.m2/repository/dk/brics/automaton/automaton/1.11-8/automaton-1.11-8.jar:/root/.m2/reposito
ry/org/slf4j/slf4j-api/2.0.7/slf4j-api-2.0.7.jar:/root/.m2/repository/org/apache/logging/log4j/log4j-slf4j2-impl/2.20.0/log4j-slf4j2-impl-2.20.0.jar:/root/.m2/repository/org/apache/logging/log4j/log4j-api/2.20.0/log4j-api-2.20.0.jar:/root/.m2/repository/org/apache/logging/log4j/log4j-core/2.20.0/log4j-core-2.20.0.jar
org.jetbrains.plugins.scala.testingSupport.scalaTest.ScalaTestRunner -s
org.apache.gluten.execution.VeloxTPCHV2Suite -testName "JDK Crash Repro"
-showProgressMessages true
Testing started at 7:41 AM ...
Using Spark's default log4j profile:
org/apache/spark/log4j2-defaults.properties
25/08/21 07:41:04 INFO SparkContext: Running Spark version 3.5.3
25/08/21 07:41:04 INFO SparkContext: OS info Linux, 6.12.27-1rodete1-amd64,
amd64
25/08/21 07:41:04 INFO SparkContext: Java version 11.0.24
25/08/21 07:41:04 WARN NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
25/08/21 07:41:04 INFO ResourceUtils:
==============================================================
25/08/21 07:41:04 INFO ResourceUtils: No custom resources configured for
spark.driver.
25/08/21 07:41:04 INFO ResourceUtils:
==============================================================
25/08/21 07:41:04 INFO SparkContext: Submitted application: test-sql-context
25/08/21 07:41:04 INFO ResourceProfile: Default ResourceProfile created,
executor resources: Map(cores -> name: cores, amount: 1, script: , vendor: ,
memory -> name: memory, amount: 1024, script: , vendor: , offHeap -> name:
offHeap, amount: 2048, script: , vendor: ), task resources: Map(cpus -> name:
cpus, amount: 1.0)
25/08/21 07:41:04 INFO ResourceProfile: Limiting resource is cpu
25/08/21 07:41:04 INFO ResourceProfileManager: Added ResourceProfile id: 0
25/08/21 07:41:04 INFO SecurityManager: Changing view acls to: root
25/08/21 07:41:04 INFO SecurityManager: Changing modify acls to: root
25/08/21 07:41:04 INFO SecurityManager: Changing view acls groups to:
25/08/21 07:41:04 INFO SecurityManager: Changing modify acls groups to:
25/08/21 07:41:04 INFO SecurityManager: SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: root; groups with view
permissions: EMPTY; users with modify permissions: root; groups with modify
permissions: EMPTY
25/08/21 07:41:05 INFO Utils: Successfully started service 'sparkDriver' on
port 42491.
25/08/21 07:41:05 INFO SparkEnv: Registering MapOutputTracker
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform
(file:/root/.m2/repository/org/apache/spark/spark-unsafe_2.12/3.5.3/spark-unsafe_2.12-3.5.3.jar)
to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of
org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal
reflective access operations
WARNING: All illegal access operations will be denied in a future release
25/08/21 07:41:05 INFO SparkEnv: Registering BlockManagerMaster
25/08/21 07:41:05 INFO BlockManagerMasterEndpoint: Using
org.apache.spark.storage.DefaultTopologyMapper for getting topology information
25/08/21 07:41:05 INFO BlockManagerMasterEndpoint:
BlockManagerMasterEndpoint up
25/08/21 07:41:05 INFO SparkEnv: Registering BlockManagerMasterHeartbeat
25/08/21 07:41:05 INFO DiskBlockManager: Created local directory at
/tmp/blockmgr-dada3e75-8bc9-4353-a0b2-d8e663592347
25/08/21 07:41:05 INFO MemoryStore: MemoryStore started with capacity 19.5
GiB
25/08/21 07:41:05 INFO SparkEnv: Registering OutputCommitCoordinator
25/08/21 07:41:05 INFO Discovery: Start discovering components in the
current classpath...
25/08/21 07:41:05 INFO Discovery: Discovered component files:
META-INF/gluten-components/org.apache.gluten.backendsapi.velox.VeloxBackend.
Duration: 157 ms.
25/08/21 07:41:05 INFO package: Components registered within order: velox
25/08/21 07:41:05 INFO GlutenDriverPlugin: Gluten build info:
==============================================================
Components: Velox
Component Velox Branch: gluten-1.3.0
Component Velox Revision: 6af292c63804fb79e8b0da6d69ca265833148e8a
Component Velox Revision Time: 2025-07-08 01:11:09 -0700
Gluten Version: 1.3.0
GCC Version: GCC: (Debian 12.2.0-14+deb12u1) 12.2.0
Java Version: 11
Scala Version: 2.12.15
Spark Version: 3.5.3
Hadoop Version: 3.3.4
Gluten Branch: v1.3.0
Gluten Revision: 646329de0411c32547947777fd4bd7875657f946
Gluten Revision Time: 2025-07-25 08:35:19 -0700
Gluten Build Time: 2025-08-21T05:38:35Z
Gluten Repo URL: sso://internal-repo/third_party/apache/incubator-gluten
==============================================================
25/08/21 07:41:05 INFO VeloxListenerApi: Memory overhead is not set. Setting
it to 644245094 automatically. Gluten doesn't follow Spark's calculation on
default value of this option because the actual required memory overhead will
depend on off-heap usage than on on-heap usage.
25/08/21 07:41:05 WARN VeloxListenerApi: Memory overhead is set to 643825664
which is smaller than the recommended size 644245094. This may cause OOM.
25/08/21 07:41:05 INFO SparkDirectoryUtil: Created local directory at
/tmp/gluten-a79d9ef9-087a-4a31-8a03-e68547869895
25/08/21 07:41:05 INFO JniWorkspace: Creating JNI workspace in root
directory
/tmp/gluten-a79d9ef9-087a-4a31-8a03-e68547869895/jni/33d1d161-f681-402c-b27d-a07a52e66f89
25/08/21 07:41:05 INFO JniWorkspace: JNI workspace
/tmp/gluten-a79d9ef9-087a-4a31-8a03-e68547869895/jni/33d1d161-f681-402c-b27d-a07a52e66f89/gluten-11050754109111867394
created in root directory
/tmp/gluten-a79d9ef9-087a-4a31-8a03-e68547869895/jni/33d1d161-f681-402c-b27d-a07a52e66f89
25/08/21 07:41:05 INFO JniLibLoader: Read real path
/tmp/gluten-a79d9ef9-087a-4a31-8a03-e68547869895/jni/33d1d161-f681-402c-b27d-a07a52e66f89/gluten-11050754109111867394/linux/amd64/libgluten.so
for libPath
/tmp/gluten-a79d9ef9-087a-4a31-8a03-e68547869895/jni/33d1d161-f681-402c-b27d-a07a52e66f89/gluten-11050754109111867394/linux/amd64/libgluten.so
25/08/21 07:41:05 INFO JniLibLoader: Library
/tmp/gluten-a79d9ef9-087a-4a31-8a03-e68547869895/jni/33d1d161-f681-402c-b27d-a07a52e66f89/gluten-11050754109111867394/linux/amd64/libgluten.so
has been loaded using path-loading method
25/08/21 07:41:05 INFO JniLibLoader: Library
/tmp/gluten-a79d9ef9-087a-4a31-8a03-e68547869895/jni/33d1d161-f681-402c-b27d-a07a52e66f89/gluten-11050754109111867394/linux/amd64/libgluten.so
has been loaded
25/08/21 07:41:05 INFO JniLibLoader: Successfully loaded library
linux/amd64/libgluten.so
25/08/21 07:41:09 INFO JniLibLoader: Read real path
/tmp/gluten-a79d9ef9-087a-4a31-8a03-e68547869895/jni/33d1d161-f681-402c-b27d-a07a52e66f89/gluten-11050754109111867394/linux/amd64/libvelox.so
for libPath
/tmp/gluten-a79d9ef9-087a-4a31-8a03-e68547869895/jni/33d1d161-f681-402c-b27d-a07a52e66f89/gluten-11050754109111867394/linux/amd64/libvelox.so
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20250821 07:41:13.372397 138026 VeloxJniWrapper.cc:68] Loaded Velox backend.
25/08/21 07:41:13 INFO JniLibLoader: Library
/tmp/gluten-a79d9ef9-087a-4a31-8a03-e68547869895/jni/33d1d161-f681-402c-b27d-a07a52e66f89/gluten-11050754109111867394/linux/amd64/libvelox.so
has been loaded using path-loading method
25/08/21 07:41:13 INFO JniLibLoader: Library
/tmp/gluten-a79d9ef9-087a-4a31-8a03-e68547869895/jni/33d1d161-f681-402c-b27d-a07a52e66f89/gluten-11050754109111867394/linux/amd64/libvelox.so
has been loaded
25/08/21 07:41:13 INFO JniLibLoader: Successfully loaded library
linux/amd64/libvelox.so
I20250821 07:41:13.451807 138026 VeloxBackend.cc:97] VeloxBackend config:
[spark.gluten.memory.task.offHeap.size.in.bytes, 1073741824]
[spark.hadoop.input.connect.timeout, 180000]
[spark.gluten.velox.awsSdkLogLevel, FATAL]
[spark.hadoop.fs.s3a.connection.ssl.enabled, false]
[spark.sql.orc.compression.codec, snappy]
[spark.sql.decimalOperations.allowPrecisionLoss, true]
[spark.gluten.sql.columnar.shuffle.codecBackend, ]
[spark.gluten.sql.columnar.backend.velox.IOThreads, 2]
[spark.gluten.sql.columnar.backend.velox.fileHandleCacheEnabled, false]
[spark.hadoop.fs.s3a.path.style.access, true]
[spark.gluten.sql.columnar.shuffle.codec, ]
[spark.hadoop.fs.s3a.retry.limit, 20]
[spark.hadoop.input.read.timeout, 180000]
[spark.gluten.sql.columnar.backend.velox.memInitCapacity, 1048576]
[spark.gluten.memory.offHeap.size.in.bytes, 2147483648]
[spark.hadoop.fs.s3a.use.instance.credentials, false]
[spark.gluten.sql.debug, true]
[spark.hadoop.fs.s3a.connection.maximum, 15]
[spark.gluten.velox.fs.s3a.connect.timeout, 200s]
[spark.hadoop.dfs.client.log.severity, INFO]
[spark.memory.offHeap.enabled, true]
[spark.gluten.velox.fs.s3a.retry.mode, legacy]
[spark.gluten.memoryOverhead.size.in.bytes, 643825664]
[spark.hadoop.input.write.timeout, 180000]
I20250821 07:41:13.452808 138026 HiveConnector.cpp:61] Hive connector
test-hive created with file handle cache disabled
I20250821 07:41:13.652258 138026 VeloxBackend.cc:186] Setting global Velox
memory manager with capacity: 482869248
W20250821 07:41:13.652578 138026 MemoryArbitrator.cpp:84] Query memory
capacity[460.50MB] is set for NOOP arbitrator which has no capacity enforcement
25/08/21 07:41:13 INFO DriverPluginContainer: Initialized driver component
for plugin org.apache.gluten.GlutenPlugin.
25/08/21 07:41:13 INFO Executor: Starting executor ID driver on host
docker-host.com
25/08/21 07:41:13 INFO Executor: OS info Linux, 6.12.27-1rodete1-amd64, amd64
25/08/21 07:41:13 INFO Executor: Java version 11.0.24
25/08/21 07:41:13 INFO Executor: Starting executor with user classpath
(userClassPathFirst = false): ''
25/08/21 07:41:13 INFO Executor: Created or updated repl class loader
org.apache.spark.util.MutableURLClassLoader@55fee662 for default.
25/08/21 07:41:13 INFO VeloxListenerApi: Gluten is running with Spark local
mode. Skip running static initializer for executor.
25/08/21 07:41:13 INFO ExecutorPluginContainer: Initialized executor
component for plugin org.apache.gluten.GlutenPlugin.
25/08/21 07:41:13 INFO Utils: Successfully started service
'org.apache.spark.network.netty.NettyBlockTransferService' on port 32955.
25/08/21 07:41:13 INFO NettyBlockTransferService: Server created on
docker-host.com:32955
25/08/21 07:41:13 INFO BlockManager: Using
org.apache.spark.storage.RandomBlockReplicationPolicy for block replication
policy
25/08/21 07:41:13 INFO BlockManagerMaster: Registering BlockManager
BlockManagerId(driver, docker-host.com, 32955, None)
25/08/21 07:41:13 INFO BlockManagerMasterEndpoint: Registering block manager
docker-host.com:32955 with 19.5 GiB RAM, BlockManagerId(driver,
docker-host.com, 32955, None)
25/08/21 07:41:13 INFO BlockManagerMaster: Registered BlockManager
BlockManagerId(driver, docker-host.com, 32955, None)
25/08/21 07:41:13 INFO BlockManager: Initialized BlockManager:
BlockManagerId(driver, docker-host.com, 32955, None)
25/08/21 07:41:14 INFO SparkShimLoader: Loading Spark Shims for version:
3.5.3
25/08/21 07:41:14 INFO SparkShimLoader: Using Shim provider:
List(org.apache.gluten.sql.shims.spark353.SparkShimProvider@67fb5025)
I20250821 07:41:18.670761 138026 VeloxJniWrapper.cc:127]
################################################## received substrait::Plan:
for validation
I20250821 07:41:18.670799 138026 VeloxJniWrapper.cc:128]
{"extensions":[{"extensionFunction":{"functionAnchor":2,"name":"not:bool"}},{"extensionFunction":{"name":"and:bool_bool"}},{"extensionFunction":{"functionAnchor":1,"name":"is_not_null:fp64"}},{"extensionFunction":{"functionAnchor":3,"name":"equal:fp64_fp64"}},{"extensionFunction":{"functionAnchor":4,"name":"gt:fp64_fp64"}}],"relations":[{"root":{"input":{"read":{"common":{"direct":{}},"baseSchema":{"names":["l_orderkey"],"struct":{"types":[{"fp64":{"nullability":"NULLABILITY_NULLABLE"}}]},"columnTypes":["NORMAL_COL"]},"filter":{"scalarFunction":{"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"scalarFunction":{"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"scalarFunction":{"functionReference":1,"outputType":{"bool":{"nullability":"NULLABILITY_REQUIRED"}},"arguments":[{"value":{"selection":{"directReference":{"structField":{}}}}}]}}},{"value":{"scalarFu
nction":{"functionReference":2,"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"scalarFunction":{"functionReference":3,"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"selection":{"directReference":{"structField":{}}}}},{"value":{"literal":{"fp64":"NaN"}}}]}}}]}}}]}}},{"value":{"scalarFunction":{"functionReference":4,"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"selection":{"directReference":{"structField":{}}}}},{"value":{"literal":{"fp64":0}}}]}}}]}},"advancedExtension":{"optimization":{"@type":"/google.protobuf.StringValue","value":"isMergeTree=0\n"}}}}}}]}
I20250821 07:41:18.744730 138026 VeloxJniWrapper.cc:127]
################################################## received substrait::Plan:
for validation
I20250821 07:41:18.744760 138026 VeloxJniWrapper.cc:128]
{"extensions":[{"extensionFunction":{"functionAnchor":2,"name":"not:bool"}},{"extensionFunction":{"name":"and:bool_bool"}},{"extensionFunction":{"functionAnchor":1,"name":"is_not_null:fp64"}},{"extensionFunction":{"functionAnchor":3,"name":"equal:fp64_fp64"}},{"extensionFunction":{"functionAnchor":4,"name":"gt:fp64_fp64"}}],"relations":[{"root":{"input":{"read":{"common":{"direct":{}},"baseSchema":{"names":["l_orderkey"],"struct":{"types":[{"fp64":{"nullability":"NULLABILITY_NULLABLE"}}]},"columnTypes":["NORMAL_COL"]},"filter":{"scalarFunction":{"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"scalarFunction":{"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"scalarFunction":{"functionReference":1,"outputType":{"bool":{"nullability":"NULLABILITY_REQUIRED"}},"arguments":[{"value":{"selection":{"directReference":{"structField":{}}}}}]}}},{"value":{"scalarFu
nction":{"functionReference":2,"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"scalarFunction":{"functionReference":3,"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"selection":{"directReference":{"structField":{}}}}},{"value":{"literal":{"fp64":"NaN"}}}]}}}]}}}]}}},{"value":{"scalarFunction":{"functionReference":4,"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"selection":{"directReference":{"structField":{}}}}},{"value":{"literal":{"fp64":0}}}]}}}]}},"advancedExtension":{"optimization":{"@type":"/google.protobuf.StringValue","value":"isMergeTree=0\n"}}}}}}]}
I20250821 07:41:19.025285 138204 VeloxRuntime.cc:74]
################################################## received substrait::Plan:
[Stage: 9 TID: 9]
{"extensions":[{"extensionFunction":{"functionAnchor":2,"name":"not:bool"}},{"extensionFunction":{"name":"and:bool_bool"}},{"extensionFunction":{"functionAnchor":1,"name":"is_not_null:fp64"}},{"extensionFunction":{"functionAnchor":3,"name":"equal:fp64_fp64"}},{"extensionFunction":{"functionAnchor":4,"name":"gt:fp64_fp64"}}],"relations":[{"root":{"input":{"read":{"common":{"direct":{}},"baseSchema":{"names":["l_orderkey"],"struct":{"types":[{"fp64":{"nullability":"NULLABILITY_NULLABLE"}}]},"columnTypes":["NORMAL_COL"]},"filter":{"scalarFunction":{"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"scalarFunction":{"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"scalarFunction":{"functionReference":1,"outputType":{"bool":{"nullability":"NULLABILITY_REQUIRED"}},"arguments":[{"value":{"selection":{"directReference":{"structField":{}}}}}]}}},{"value":{"scalarFunction":{"functionReference":2,"outputType":{"bool":{"nul
lability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"scalarFunction":{"functionReference":3,"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"selection":{"directReference":{"structField":{}}}}},{"value":{"literal":{"fp64":"NaN"}}}]}}}]}}}]}}},{"value":{"scalarFunction":{"functionReference":4,"outputType":{"bool":{"nullability":"NULLABILITY_NULLABLE"}},"arguments":[{"value":{"selection":{"directReference":{"structField":{}}}}},{"value":{"literal":{"fp64":0}}}]}}}]}},"advancedExtension":{"optimization":{"@type":"/google.protobuf.StringValue","value":"isMergeTree=0\n"}}}},"names":["l_orderkey#128"]}}]}
I20250821 07:41:19.025633 138204 VeloxRuntime.cc:88]
################################################## received
substrait::ReadRel.LocalFiles: [Stage: 9 TID: 9]
{"items":[{"uriFile":"file:///root/incubator-gluten/test/gluten-part-9b412adb-10ab-432d-8bd1-8b9818e12c17.snappy.parquet","length":"148348","parquet":{},"schema":{},"metadataColumns":[{"key":"input_file_name","value":"file:///root/incubator-gluten/test/gluten-part-9b412adb-10ab-432d-8bd1-8b9818e12c17.snappy.parquet"},{"key":"input_file_block_length","value":"148348"},{"key":"input_file_block_start","value":"0"}],"properties":{"fileSize":"148348","modificationTime":"1753709617410"}}]}
I20250821 07:41:19.025874 138204 VeloxRuntime.cc:139] VeloxRuntime session
config:
[spark.unsafe.sorter.spill.reader.buffer.size, 1048576]
[spark.gluten.memory.task.offHeap.size.in.bytes, 1073741824]
[spark.gluten.memory.backtrace.allocation, false]
[spark.sql.legacy.timeParserPolicy, EXCEPTION]
[spark.gluten.ugi.username, root]
[spark.gluten.sql.session.timeZone.default, America/Los_Angeles]
[spark.gluten.sql.columnar.backend.velox.memInitCapacity, 1048576]
[spark.gluten.ugi.tokens, ]
[spark.gluten.sql.debug, true]
[spark.gluten.sql.columnarToRowMemoryThreshold, 67108864]
[spark.sql.files.ignoreMissingFiles, false]
[spark.shuffle.spill.diskWriteBufferSize, 1048576]
[spark.shuffle.spill.compress, true]
[spark.sql.caseSensitive, false]
I20250821 07:41:19.026878 138204 VeloxPlanConverter.cc:128] Plan Node:
-- TableScan[0][table: hive_table, remaining filter:
(and(and(isnotnull("l_orderkey"),not(equalto("l_orderkey","NaN"))),greaterthan("l_orderkey",0)))]
-> n0_0:DOUBLE
I20250821 07:41:19.029193 138204 FileSystems.cpp:193] LocalFileSystem::mkdir
/tmp/gluten-a79d9ef9-087a-4a31-8a03-e68547869895/gluten-spill/cc05f8c5-a007-4140-8c16-061b5a3271ce
I20250821 07:41:19.053068 138204 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeDOUBLE
I20250821 07:41:19.053121 138204 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeBOOLEAN
I20250821 07:41:19.053133 138204 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeBOOLEAN
I20250821 07:41:19.053141 138204 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeBOOLEAN
I20250821 07:41:19.053148 138204 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeDOUBLE
I20250821 07:41:19.053156 138204 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeBOOLEAN
I20250821 07:41:19.053164 138204 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeBOOLEAN
I20250821 07:41:19.053171 138204 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeDOUBLE
I20250821 07:41:19.053179 138204 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeDOUBLE
I20250821 07:41:19.053186 138204 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeBOOLEAN
I20250821 07:41:19.053193 138204 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeDOUBLE
I20250821 07:41:19.053200 138204 HiveConnectorUtil.cpp:301] No need to check
type lowercase modeDOUBLE
E20250821 07:41:19.054841 138204 Exceptions.h:66] Line:
/root/incubator-gluten/ep/build-velox/build/velox_ep/./velox/type/Filter.h:1360,
Function:FloatingPointRange, Expression: upperUnbounded || !std::isnan(upper_)
, Source: RUNTIME, ErrorCode: INVALID_STATE
W20250821 07:41:19.065094 138204 HiveConnectorUtil.cpp:878] Unexpected
failure when extracting filter for: equalto("l_orderkey","NaN")
I20250821 07:41:19.066823 138204 HiveDataSource.cpp:169] Extracted subfields
from remaining filter: [l_orderkey]
E20250821 07:41:19.067951 138204 Exceptions.h:66] Line:
/root/incubator-gluten/ep/build-velox/build/velox_ep/./velox/type/Filter.h:1360,
Function:FloatingPointRange, Expression: upperUnbounded || !std::isnan(upper_)
, Source: RUNTIME, ErrorCode: INVALID_STATE
W20250821 07:41:19.068218 138204 MetadataFilter.cpp:195] Fail to convert
expression to metadata filter: equalto("l_orderkey","NaN")
I20250821 07:41:19.068548 138204 HiveDataSource.cpp:306] Adding split Hive:
file:///root/incubator-gluten/test/gluten-part-9b412adb-10ab-432d-8bd1-8b9818e12c17.snappy.parquet
0 - 148348
I20250821 07:41:19.069901 138204 FileHandle.cpp:61] Generating file handle
for:
file:///root/incubator-gluten/test/gluten-part-9b412adb-10ab-432d-8bd1-8b9818e12c17.snappy.parquet
uuid: 1
I20250821 07:41:19.072009 138259 EventBase.h:883] expCoeff_ -5e-07
folly::EventBase::SmoothLoopTime::SmoothLoopTime(std::chrono::microseconds)
I20250821 07:41:19.072326 138259 EventBase.cpp:543] EventBase(): Starting
loop.
I20250821 07:41:19.072394 138259 EventBase.cpp:794] EventBase 0x7fef24001c30
virtual void folly::EventBase::bumpHandlingTime() (loop) latest
18446744073709551576 next 18446744073709551577
I20250821 07:41:19.072422 138259 EventBase.cpp:1058] latest
18446744073709551576 next 18446744073709551577
I20250821 07:41:19.072431 138259 EventBase.cpp:801] EventBase 0x7fef24001c30
virtual void folly::EventBase::bumpHandlingTime() (loop) startWork_
1801472268708386
I20250821 07:41:19.072468 138259 EventBase.cpp:794] EventBase 0x7fef24001c30
virtual void folly::EventBase::bumpHandlingTime() (loop) latest
18446744073709551577 next 18446744073709551577
I20250821 07:41:19.072476 138259 EventBase.cpp:1058] latest
18446744073709551577 next 18446744073709551577
I20250821 07:41:19.072507 138259 EventBase.cpp:1058] latest
18446744073709551577 next 18446744073709551577
I20250821 07:41:19.072486 138259 EventBase.cpp:655] EventBase 0x7fef24001c30
did not timeout loop time guess: 139 idle time: 86 busy time: 53 avgLoopTime:
0.0036835 maxLatencyLoopTime: 0.0036835 maxLatency_: 0us notificationQueueSize:
0 nothingHandledYet(): 0
I20250821 07:41:19.072522 138259 EventBase.cpp:686] EventBase 0x7fef24001c30
loop time: 0
I20250821 07:41:19.072610 138259 EventBase.cpp:794] EventBase 0x7fef24001c30
virtual void folly::EventBase::bumpHandlingTime() (loop) latest
18446744073709551577 next 18446744073709551578
I20250821 07:41:19.072621 138259 EventBase.cpp:1058] latest
18446744073709551577 next 18446744073709551578
I20250821 07:41:19.072629 138259 EventBase.cpp:801] EventBase 0x7fef24001c30
virtual void folly::EventBase::bumpHandlingTime() (loop) startWork_
1801472268906366
I20250821 07:41:19.072952 138259 JniCommon.h:111] JNIEnv was not attached to
current thread.
I20250821 07:41:19.073211 138259 JniCommon.h:117] Succeeded attaching
current thread.
I20250821 07:41:19.077234 138259 EventBase.cpp:794] EventBase 0x7fef24001c30
virtual void folly::EventBase::bumpHandlingTime() (loop) latest
18446744073709551578 next 18446744073709551578
I20250821 07:41:19.077251 138259 EventBase.cpp:1058] latest
18446744073709551578 next 18446744073709551578
I20250821 07:41:19.077280 138259 EventBase.cpp:1058] latest
18446744073709551578 next 18446744073709551578
I20250821 07:41:19.077260 138259 EventBase.cpp:655] EventBase 0x7fef24001c30
did not timeout loop time guess: 4775 idle time: 144 busy time: 4631
avgLoopTime: 11.5086 maxLatencyLoopTime: 11.5086 maxLatency_: 0us
notificationQueueSize: 0 nothingHandledYet(): 0
I20250821 07:41:19.077292 138259 EventBase.cpp:686] EventBase 0x7fef24001c30
loop time: 4
I20250821 07:41:19.080861 138260 EventBase.h:883] expCoeff_ -5e-07
folly::EventBase::SmoothLoopTime::SmoothLoopTime(std::chrono::microseconds)
I20250821 07:41:19.080993 138260 EventBase.cpp:543] EventBase(): Starting
loop.
I20250821 07:41:19.081023 138260 EventBase.cpp:794] EventBase 0x7fef2c007ed0
virtual void folly::EventBase::bumpHandlingTime() (loop) latest
18446744073709551576 next 18446744073709551577
I20250821 07:41:19.081033 138260 EventBase.cpp:1058] latest
18446744073709551576 next 18446744073709551577
I20250821 07:41:19.081040 138260 EventBase.cpp:801] EventBase 0x7fef2c007ed0
virtual void folly::EventBase::bumpHandlingTime() (loop) startWork_
1801472277317776
I20250821 07:41:19.081060 138260 EventBase.cpp:794] EventBase 0x7fef2c007ed0
virtual void folly::EventBase::bumpHandlingTime() (loop) latest
18446744073709551577 next 18446744073709551577
I20250821 07:41:19.081068 138260 EventBase.cpp:1058] latest
18446744073709551577 next 18446744073709551577
I20250821 07:41:19.081087 138260 EventBase.cpp:1058] latest
18446744073709551577 next 18446744073709551577
I20250821 07:41:19.081075 138260 EventBase.cpp:655] EventBase 0x7fef2c007ed0
did not timeout loop time guess: 70 idle time: 36 busy time: 34 avgLoopTime:
0.00119 maxLatencyLoopTime: 0.00119 maxLatency_: 0us notificationQueueSize: 1
nothingHandledYet(): 0
I20250821 07:41:19.081099 138260 EventBase.cpp:686] EventBase 0x7fef2c007ed0
loop time: 0
I20250821 07:41:19.081108 138260 EventBase.cpp:794] EventBase 0x7fef2c007ed0
virtual void folly::EventBase::bumpHandlingTime() (loop) latest
18446744073709551577 next 18446744073709551578
I20250821 07:41:19.081115 138260 EventBase.cpp:1058] latest
18446744073709551577 next 18446744073709551578
I20250821 07:41:19.081122 138260 EventBase.cpp:801] EventBase 0x7fef2c007ed0
virtual void folly::EventBase::bumpHandlingTime() (loop) startWork_
1801472277399616
I20250821 07:41:19.081512 138260 EventBase.cpp:794] EventBase 0x7fef2c007ed0
virtual void folly::EventBase::bumpHandlingTime() (loop) latest
18446744073709551578 next 18446744073709551578
I20250821 07:41:19.081528 138260 EventBase.cpp:1058] latest
18446744073709551578 next 18446744073709551578
I20250821 07:41:19.081552 138260 EventBase.cpp:1058] latest
18446744073709551578 next 18446744073709551578
I20250821 07:41:19.081537 138260 EventBase.cpp:655] EventBase 0x7fef2c007ed0
did not timeout loop time guess: 461 idle time: 47 busy time: 414 avgLoopTime:
0.118944 maxLatencyLoopTime: 0.118944 maxLatency_: 0us notificationQueueSize: 0
nothingHandledYet(): 0
I20250821 07:41:19.081563 138260 EventBase.cpp:686] EventBase 0x7fef2c007ed0
loop time: 0
I20250821 07:41:19.149184 138204 Task.cpp:1255] All drivers (1) finished for
task Gluten_Stage_9_TID_9_VTID_0 after running for 99ms
I20250821 07:41:19.149259 138204 Task.cpp:2051] Terminating task
Gluten_Stage_9_TID_9_VTID_0 with state Finished after running for 99ms
I20250821 07:41:19.152727 138204 WholeStageResultIterator.cc:349] Native
Plan with stats for: [Stage: 9 TID: 9]
-- TableScan[0][table: hive_table, remaining filter:
(and(and(isnotnull("l_orderkey"),not(equalto("l_orderkey","NaN"))),greaterthan("l_orderkey",0)))]
-> n0_0:DOUBLE
Input: 60175 rows (694.59KB, 15 batches), Output: 60175 rows (694.59KB,
15 batches), Cpu time: 28.97ms, Wall time: 43.05ms, Blocked wall time: 0ns,
Peak memory: 657.12KB, Memory allocations: 59, Threads: 1, Splits: 1, CPU
breakdown: B/I/O/F (112.14us/0ns/28.86ms/2.61us)
dataSourceAddSplitWallNanos sum: 12.90ms, count: 1, min: 12.90ms,
max: 12.90ms
dataSourceReadWallNanos sum: 12.63ms, count: 1, min: 12.63ms,
max: 12.63ms
ioWaitWallNanos sum: 5.82ms, count: 1, min: 5.82ms,
max: 5.82ms
maxSingleIoWaitWallNanos sum: 4.33ms, count: 1, min: 4.33ms,
max: 4.33ms
numPrefetch sum: 2, count: 1, min: 2, max: 2
numSilentThrow sum: 2, count: 1, min: 2, max: 2
numStorageRead sum: 2, count: 1, min: 2, max: 2
overreadBytes sum: 0B, count: 1, min: 0B, max: 0B
prefetchBytes sum: 289.41KB, count: 1, min: 289.41KB,
max: 289.41KB
queuedWallNanos sum: 89.00us, count: 1, min: 89.00us,
max: 89.00us
runningAddInputWallNanos sum: 0ns, count: 1, min: 0ns, max: 0ns
runningFinishWallNanos sum: 3.76us, count: 1, min: 3.76us,
max: 3.76us
runningGetOutputWallNanos sum: 42.89ms, count: 1, min: 42.89ms,
max: 42.89ms
storageReadBytes sum: 289.41KB, count: 1, min: 289.41KB,
max: 289.41KB
totalRemainingFilterTime sum: 3.16ms, count: 1, min: 3.16ms,
max: 3.16ms
totalScanTime sum: 1.48ms, count: 1, min: 1.48ms,
max: 1.48ms
I20250821 07:41:19.157507 138204 FileSystems.cpp:206] LocalFileSystem::rmdir
/tmp/gluten-a79d9ef9-087a-4a31-8a03-e68547869895/gluten-spill/cc05f8c5-a007-4140-8c16-061b5a3271ce
== Parsed Logical Plan ==
'Filter ('l_orderkey > 0.0)
+- Filter NOT (l_orderkey#128 = NaN)
+- RelationV2[l_orderkey#128] parquet file:/root/incubator-gluten/test
== Analyzed Logical Plan ==
l_orderkey: double
Filter (l_orderkey#128 > 0.0)
+- Filter NOT (l_orderkey#128 = NaN)
+- RelationV2[l_orderkey#128] parquet file:/root/incubator-gluten/test
== Optimized Logical Plan ==
Filter ((isnotnull(l_orderkey#128) AND NOT (l_orderkey#128 = NaN)) AND
(l_orderkey#128 > 0.0))
+- RelationV2[l_orderkey#128] parquet file:/root/incubator-gluten/test
== Physical Plan ==
VeloxColumnarToRow
+- ^(1) FilterExecTransformer ((isnotnull(l_orderkey#128) AND NOT
(l_orderkey#128 = NaN)) AND (l_orderkey#128 > 0.0))
+- ^(1) BatchScanTransformer parquet
file:/root/incubator-gluten/test[l_orderkey#128] ParquetScan DataFilters:
[isnotnull(l_orderkey#128), NOT (l_orderkey#128 = NaN), (l_orderkey#128 >
0.0)], Format: parquet, Location: InMemoryFileIndex(1
paths)[file:/root/incubator-gluten/test], PartitionFilters: [],
PushedAggregation: [], PushedFilters: [IsNotNull(l_orderkey),
Not(EqualTo(l_orderkey,NaN)), GreaterThan(l_orderkey,0.0)], PushedGroupBy: [],
ReadSchema: struct<l_orderkey:double> RuntimeFilters: [] NativeFilters:
[isnotnull(l_orderkey#128),NOT (l_orderkey#128 = NaN),(l_orderkey#128 > 0.0)]
== Parsed Logical Plan ==
'Filter ('l_orderkey > 0.0)
+- Filter NOT (l_orderkey#128 = NaN)
+- RelationV2[l_orderkey#128] parquet file:/root/incubator-gluten/test
== Analyzed Logical Plan ==
l_orderkey: double
Filter (l_orderkey#128 > 0.0)
+- Filter NOT (l_orderkey#128 = NaN)
+- RelationV2[l_orderkey#128] parquet file:/root/incubator-gluten/test
== Optimized Logical Plan ==
Filter ((isnotnull(l_orderkey#128) AND NOT (l_orderkey#128 = NaN)) AND
(l_orderkey#128 > 0.0))
+- RelationV2[l_orderkey#128] parquet file:/root/incubator-gluten/test
== Physical Plan ==
VeloxColumnarToRow
+- ^(1) FilterExecTransformer ((isnotnull(l_orderkey#128) AND NOT
(l_orderkey#128 = NaN)) AND (l_orderkey#128 > 0.0))
+- ^(1) BatchScanTransformer parquet
file:/root/incubator-gluten/test[l_orderkey#128] ParquetScan DataFilters:
[isnotnull(l_orderkey#128), NOT (l_orderkey#128 = NaN), (l_orderkey#128 >
0.0)], Format: parquet, Location: InMemoryFileIndex(1
paths)[file:/root/incubator-gluten/test], PartitionFilters: [],
PushedAggregation: [], PushedFilters: [IsNotNull(l_orderkey),
Not(EqualTo(l_orderkey,NaN)), GreaterThan(l_orderkey,0.0)], PushedGroupBy: [],
ReadSchema: struct<l_orderkey:double> RuntimeFilters: [] NativeFilters:
[isnotnull(l_orderkey#128),NOT (l_orderkey#128 = NaN),(l_orderkey#128 > 0.0)]
()
25/08/21 07:41:19 WARN VeloxTPCHV2Suite:
===== POSSIBLE THREAD LEAK IN SUITE
org.apache.gluten.execution.VeloxTPCHV2Suite, threads: rpc-boss-3-1
(daemon=true), shuffle-boss-6-1 (daemon=true), Thread-8 (daemon=true) =====
I20250821 07:41:19.536206 138273 EventBase.cpp:810] EventBase(): Received
terminateLoopSoon() command.
I20250821 07:41:19.536334 138273 EventBase.cpp:810] EventBase(): Received
terminateLoopSoon() command.
I20250821 07:41:19.536362 138259 EventBase.cpp:794] EventBase 0x7fef24001c30
virtual void folly::EventBase::bumpHandlingTime() (loop) latest
18446744073709551578 next 18446744073709551579
I20250821 07:41:19.536383 138259 EventBase.cpp:1058] latest
18446744073709551578 next 18446744073709551579
I20250821 07:41:19.536392 138259 EventBase.cpp:801] EventBase 0x7fef24001c30
virtual void folly::EventBase::bumpHandlingTime() (loop) startWork_
1801472732669396
I20250821 07:41:19.536409 138259 EventBase.cpp:794] EventBase 0x7fef24001c30
virtual void folly::EventBase::bumpHandlingTime() (loop) latest
18446744073709551579 next 18446744073709551579
I20250821 07:41:19.536427 138259 EventBase.cpp:1058] latest
18446744073709551579 next 18446744073709551579
I20250821 07:41:19.536396 138260 EventBase.cpp:794] EventBase 0x7fef2c007ed0
virtual void folly::EventBase::bumpHandlingTime() (loop) latest
18446744073709551578 next 18446744073709551579
I20250821 07:41:19.536453 138259 EventBase.cpp:1058] latest
18446744073709551579 next 18446744073709551579
I20250821 07:41:19.536440 138259 EventBase.cpp:655] EventBase 0x7fef24001c30
did not timeout loop time guess: 459173 idle time: 459131 busy time: 42
avgLoopTime: 14.0704 maxLatencyLoopTime: 14.0704 maxLatency_: 0us
notificationQueueSize: 0 nothingHandledYet(): 0
I20250821 07:41:19.536459 138260 EventBase.cpp:1058] latest
18446744073709551578 next 18446744073709551579
I20250821 07:41:19.536494 138260 EventBase.cpp:801] EventBase 0x7fef2c007ed0
virtual void folly::EventBase::bumpHandlingTime() (loop) startWork_
1801472732770456
I20250821 07:41:19.536477 138259 EventBase.cpp:686] EventBase 0x7fef24001c30
loop time: 459
I20250821 07:41:19.536517 138260 EventBase.cpp:794] EventBase 0x7fef2c007ed0
virtual void folly::EventBase::bumpHandlingTime() (loop) latest
18446744073709551579 next 18446744073709551579
I20250821 07:41:19.536533 138260 EventBase.cpp:1058] latest
18446744073709551579 next 18446744073709551579
I20250821 07:41:19.536520 138259 EventBase.cpp:709] EventBase(): Done with
loop.
I20250821 07:41:19.536561 138260 EventBase.cpp:1058] latest
18446744073709551579 next 18446744073709551579
I20250821 07:41:19.536546 138260 EventBase.cpp:655] EventBase 0x7fef2c007ed0
did not timeout loop time guess: 455006 idle time: 454956 busy time: 50
avgLoopTime: 11.4211 maxLatencyLoopTime: 11.4211 maxLatency_: 0us
notificationQueueSize: 0 nothingHandledYet(): 0
I20250821 07:41:19.536572 138260 EventBase.cpp:686] EventBase 0x7fef2c007ed0
loop time: 455
I20250821 07:41:19.536581 138260 EventBase.cpp:709] EventBase(): Done with
loop.
I20250821 07:41:19.536594 138259 EventBase.cpp:794] EventBase 0x7fef24001c30
virtual void folly::EventBase::bumpHandlingTime() (loop) latest
18446744073709551579 next 18446744073709551579
I20250821 07:41:19.536603 138259 EventBase.cpp:1058] latest
18446744073709551579 next 18446744073709551579
I20250821 07:41:19.536621 138260 EventBase.cpp:794] EventBase 0x7fef2c007ed0
virtual void folly::EventBase::bumpHandlingTime() (loop) latest
18446744073709551579 next 18446744073709551579
I20250821 07:41:19.536629 138260 EventBase.cpp:1058] latest
18446744073709551579 next 18446744073709551579
I20250821 07:41:19.536657 138259 EventBase.cpp:374] EventBase(): Destroyed.
I20250821 07:41:19.536684 138260 EventBase.cpp:374] EventBase(): Destroyed.
Process finished with exit code 0
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]