iasuka opened a new issue, #10620: URL: https://github.com/apache/incubator-gluten/issues/10620
### Backend VL (Velox) ### Bug description When I use the default parquet rowGroupSize, it runs normally. However, when I change the parquet rowGroupSize, some TPC-DS SQL queries result in a core dump.I noticed that there were some issues similar to this one before. I modified cpp/core/jni/JniCommon.h, but the problem still persists. ### Gluten version Gluten-1.3 ### Spark version Spark-3.3.x ### Spark configurations _No response_ ### System information _No response_ ### Relevant logs ```bash Stack: [0x0000ffffb56c5000,0x0000ffffb58c5000], sp=0x0000ffffb58bc0e0, free space=2012k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [libjvm.so+0x8126c0] Method::bci_from(unsigned char*) const+0x0 V [libjvm.so+0x5def10] InterpreterRuntime::create_exception(JavaThread*, char*, char*)+0x230 Internal exceptions (10 events): Event: 41.479 Thread 0x0000ffffb0012800 Exception <a 'java/lang/NoSuchMethodError': java.lang.Object.$anonfun$doTransform$4(Lscala/collection/Seq;Lorg/apache/spark/sql/catalyst/expressions/Expression;)Lorg/apache/gluten/expression/ExpressionTransformer;> (0x000000062210abd0) thrown at [/home/hu Event: 41.479 Thread 0x0000ffffb0012800 Exception <a 'java/lang/NoSuchMethodError': java.lang.Object.$anonfun$doTransform$5(Lorg/apache/gluten/substrait/SubstraitContext;Lorg/apache/gluten/expression/ExpressionTransformer;)Lorg/apache/gluten/substrait/expression/ExpressionNode;> (0x000000062211 Event: 41.480 Thread 0x0000ffffb0012800 Exception <a 'java/lang/NoSuchMethodError': java.lang.Object.$anonfun$doTransform$1(Lorg/apache/spark/sql/catalyst/expressions/Expression;)Lorg/apache/spark/sql/types/DataType;> (0x000000062211d7b0) thrown at [/home/huawei/jdk-build/src/hotspot/src Event: 41.484 Thread 0x0000ffffb0012800 Exception <a 'java/lang/NoSuchMethodError': java.lang.Object.$anonfun$doTransform$2(Ljava/lang/Object;Lorg/apache/gluten/expression/ExpressionTransformer;)Lorg/apache/gluten/substrait/expression/ExpressionNode;> (0x0000000622189468) thrown at [/home/huawe Event: 41.680 Thread 0x0000ffffb0012800 Exception <a 'java/lang/NoSuchMethodError': java.lang.Object.$anonfun$$minus$minus$1(Lscala/collection/generic/Subtractable;Ljava/lang/Object;)Lscala/collection/generic/Subtractable;> (0x000000062304fd58) thrown at [/home/huawei/jdk-build/src/hotsp Event: 41.741 Thread 0x0000ffffb0012800 Exception <a 'java/lang/NoSuchMethodError': java.lang.Object.$anonfun$postProcessPushDownFilter$1$adapted(Lorg/apache/spark/sql/catalyst/expressions/Expression;)Ljava/lang/Object;> (0x00000006234177b8) thrown at [/home/huawei/jdk-build/src/hotspot/ Event: 41.741 Thread 0x0000ffffb0012800 Exception <a 'java/lang/NoSuchMethodError': java.lang.Object.$anonfun$postProcessPushDownFilter$2$adapted(Lorg/apache/spark/sql/catalyst/expressions/Attribute;)Ljava/lang/Object;> (0x000000062341ce78) thrown at [/home/huawei/jdk-build/src/hotspot/s Event: 41.751 Thread 0x0000ffffb0012800 Exception <a 'java/lang/NoSuchMethodError': java.lang.Object.$anonfun$requiredChildConvention$1$adapted(Lorg/apache/gluten/extension/columnar/transition/ConventionReq;Ljava/lang/Object;)Lorg/apache/gluten/extension/columnar/transition/ConventionReq;> (0x0 Event: 41.848 Thread 0x0000ffffb0012800 Exception <a 'java/lang/NoSuchMethodError': java.lang.Object.$anonfun$find$1(Lorg/apache/spark/sql/execution/adaptive/AdaptiveSparkPlanHelper;Lscala/Function1;Lscala/Option;Lorg/apache/spark/sql/execution/SparkPlan;)Lscala/Option;> (0x0000000623adeea0) th Event: 41.848 Thread 0x0000ffffb0012800 Exception <a 'java/lang/NoSuchMethodError': java.lang.Object.$anonfun$find$2(Lorg/apache/spark/sql/execution/adaptive/AdaptiveSparkPlanHelper;Lorg/apache/spark/sql/execution/SparkPlan;Lscala/Function1;)Lscala/Option;> (0x0000000623ae7c20) thrown at [/home gdb logs: #0 0x0000ffff9c990e10 in ?? () from /usr/lib64/libc.so.6 #1 0x0000ffff9c949fbc in raise () from /usr/lib64/libc.so.6 #2 0x0000ffff9c937d70 in abort () from /usr/lib64/libc.so.6 #3 0x0000ffff9c406bbc in os::abort(bool) () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so #4 0x0000ffff9c5c7fcc in VMError::report_and_die() () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so #5 0x0000ffff9c5c8ed8 in crash_handler(int, siginfo_t*, void*) () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so #6 <signal handler called> #7 0x0000ffff9c3806bc in Method::name_and_sig_as_C_string(char*, int) const () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so #8 0x0000ffff9c03fd94 in frame::print_on_error(outputStream*, char*, int, bool) const () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so #9 0x0000ffff9c5c59cc in VMError::print_stack_trace(outputStream*, JavaThread*, char*, int, bool) [clone .part.13] () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so #10 0x0000ffff9c5c6a5c in VMError::report(outputStream*) () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so #11 0x0000ffff9c5c7b34 in VMError::report_and_die() () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so #12 0x0000ffff9c5c8ed8 in crash_handler(int, siginfo_t*, void*) () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so #13 <signal handler called> #14 0x0000ffff9c3806bc in Method::name_and_sig_as_C_string(char*, int) const () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so #15 0x0000ffff9c03fd94 in frame::print_on_error(outputStream*, char*, int, bool) const () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so #16 0x0000ffff9bfb63a8 in print_native_stack(outputStream*, frame, Thread*, char*, int) () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so #17 0x0000ffff9c5c6e50 in VMError::report(outputStream*) () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so #18 0x0000ffff9c5c7b34 in VMError::report_and_die() () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so #19 0x0000ffff9c411b74 in JVM_handle_linux_signal () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so #20 0x0000ffff9c403a0c in signalHandler(int, siginfo_t*, void*) () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so #21 <signal handler called> #22 0x0000ffff9c3816c0 in Method::bci_from(unsigned char*) const () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so #23 0x0000ffff9c14d6f0 in InterpreterRuntime::note_trap(JavaThread*, int, Thread*) () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so #24 0x0000ffff9c14df10 in InterpreterRuntime::create_exception(JavaThread*, char*, char*) () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
