[
https://issues.apache.org/jira/browse/KUDU-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Serbin resolved KUDU-3545.
---------------------------------
Fix Version/s: n/a
Resolution: Information Provided
See [this
comment|https://issues.apache.org/jira/browse/KUDU-3545?focusedCommentId=18045730&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-18045730]
for more information on the resolution.
> codegen test fails on SLES with higher libgcc version
> -----------------------------------------------------
>
> Key: KUDU-3545
> URL: https://issues.apache.org/jira/browse/KUDU-3545
> Project: Kudu
> Issue Type: Bug
> Components: codegen
> Reporter: Ashwani Raina
> Assignee: Ashwani Raina
> Priority: Minor
> Fix For: n/a
>
>
> On a SLES 15 withlibgcc_s1-13.2.1+git7813-150000.1.6.1.x86_64 version,
> codegen-test fails with following crash:
> {noformat}
> *** SIGABRT (@0x3162e) received by PID 202286 (TID 0x7f71d1bfe700) from PID
> 202286; stack trace: ***
> @ 0x7f71d41f5910 (unknown)
> @ 0x7f71d2725d2b __GI_raise
> @ 0x7f71d27273e5 __GI_abort
> @ 0x7f71d28d78d7 (unknown)
> @ 0x7f71d28f1009 __deregister_frame
> @ 0x7f71d4d6c9e0 llvm::RTDyldMemoryManager::deregisterEHFrames()
> @ 0x7f71d4976b02 llvm::MCJIT::~MCJIT()
> @ 0x7f71d4977241 llvm::MCJIT::~MCJIT()
> @ 0x7f71d481c222 std::default_delete<>::operator()()
> @ 0x7f71d481c12d std::unique_ptr<>::~unique_ptr()
> @ 0x7f71d481bfaf kudu::codegen::JITWrapper::~JITWrapper()
> @ 0x7f71d4835f34
> kudu::codegen::RowProjectorFunctions::~RowProjectorFunctions()
> @ 0x7f71d4835f50
> kudu::codegen::RowProjectorFunctions::~RowProjectorFunctions()
> @ 0x46297c kudu::RefCountedThreadSafe<>::DeleteInternal()
> @ 0x45f3d1 kudu::DefaultRefCountedThreadSafeTraits<>::Destruct()
> @ 0x45acb0 kudu::RefCountedThreadSafe<>::Release()
> @ 0x7f71d480c191
> kudu::codegen::CodeCache::EvictionCallback::EvictedEntry()
> @ 0x7f71d3c5e4bb kudu::(anonymous
> namespace)::CacheShard<>::FreeEntry()
> @ 0x7f71d3c60b31 kudu::(anonymous namespace)::CacheShard<>::Insert()
> @ 0x7f71d3c5fb73 kudu::(anonymous namespace)::ShardedCache<>::Insert()
> @ 0x7f71d480bab6 kudu::codegen::CodeCache::AddEntry()
> @ 0x7f71d4811fea kudu::codegen::(anonymous
> namespace)::CompilationTask::RunWithStatus()
> @ 0x7f71d4811a64 kudu::codegen::(anonymous
> namespace)::CompilationTask::Run()
> @ 0x7f71d481288a
> _ZZN4kudu7codegen18CompilationManager19RequestRowProjectorEPKNS_6SchemaES4_PSt10unique_ptrINS0_12RowProjectorESt14default_deleteIS6_EEENKUlvE_clEv
> @ 0x7f71d4813e72
> _ZNSt17_Function_handlerIFvvEZN4kudu7codegen18CompilationManager19RequestRowProjectorEPKNS1_6SchemaES6_PSt10unique_ptrINS2_12RowProjectorESt14default_deleteIS8_EEEUlvE_E9_M_invokeERKSt9_Any_data
> @ 0x452430 std::function<>::operator()()
> @ 0x7f71d3d98648 kudu::ThreadPool::DispatchThread()
> @ 0x7f71d3d98ee9 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv
> @ 0x7f71d3d9a6a0
> _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data
> @ 0x452430 std::function<>::operator()()
> @ 0x7f71d3d89482 kudu::Thread::SuperviseThread()
> @ 0x7f71d41e96ea start_thread
> {noformat}
> From the stack frame, it seems that __deregister_frame is probably being fed
> some invalid input that is already de-initialised before calling the
> __deregister_frame.
> We seem to be hitting this assert:
> [https://github.com/gcc-mirror/gcc/blob/65e2c932019b4e36d7c1d49952dc006fa7419a3d/libgcc/unwind-dw2-fde.c#L291C11-L291C11]
> {noformat}
> gcc_assert (in_shutdown || ob);
> {noformat}
> Similar stack traces are reported on RHEL9 x86_64 platform once updating
> {{glibc}} up to 11.5.0-11 version, but instead of SIGABRT triggered by the
> assertion, kudu-tserver would crash with SIGSEGV while de-referencing a null
> pointer. In addition, on RHEL8 x86_64 running {{codegen-test}} doesn't
> trigger the crash, but rather particular workloads running against Kudu
> cluster trigger the issue. Two examples are below.
> {noformat}
> *** SIGSEGV (@0x0) received by PID 164812 (TID 0x7fdf8b177640) from PID 0;
> stack trace: ***
> @ 0xb6a837 google::(anonymous namespace)::FailureSignalHandler()
> @ 0x7fdfcf23fc30 (unknown)
> @ 0x7fdfcffdec5d (unknown)
> @ 0x7fdfcffdfa08 (unknown)
> @ 0x7fdfcffe0fec __deregister_frame_info_bases
> @ 0x7fdfcffe1029 __deregister_frame
> @ 0x10b9b20 llvm::RTDyldMemoryManager::deregisterEHFrames()
> @ 0x10a0df9 llvm::MCJIT::~MCJIT()
> @ 0x10a1592 llvm::MCJIT::~MCJIT()
> @ 0xe080f2 kudu::codegen::JITWrapper::~JITWrapper()
> @ 0xe06804
> kudu::codegen::RowProjectorFunctions::~RowProjectorFunctions()
> @ 0x2bf6138 kudu::(anonymous
> namespace)::CacheShard<>::FreeEntry()
> @ 0x2bf6a8f kudu::(anonymous namespace)::CacheShard<>::Insert()
> @ 0x2bf6e4a kudu::(anonymous namespace)::ShardedCache<>::Insert()
> @ 0xe06f13 kudu::codegen::CodeCache::AddEntry()
> @ 0xdfe447 kudu::codegen::(anonymous
> namespace)::CompilationTask::Run()
> @ 0x2cc53c1 kudu::ThreadPool::DispatchThread()
> @ 0x2cbafc3 kudu::Thread::SuperviseThread()
> @ 0x7fdfcf28b2ea start_thread
> @ 0x7fdfcf3103c0 __clone3
> {noformat}
> {noformat}
> *** SIGSEGV (@0x0) received by PID 138135 (TID 0x7fc277d56640) from PID 0;
> stack trace: ***
> @ 0xb6a837 google::(anonymous namespace)::FailureSignalHandler()
> @ 0x7fc2bb63fc30 (unknown)
> @ 0x7fc2bc446c5d (unknown)
> @ 0x7fc2bc4473af (unknown)
> @ 0x10b9f51 llvm::RTDyldMemoryManager::registerEHFrames()
> @ 0x10cc2af llvm::RuntimeDyldELF::registerEHFrames()
> @ 0x109fbe1 llvm::MCJIT::finalizeLoadedModules()
> @ 0x10a0165 llvm::MCJIT::finalizeObject()
> @ 0xe0b0c8 kudu::codegen::ModuleBuilder::Compile()
> @ 0xe05a28 kudu::codegen::RowProjectorFunctions::Create()
> @ 0xe07214 kudu::codegen::CodeGenerator::CompileRowProjector()
> @ 0xdfe3a3 kudu::codegen::(anonymous
> namespace)::CompilationTask::Run()
> @ 0x2cc53c1 kudu::ThreadPool::DispatchThread()
> @ 0x2cbafc3 kudu::Thread::SuperviseThread()
> @ 0x7fc2bb68b2ea start_thread
> @ 0x7fc2bb7103c0 __clone3
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
