[
https://issues.apache.org/jira/browse/IMPALA-14079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Riza Suminto reassigned IMPALA-14079:
-------------------------------------
Assignee: Riza Suminto
> Catalog hits TSAN error during dataload
> ---------------------------------------
>
> Key: IMPALA-14079
> URL: https://issues.apache.org/jira/browse/IMPALA-14079
> Project: IMPALA
> Issue Type: Bug
> Components: Catalog
> Affects Versions: Impala 5.0.0
> Reporter: Joe McDonnell
> Assignee: Riza Suminto
> Priority: Blocker
>
> The TSAN job is failing during dataload with this error in the catalogd ERROR
> log:
> {noformat}
> WARNING: ThreadSanitizer: data race (pid=25180)
> Read of size 1 at 0x7b10000bd0f0 by thread T84:
> #0
> impala::CatalogServiceThriftIf::AcceptRequest(impala::CatalogServiceVersion::type)
>
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/catalog/catalog-server.cc:566:28
> (impalad+0x2107287)
> #1 impala::CatalogServiceThriftIf::ExecDdl(impala::TDdlExecResponse&,
> impala::TDdlExecRequest const&)
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/catalog/catalog-server.cc:348:21
> (impalad+0x2104302)
> #2
> impala::CatalogServiceProcessorT<apache::thrift::protocol::TDummyProtocol>::process_ExecDdl(int,
> apache::thrift::protocol::TProtocol*, apache::thrift::protocol::TProtocol*,
> void*)
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/generated-sources/gen-cpp/CatalogService.tcc:3172:13
> (impalad+0x2017d63)
> #3
> impala::CatalogServiceProcessorT<apache::thrift::protocol::TDummyProtocol>::dispatchCall(apache::thrift::protocol::TProtocol*,
> apache::thrift::protocol::TProtocol*, std::__cxx11::basic_string<char,
> std::char_traits<char>, std::allocator<char> > const&, int, void*)
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/generated-sources/gen-cpp/CatalogService.tcc:3124:3
> (impalad+0x2021822)
> #4
> apache::thrift::TDispatchProcessor::process(std::shared_ptr<apache::thrift::protocol::TProtocol>,
> std::shared_ptr<apache::thrift::protocol::TProtocol>, void*)
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc10.4.0/thrift-0.16.0-p7/include/thrift/TDispatchProcessor.h:121:12
> (impalad+0x202159e)
> #5 apache::thrift::server::TAcceptQueueServer::Task::run()
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/rpc/TAcceptQueueServer.cpp:84:26
> .(impalad+0x265a5b4)
> ...
> p1/libs/thread/src/pthread/thread.cpp:179:37 (impalad+0x3c80856) Previous
> write of size 1 at 0x7b10000bd0f0 by thread T82:
> #0
> impala::CatalogServiceThriftIf::AcceptRequest(impala::CatalogServiceVersion::type)
>
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/catalog/catalog-server.cc:571:36
> (impalad+0x2107309)
> #1 impala::CatalogServiceThriftIf::ExecDdl(impala::TDdlExecResponse&,
> impala::TDdlExecRequest const&)
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/catalog/catalog-server.cc:348:21
> (impalad+0x2104302)
> #2
> impala::CatalogServiceProcessorT<apache::thrift::protocol::TDummyProtocol>::process_ExecDdl(int,
> apache::thrift::protocol::TProtocol*, apache::thrift::protocol::TProtocol*,
> void*)
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/generated-sources/gen-cpp/CatalogService.tcc:3172:13
> (impalad+0x2017d63)
> #3
> impala::CatalogServiceProcessorT<apache::thrift::protocol::TDummyProtocol>::dispatchCall(apache::thrift::protocol::TProtocol*,
> apache::thrift::protocol::TProtocol*, std::__cxx11::basic_string<char,
> std::char_traits<char>, std::allocator<char> > const&, int, void*)
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/generated-sources/gen-cpp/CatalogService.tcc:3124:3
> (impalad+0x2021822)
> #4
> apache::thrift::TDispatchProcessor::process(std::shared_ptr<apache::thrift::protocol::TProtocol>,
> std::shared_ptr<apache::thrift::protocol::TProtocol>, void*)
> /data/jenkins/workspace/impala-asf-master-core-tsan/Impala-Toolchain/toolchain-packages-gcc10.4.0/thrift-0.16.0-p7/include/thrift/TDispatchProcessor.h:121:12
> (impalad+0x202159e)
> #5 apache::thrift::server::TAcceptQueueServer::Task::run()
> /data/jenkins/workspace/impala-asf-master-core-tsan/repos/Impala/be/src/rpc/TAcceptQueueServer.cpp:84:26
> (impalad+0x265a5b4){noformat}
> It looks like a race on has_initiated_first_reset_ and came in with
> "IMPALA-13850 (part 2): Fix bug found by test_restart_services.py".
> has_initiated_first_reset_ could be made into a std::atomic<bool>.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
