kangkaisen commented on issue #458: Create table error: java.net.SocketTimeoutException: Read timed out URL: https://github.com/apache/incubator-doris/issues/458#issuecomment-463038454 After I debug in our prod env with `pstack` and `gdb`, I found the `start_trash_sweep` operation hold the `_store_lock` mutex. ``` #0 0x00007f957083f855 in __getdents64 () from /lib64/libc.so.6 #1 0x00007f957083f5a6 in readdir_r () from /lib64/libc.so.6 #2 0x000000000159e5ae in boost::filesystem::detail::directory_iterator_increment(boost::filesystem::directory_iterator&, boost::system::error_code*) () #3 0x0000000000c67edc in increment (this=<optimized out>) at /home/kangkaisen/palo/thirdparty/installed/include/boost/filesystem/operations.hpp:939 #4 increment<boost::filesystem::directory_iterator> (f=...) at /home/kangkaisen/palo/thirdparty/installed/include/boost/iterator/iterator_facade.hpp:555 #5 operator++ (this=<optimized out>) at /home/kangkaisen/palo/thirdparty/installed/include/boost/iterator/iterator_facade.hpp:665 #6 increment (ec=0x0, this=0xd7171b960) at /home/kangkaisen/palo/thirdparty/installed/include/boost/filesystem/operations.hpp:1101 #7 increment (this=<synthetic pointer>) at /home/kangkaisen/palo/thirdparty/installed/include/boost/filesystem/operations.hpp:1285 #8 increment<boost::filesystem::recursive_directory_iterator> (f=...) at /home/kangkaisen/palo/thirdparty/installed/include/boost/iterator/iterator_facade.hpp:555 #9 operator++ (this=<synthetic pointer>) at /home/kangkaisen/palo/thirdparty/installed/include/boost/iterator/iterator_facade.hpp:665 #10 doris::OLAPEngine::_get_root_path_capacity (this=this@entry=0x64e7c00, root_path=..., data_used=data_used@entry=0xc7edc1170, disk_available=disk_available@entry=0xc7edc1168) at /home/kangkaisen/palo/be/src/olap/olap_engine.cpp:588 #11 0x0000000000c68512 in doris::OLAPEngine::get_all_root_path_info (this=this@entry=0x64e7c00, root_paths_info=root_paths_info@entry=0x7f9561b09660) at /home/kangkaisen/palo/be/src/olap/olap_engine.cpp:429 #12 0x0000000000c686b3 in doris::OLAPEngine::start_trash_sweep (this=this@entry=0x64e7c00, usage=usage@entry=0x7f9561b0bf58) at /home/kangkaisen/palo/be/src/olap/olap_engine.cpp:1740 #13 0x0000000000c83135 in doris::OLAPEngine::_garbage_sweeper_thread_callback (this=0x64e7c00, arg=arg@entry=0x0) at /home/kangkaisen/palo/be/src/olap/olap_server.cpp:167 #14 0x0000000000c832df in operator() (__closure=<optimized out>) at /home/kangkaisen/palo/be/src/olap/olap_server.cpp:46 #15 __invoke_impl<void, doris::OLAPEngine::_start_bg_worker()::<lambda()> > (__f=...) at /usr/local/include/c++/7.2.0/bits/invoke.h:60 #16 __invoke<doris::OLAPEngine::_start_bg_worker()::<lambda()> > (__fn=...) at /usr/local/include/c++/7.2.0/bits/invoke.h:95 #17 _M_invoke<0> (this=<optimized out>) at /usr/local/include/c++/7.2.0/thread:234 #18 operator() (this=<optimized out>) at /usr/local/include/c++/7.2.0/thread:243 ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
