Hi,
目前Doris集群,共3个be节点: # BackendId, Cluster, IP, HostName, HeartbeatPort, BePort, HttpPort, BrpcPort, LastStartTime, LastHeartbeat, Alive, SystemDecommissioned, ClusterDecommissioned, TabletNum, DataUsedCapacity, AvailCapacity, TotalCapacity, UsedPct, MaxDiskUsedPct, Tag, ErrMsg, Version, Status '24929', 'default_cluster', '172.16.0.107', '172.16.0.107', '9050', '9060', '8040', '8060', '2023-05-17 14:14:56', '2023-05-18 17:38:50', 'true', 'false', 'false', '1010', '337.511 MB', '83.906 GB', '196.737 GB', '57.35 %', '57.35 %', '{\"location\" : \"default\"}', '', '1.0.0-rc03-Unknown', '{\"lastSuccessReportTabletsTime\":\"2023-05-18 17:37:52\",\"lastStreamLoadTime\":-1,\"isQueryDisabled\":false,\"isLoadDisabled\":false}' '17795', 'default_cluster', '172.16.0.117', '172.16.0.117', '9050', '9060', '8040', '8060', '2023-05-08 16:03:28', '2023-05-18 17:38:50', 'true', 'false', 'false', '1013', '360.704 MB', '222.378 GB', '491.170 GB', '54.72 %', '54.72 %', '{\"location\" : \"default\"}', '', '1.0.0-rc03-Unknown', '{\"lastSuccessReportTabletsTime\":\"2023-05-18 17:38:49\",\"lastStreamLoadTime\":-1,\"isQueryDisabled\":false,\"isLoadDisabled\":false}' '10004', 'default_cluster', '10.81.182.154', 'kafka-3', '9050', '9060', '8040', '8060', '2023-05-18 09:31:59', '2023-05-18 17:38:50', 'true', 'false', 'false', '1016', '369.245 MB', '276.854 GB', '492.029 GB', '43.73 %', '43.73 %', '{\"location\" : \"default\"}', '', '1.0.0-rc03-Unknown', '{\"lastSuccessReportTabletsTime\":\"2023-05-18 17:38:51\",\"lastStreamLoadTime\":-1,\"isQueryDisabled\":false,\"isLoadDisabled\":false}' 但其中BackendId:24929上的be.INFO日志文件里,持续有下面的日志输出: I0518 17:36:05.396911 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=6bc230bc82a94f35-a79769da172ffa85|query_id=6bc230bc82a94f35-a79769da172ffa83 I0518 17:36:05.396915 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment 6bc230bc82a94f35-a79769da172ffa85 I0518 17:36:05.396919 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=28b3bc92206148d5-a0e25f4fb1b40a96|query_id=28b3bc92206148d5-a0e25f4fb1b40a94 I0518 17:36:05.396921 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment 28b3bc92206148d5-a0e25f4fb1b40a96 I0518 17:36:05.396924 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=ae93e77512a94f47-8408873f80b5d582|query_id=ae93e77512a94f47-8408873f80b5d580 I0518 17:36:05.396929 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment ae93e77512a94f47-8408873f80b5d582 I0518 17:36:05.396930 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=6c58f6baf18b49a5-aeadd3179e0d2eed|query_id=6c58f6baf18b49a5-aeadd3179e0d2eeb I0518 17:36:05.396934 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment 6c58f6baf18b49a5-aeadd3179e0d2eed I0518 17:36:05.396936 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=649fa727844b42e6-92b08819ce34723a|query_id=649fa727844b42e6-92b08819ce347238 I0518 17:36:05.396940 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment 649fa727844b42e6-92b08819ce34723a I0518 17:36:05.396943 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=4424ed8ee3c54ee0-afd22ab0dafa6b7b|query_id=4424ed8ee3c54ee0-afd22ab0dafa6b79 I0518 17:36:05.396961 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment 4424ed8ee3c54ee0-afd22ab0dafa6b7b I0518 17:36:05.396965 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=d760a15665d24b1e-bcb06acecab477aa|query_id=d760a15665d24b1e-bcb06acecab477a8 I0518 17:36:05.396975 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment d760a15665d24b1e-bcb06acecab477aa I0518 17:36:05.396978 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=e86a41ee157346d1-b2308a992b70789c|query_id=e86a41ee157346d1-b2308a992b70789a I0518 17:36:05.396982 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment e86a41ee157346d1-b2308a992b70789c I0518 17:36:05.396986 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment e7f70202644b421f-b2261fb1311b4677 I0518 17:36:05.396988 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=c86575d3d01c45cb-87253971e492a8bc|query_id=c86575d3d01c45cb-87253971e492a8ba I0518 17:36:05.396999 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment c86575d3d01c45cb-87253971e492a8bc I0518 17:36:05.397002 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=e4aceee6b2714fe3-8ebddc7898020087|query_id=e4aceee6b2714fe3-8ebddc7898020085 I0518 17:36:05.397006 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment e4aceee6b2714fe3-8ebddc7898020087 I0518 17:36:05.397008 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=a42b67905e484add-b79cf0df6cf004a4|query_id=a42b67905e484add-b79cf0df6cf004a2 I0518 17:36:05.397012 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment a42b67905e484add-b79cf0df6cf004a4 I0518 17:36:05.397014 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=16146a8bd8e44903-bd75678d28e5cb4a|query_id=16146a8bd8e44903-bd75678d28e5cb48 I0518 17:36:05.397018 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment 16146a8bd8e44903-bd75678d28e5cb4a I0518 17:36:05.397020 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=5672abb85bc4a10-b639f0ef48e0f4d5|query_id=5672abb85bc4a10-b639f0ef48e0f4d3 I0518 17:36:05.397024 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment 5672abb85bc4a10-b639f0ef48e0f4d5 I0518 17:36:05.397027 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=63bb0659fdb84d8e-8ecc711ce17ba3a5|query_id=63bb0659fdb84d8e-8ecc711ce17ba3a3 I0518 17:36:05.397032 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment 63bb0659fdb84d8e-8ecc711ce17ba3a5 I0518 17:36:05.397033 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=6587c3b706fa47e4-9b1dc693c74914a3|query_id=6587c3b706fa47e4-9b1dc693c74914a1 I0518 17:36:05.397037 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment 6587c3b706fa47e4-9b1dc693c74914a3 I0518 17:36:05.397039 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=d6deb96034484789-86303375b113ba5c|query_id=d6deb96034484789-86303375b113ba5a I0518 17:36:05.397043 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment d6deb96034484789-86303375b113ba5c I0518 17:36:06.193006 11056 task_worker_pool.cpp:1621] finish report TASK. master host: 10.81.180.91, port: 9020 I0518 17:36:06.397177 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=a8bc4d5c93424ada-bb42fe5041735e8e|query_id=a8bc4d5c93424ada-bb42fe5041735e8c I0518 17:36:06.397212 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment a8bc4d5c93424ada-bb42fe5041735e8e I0518 17:36:06.397217 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=cb14f1876a334c0c-ae41ab3380725284|query_id=cb14f1876a334c0c-ae41ab3380725282 I0518 17:36:06.397222 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment cb14f1876a334c0c-ae41ab3380725284 I0518 17:36:06.397224 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=7be5cefdff5b4ed6-b8f2da70e7eb5742|query_id=7be5cefdff5b4ed6-b8f2da70e7eb5740 I0518 17:36:06.397270 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment 7be5cefdff5b4ed6-b8f2da70e7eb5742 I0518 17:36:06.397274 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=bd248fc7224c4257-bdd41d570ab75738|query_id=bd248fc7224c4257-bdd41d570ab75736 I0518 17:36:06.397277 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment bd248fc7224c4257-bdd41d570ab75738 I0518 17:36:06.397280 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=6e2dd5d81fad48af-826e25f5bc8f7aa4|query_id=6e2dd5d81fad48af-826e25f5bc8f7aa2 I0518 17:36:06.397284 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment 6e2dd5d81fad48af-826e25f5bc8f7aa4 I0518 17:36:06.397287 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=b138aaa924b349da-bae3b383fd3bb857|query_id=b138aaa924b349da-bae3b383fd3bb855 I0518 17:36:06.397291 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment b138aaa924b349da-bae3b383fd3bb857 I0518 17:36:06.397294 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=ab6b54dd53d54905-bfd04fd3741cf5d2|query_id=ab6b54dd53d54905-bfd04fd3741cf5d0 I0518 17:36:06.397298 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment ab6b54dd53d54905-bfd04fd3741cf5d2 I0518 17:36:06.397300 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=149404f51b284db4-a705ab7a12ae42c5|query_id=149404f51b284db4-a705ab7a12ae42c3 I0518 17:36:06.397305 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment 149404f51b284db4-a705ab7a12ae42c5 I0518 17:36:06.397307 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment e226d848287d4a81-99900b717f2348f8 I0518 17:36:06.397310 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment 582094bb3b11403c-8696e2c76c6a597a I0518 17:36:06.397313 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=8c6a64fd07c94fb4-9d24d5a2c49fff4d|query_id=8c6a64fd07c94fb4-9d24d5a2c49fff4b I0518 17:36:06.397317 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment 8c6a64fd07c94fb4-9d24d5a2c49fff4d I0518 17:36:06.397320 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=4b21b52b66c343a6-9a23ee2e11f14198|query_id=4b21b52b66c343a6-9a23ee2e11f14196 I0518 17:36:06.397323 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment 4b21b52b66c343a6-9a23ee2e11f14198 I0518 17:36:06.397326 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=497615937f12463d-82b4c66ba0fdb6ac|query_id=497615937f12463d-82b4c66ba0fdb6aa I0518 17:36:06.397330 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment 497615937f12463d-82b4c66ba0fdb6ac I0518 17:36:06.397333 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment bca59b60a8764c9e-83ffe4b797fbbbf9 I0518 17:36:06.397336 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=5b4528de294b4661-b6f2b8c761bbf40c|query_id=5b4528de294b4661-b6f2b8c761bbf40a I0518 17:36:06.397339 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment 5b4528de294b4661-b6f2b8c761bbf40c I0518 17:36:06.397342 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=e0faadbfcf944ea7-afd4a1948adaf3eb|query_id=e0faadbfcf944ea7-afd4a1948adaf3e9 I0518 17:36:06.397346 10873 fragment_mgr.cpp:685] FragmentMgr cancel worker going to cancel timeout fragment e0faadbfcf944ea7-afd4a1948adaf3eb I0518 17:36:06.397348 10873 plan_fragment_executor.cpp:611] PlanFragmentExecutor::cancel|instance_id=11aafb3ff5184b6b-90851d6775c393ff|query_id=11aafb3ff5184b6b-90851d6775c393fd 请问,这些timeout的日志,如何确定这些timeout的日志是不是异常,如何能够优化解决,或者让它和其它节点一样,不再持续输出这样的日志? | | 李凯(Don Li) | | ie...@126.com |