What is your Doris version?
-- 此致！Best Regards 陈明雨 Mingyu Chen Email: morning...@apache.org At 2023-02-13 09:35:50, "" <2...@winnermedical.com> wrote: > >您好！ > 我这边在使用broker load进行导入到doris时，一直存在会把be节点搞宕机，一直没有定位到关键问题。还请帮忙看一下问题 >问题报错：be.out文件内容 >terminate called after throwing an instance of 'orc::ParseError' > what(): Failed to read > hdfs://DATALAKE/warehouse/tablespace/managed/hive/test_winner_grp.db/ads_mpc_goods_sale_rt_pt_d_incr/part-00126-36dd66ba-a6a2-4625-ac38-0fc6cb2228c2-c000: > Internal error: Read from broker failed, > broker:TNetworkAddress(hostname=10.49.146.24, port=8000) failed:errors while > write data to output stream, cause by: Filesystem closed >*** Query id: 4360764793334480-9a89563a04dfc99b *** >*** Aborted at 1676191418 (unix time) try "date -d @1676191418" if you are >using GNU date *** >*** Current BE git commitID: Unknown *** >*** SIGABRT unkown detail explain (@0x1db2) received by PID 7602 (TID >0x7f28a59f9700) from PID 7602; stack trace: *** > 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, > siginfo_t*, void*) at /root/doris/be/src/common/signal_handler.h:420 > 1# 0x00007F291215F3B0 in /lib64/libc.so.6 > 2# gsignal in /lib64/libc.so.6 > 3# __GI_abort in /lib64/libc.so.6 > 4# __gnu_cxx::__verbose_terminate_handler() [clone .cold] in > /data/doris-1.2.1/be/lib/doris_be > 5# __cxxabiv1::__terminate(void (*)()) in /data/doris-1.2.1/be/lib/doris_be > 6# 0x0000564F1207B7C1 in /data/doris-1.2.1/be/lib/doris_be > 7# 0x0000564F1207B915 in /data/doris-1.2.1/be/lib/doris_be > 8# doris::vectorized::ORCFileInputStream::read(void*, unsigned long, unsigned > long) [clone .cold] at > /root/doris/be/src/vec/exec/format/orc/vorc_reader.cpp:67 > 9# orc::SeekableFileInputStream::Next(void const**, int*) in > /data/doris-1.2.1/be/lib/doris_be >10# orc::DecompressionStream::readBuffer(bool) in >/data/doris-1.2.1/be/lib/doris_be >11# orc::DecompressionStream::readHeader() in /data/doris-1.2.1/be/lib/doris_be >12# orc::DecompressionStream::Next(void const**, int*) in >/data/doris-1.2.1/be/lib/doris_be >13# orc::RleDecoderV2::next(long*, unsigned long, char const*) in >/data/doris-1.2.1/be/lib/doris_be >14# orc::StringDictionaryColumnReader::next(orc::ColumnVectorBatch&, unsigned >long, char*) in /data/doris-1.2.1/be/lib/doris_be >15# orc::StructColumnReader::next(orc::ColumnVectorBatch&, unsigned long, >char*) in /data/doris-1.2.1/be/lib/doris_be >16# orc::RowReaderImpl::next(orc::ColumnVectorBatch&) in >/data/doris-1.2.1/be/lib/doris_be >17# doris::vectorized::OrcReader::get_next_block(doris::vectorized::Block*, >unsigned long*, bool*) at >/root/doris/be/src/vec/exec/format/orc/vorc_reader.cpp:747 >18# doris::vectorized::VFileScanner::_get_block_impl(doris::RuntimeState*, >doris::vectorized::Block*, bool*) at >/root/doris/be/src/vec/exec/scan/vfile_scanner.cpp:148 >19# doris::vectorized::VScanner::get_block(doris::RuntimeState*, >doris::vectorized::Block*, bool*) at >/root/doris/be/src/vec/exec/scan/vscanner.cpp:53 >20# >doris::vectorized::ScannerScheduler::_scanner_scan(doris::vectorized::ScannerScheduler*, > doris::vectorized::ScannerContext*, doris::vectorized::VScanner*) at >/root/doris/be/src/vec/exec/scan/scanner_scheduler.cpp:234 >21# doris::ThreadPool::dispatch_thread() at >/root/doris/be/src/util/threadpool.cpp:542 >22# doris::Thread::supervise_thread(void*) at >/root/doris/be/src/util/thread.cpp:455 >23# start_thread in /lib64/libpthread.so.0 >24# clone in /lib64/libc.so.6 > >be.warn文件内容： >W0212 16:43:38.025727 7742 broker_reader.cpp:186] Read from broker failed, >broker:TNetworkAddress(hostname=10.49.146.24, port=8000) failed:errors while >write data to output stream, cause by: Filesystem closed >W0212 16:43:50.535388 21144 cumulative_compaction.cpp:112] There are missed >versions among rowsets. prev rowset verison=[34235-34235], next rowset >version=[34237-34237], >tablet=1020778.276917532.244d8cd50094d83d-2beda143c376479f >W0212 16:43:50.837388 21144 cumulative_compaction.cpp:112] There are missed >versions among rowsets. prev rowset verison=[34235-34235], next rowset >version=[34237-34237], >tablet=1020802.276917532.044fcb9d5a58f77c-eb728622f29998b6 >W0212 16:43:50.862862 21144 cumulative_compaction.cpp:112] There are missed >versions among rowsets. prev rowset verison=[34235-34235], next rowset >version=[34237-34237], >tablet=1020774.276917532.c044d2bf26a96a16-ab8648340b12a0be >W0212 16:43:51.010138 21144 cumulative_compaction.cpp:112] There are missed >versions among rowsets. prev rowset verison=[34181-34235], next rowset >version=[34237-34237], >tablet=1020810.276917532.8b4f63370dad3890-cb5a5c4c41153f83 >W0212 16:43:51.035369 21144 cumulative_compaction.cpp:112] There are missed >versions among rowsets. prev rowset verison=[34205-34235], next rowset >version=[34237-34237], >tablet=1020798.276917532.e445a13b3295045e-4cb1238f530625bb >W0212 16:43:52.992830 21144 cumulative_compaction.cpp:112] There are missed >versions among rowsets. prev rowset verison=[34235-34235], next rowset >version=[34237-34237], >tablet=1020806.276917532.9d49f167f61a32a2-de4d451374a47cae >W0212 16:43:53.043406 21144 cumulative_compaction.cpp:112] There are missed >versions among rowsets. prev rowset verison=[34235-34235], next rowset >version=[34237-34237], >tablet=1020790.276917532.ec474f9b9e3b27fd-d96c05d874ce9186 >W0212 16:43:53.068686 21144 cumulative_compaction.cpp:112] There are missed >versions among rowsets. prev rowset verison=[34235-34235], next rowset >version=[34237-34237], >tablet=1020786.276917532.89454e3d2fe4a0c2-6a494ce8f603a5ba >W0212 16:43:55.564836 21144 cumulative_compaction.cpp:112] There are missed >versions among rowsets. prev rowset verison=[34235-34235], next rowset >version=[34237-34237], >tablet=1020778.276917532.244d8cd50094d83d-2beda143c376479f >W0212 16:43:55.860325 21144 cumulative_compaction.cpp:112] There are missed >versions among rowsets. prev rowset verison=[34235-34235], next rowset >version=[34237-34237], >tablet=1020802.276917532.044fcb9d5a58f77c-eb728622f29998b6 >W0212 16:43:55.885744 21144 cumulative_compaction.cpp:112] There are missed >versions among rowsets. prev rowset verison=[34235-34235], next rowset >version=[34237-34237], >tablet=1020774.276917532.c044d2bf26a96a16-ab8648340b12a0be >W0212 16:43:56.029886 21144 cumulative_compaction.cpp:112] There are missed >versions among rowsets. prev rowset verison=[34181-34235], next rowset >version=[34237-34237], >tablet=1020810.276917532.8b4f63370dad3890-cb5a5c4c41153f83 >W0212 16:43:56.054003 21144 cumulative_compaction.cpp:112] There are missed >versions among rowsets. prev rowset verison=[34205-34235], next rowset >version=[34237-34237], >tablet=1020798.276917532.e445a13b3295045e-4cb1238f530625bb >W0212 16:43:58.011371 21144 cumulative_compaction.cpp:112] There are missed >versions among rowsets. prev rowset verison=[34235-34235], next rowset >version=[34237-34237], >tablet=1020806.276917532.9d49f167f61a32a2-de4d451374a47cae >W0212 16:43:58.062548 21144 cumulative_compaction.cpp:112] There are missed >versions among rowsets. prev rowset verison=[34235-34235], next rowset >version=[34237-34237], >tablet=1020790.276917532.ec474f9b9e3b27fd-d96c05d874ce9186 >W0212 16:43:58.088730 21144 cumulative_compaction.cpp:112] There are missed >versions among rowsets. prev rowset verison=[34235-34235], next rowset >version=[34237-34237], >tablet=1020786.276917532.89454e3d2fe4a0c2-6a494ce8f603a5ba > > >be.log日志文件较大不方便粘贴 ，还请帮忙协助一下 >感谢！ > >________________________________________ >发件人: dev-h...@doris.apache.org <dev-h...@doris.apache.org> >发送时间: 2023年2月13日 9:19 >收件人: 章志诚 >主题: ?????????????confirm subscribe to dev@doris.apache.org > >Hi! This is the ezmlm program. I'm managing the >dev@doris.apache.org mailing list. > >I'm working for my owner, who can be reached >at dev-ow...@doris.apache.org. > >To confirm that you would like > > 2...@winnermedical.com > >added to the dev mailing list, please send >a short reply to this address: > > > dev-sc.1676251145.higodnbanpnlnbbodjok-2265=winnermedical....@doris.apache.org > >Usually, this happens when you just hit the "reply" button. >If this does not work, simply copy the address and paste it into >the "To:" field of a new message. > >or click here: > > mailto:dev-sc.1676251145.higodnbanpnlnbbodjok-2265=winnermedical....@doris.apache.org > >This confirmation serves two purposes. First, it verifies that I am able >to get mail through to you. Second, it protects you in case someone >forges a subscription request in your name. > >Please note that ALL Apache dev- and user- mailing lists are publicly >archived. Do familiarize yourself with Apache's public archive policy at > > http://www.apache.org/foundation/public-archives.html > >prior to subscribing and posting messages to dev@doris.apache.org. >If you're not sure whether or not the policy applies to this mailing list, >assume it does unless the list name contains the word "private" in it. > >Some mail programs are broken and cannot handle long addresses. If you >cannot reply to this request, instead send a message to ><dev-requ...@doris.apache.org> and put the >entire address listed above into the "Subject:" line. > > >--- Administrative commands for the dev list --- > >I can handle administrative requests automatically. Please >do not send them to the list address! Instead, send >your message to the correct command address: > >To subscribe to the list, send a message to: > <dev-subscr...@doris.apache.org> > >To remove your address from the list, send a message to: > <dev-unsubscr...@doris.apache.org> > >Send mail to the following for info and FAQ for this list: > <dev-i...@doris.apache.org> > <dev-...@doris.apache.org> > >Similar addresses exist for the digest list: > <dev-digest-subscr...@doris.apache.org> > <dev-digest-unsubscr...@doris.apache.org> > >To get messages 123 through 145 (a maximum of 100 per request), mail: > <dev-get.123_...@doris.apache.org> > >To get an index with subject and author for messages 123-456 , mail: > <dev-index.123_...@doris.apache.org> > >They are always returned as sets of 100, max 2000 per request, >so you'll actually get 100-499. > >To receive all messages with the same subject as message 12345, >send a short message to: > <dev-thread.12...@doris.apache.org> > >The messages should contain one line or word of text to avoid being >treated as sp@m, but I will ignore their content. >Only the ADDRESS you send to is important. > >You can start a subscription for an alternate address, >for example "john@host.domain", just add a hyphen and your >address (with '=' instead of '@') after the command word: ><dev-subscribe-john=host.dom...@doris.apache.org> > >To stop subscription for this address, mail: ><dev-unsubscribe-john=host.dom...@doris.apache.org> > >In both cases, I'll send a confirmation message to that address. When >you receive it, simply reply to it to complete your subscription. > >If despite following these instructions, you do not get the >desired results, please contact my owner at >dev-ow...@doris.apache.org. Please be patient, my owner is a >lot slower than I am ;-) > >--- Enclosed is a copy of the request I received. > >Return-Path: <2...@winnermedical.com> >Received: (qmail 237756 invoked by uid 116); 13 Feb 2023 01:19:04 -0000 >Received: from spamproc1-he-de.apache.org (HELO spamproc1-he-de.apache.org) >(116.203.196.100) > by apache.org (qpsmtpd/0.94) with ESMTP; Mon, 13 Feb 2023 01:19:04 +0000 >Authentication-Results: apache.org; auth=none >Received: from localhost (localhost [127.0.0.1]) > by spamproc1-he-de.apache.org (ASF Mail Server at > spamproc1-he-de.apache.org) with ESMTP id D477D1FF6C3 > for <dev-subscr...@doris.apache.org>; Mon, 13 Feb 2023 01:19:04 +0000 > (UTC) >X-Virus-Scanned: Debian amavisd-new at spamproc1-he-de.apache.org >X-Spam-Flag: NO >X-Spam-Score: 3.924 >X-Spam-Level: *** >X-Spam-Status: No, score=3.924 tagged_above=-999 required=6.31 > tests=[HTML_MESSAGE=0.2, MPART_ALT_DIFF=0.724, > RCVD_IN_DNSWL_BLOCKED=0.001, RDNS_NONE=3, SPF_PASS=-0.001] > autolearn=disabled >Received: from mx1-ec2-va.apache.org ([116.203.227.195]) > by localhost (spamproc1-he-de.apache.org [116.203.196.100]) > (amavisd-new, port 10024) > with ESMTP id ypJns8XRVylS for <dev-subscr...@doris.apache.org>; > Mon, 13 Feb 2023 01:19:04 +0000 (UTC) >Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=103.194.244.106; >helo=spam.winnermedical.com; envelope-from=2...@winnermedical.com; >receiver=<UNKNOWN> >Received: from spam.winnermedical.com (unknown [103.194.244.106]) > by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) > with ESMTP id 5385FBCA28 > for <dev-subscr...@doris.apache.org>; Mon, 13 Feb 2023 01:19:01 +0000 > (UTC) >Received: from SR-MBX-01.winnermedical.com ([172.16.100.30]) > by spam.winnermedical.com with ESMTPS id 31D1IM8w074938 > (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=FAIL) > for <dev-subscr...@doris.apache.org>; Mon, 13 Feb 2023 09:18:22 +0800 > (GMT-8) > (envelope-from 2...@winnermedical.com) >Received: from SR-MBX-02.winnermedical.com (172.16.100.32) by > SR-MBX-01.winnermedical.com (172.16.100.30) with Microsoft SMTP Server (TLS) > id 15.0.1497.2; Mon, 13 Feb 2023 09:18:22 +0800 >Received: from SR-MBX-02.winnermedical.com ([fe80::68de:3d29:2c94:cc8a]) by > SR-MBX-02.winnermedical.com ([fe80::68de:3d29:2c94:cc8a%18]) with mapi id > 15.00.1497.000; Mon, 13 Feb 2023 09:18:22 +0800 >From: <2...@winnermedical.com> >To: <dev-subscr...@doris.apache.org> >Subject: =?gb2312?B?ZG9yaXO1xGJlvdq14+W0u/o=?= >Thread-Topic: =?gb2312?B?ZG9yaXO1xGJlvdq14+W0u/o=?= >Thread-Index: AQHZP0kQY6g1r6ny0U2uaQQ6QD8VsQ== >Date: Mon, 13 Feb 2023 01:18:21 +0000 >Message-ID: <8e24767e4dea49b88d0e655311aaf...@sr-mbx-02.winnermedical.com> >Accept-Language: zh-CN, en-US >Content-Language: zh-CN >X-MS-Has-Attach: >X-MS-TNEF-Correlator: >x-ms-exchange-transport-fromentityheader: Hosted >x-originating-ip: [10.10.48.13] >Content-Type: multipart/alternative; > > boundary="_000_8e24767e4dea49b88d0e655311aaf370SRMBX02winnermedicalcom_" >MIME-Version: 1.0 >X-DNSRBL: >X-SPAM-SOURCE-CHECK: pass >X-MAIL:spam.winnermedical.com 31D1IM8w074938 > > >--------------------------------------------------------------------- >To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org >For additional commands, e-mail: dev-h...@doris.apache.org >
