[
https://issues.apache.org/jira/browse/KUDU-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16414097#comment-16414097
]
Todd Lipcon commented on KUDU-2375:
-----------------------------------
You sure that table 467d365fffbe4485a3249079c48f42a9 is the one you pasted? My
guess is that it's one that has a DECIMAL type column in its 5th (0-indexed)
position, and when you downgrade to 1.6.0 it doesn't know what to make of the
DECIMAL. Agreed the error message and behavior could be a lot better.
[~granthenke] what do you think?
> Can't parse message of type "kudu.master.SysTablesEntryPB" because it is
> missing required fields: schema.columns[5].type
> ------------------------------------------------------------------------------------------------------------------------
>
> Key: KUDU-2375
> URL: https://issues.apache.org/jira/browse/KUDU-2375
> Project: Kudu
> Issue Type: Bug
> Components: master
> Affects Versions: 1.7.0
> Reporter: Michael Brown
> Priority: Blocker
>
> A downgrade from 1.7.0 to 1.6 results in a dcheck when 1.6 starts. I see the
> same dcheck on both 1.6.0 and 1.6.x. A "revert" back to 1.7.0 makes the
> problem go away.
> Although the symptom is in 1.6, I've filed this against 1.7.0 assuming the
> backward incompatibility was not intended.
> {noformat}
> I0324 17:45:10.681015 105716 catalog_manager.cc:306] Loaded metadata for
> table impala::tpcds_1000_kudu.web_returns
> [id=40c35b333fa84bb8ad331fab02e03fdf]
> F0324 17:45:10.681808 105716 catalog_manager.cc:935] Loading table and tablet
> metadata into memory failed: Corruption: Failed while visiting tables in sys
> catalog: unable to parse metadata field for row
> 467d365fffbe4485a3249079c48f42a9: Error parsing msg: Can't parse message of
> type "kudu.master.SysTablesEntryPB" because it is missing required fields:
> schema.columns[5].type
> {noformat}
> {noformat}
> #0 0x0000003355e32625 in raise () from /lib64/libc.so.6
> #1 0x0000003355e33e05 in abort () from /lib64/libc.so.6
> #2 0x0000000001cea129 in ?? ()
> #3 0x00000000009268cd in google::LogMessage::Fail() ()
> #4 0x000000000092878d in google::LogMessage::SendToLog() ()
> #5 0x0000000000926409 in google::LogMessage::Flush() ()
> #6 0x000000000092922f in google::LogMessageFatal::~LogMessageFatal() ()
> #7 0x00000000008f05de in ?? ()
> #8 0x00000000008f6039 in
> kudu::master::CatalogManager::PrepareForLeadershipTask() ()
> #9 0x0000000001d297d7 in kudu::ThreadPool::DispatchThread() ()
> #10 0x0000000001d20151 in kudu::Thread::SuperviseThread(void*) ()
> #11 0x0000003356207aa1 in start_thread () from /lib64/libpthread.so.0
> #12 0x0000003355ee893d in clone () from /lib64/libc.so.6
> {noformat}
> This is on a long-lived cluster that has had Impala and Kudu slowly upgrading
> with mostly dev releases over time for a few months. Here's the Impala {{SHOW
> CREATE TABLE}}:
> {noformat}
> | CREATE TABLE tpcds_1000_kudu.web_returns (
> |
> | wr_returned_date_sk INT NOT NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_order_number BIGINT NOT NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_item_sk BIGINT NOT NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_returned_time_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_refunded_customer_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_refunded_cdemo_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_refunded_hdemo_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_refunded_addr_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_returning_customer_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_returning_cdemo_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_returning_hdemo_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_returning_addr_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_web_page_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_reason_sk INT NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_return_quantity INT NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_return_amt DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_return_tax DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_return_amt_inc_tax DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_fee DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_return_ship_cost DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_refunded_cash DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_reversed_charge DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_account_credit DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | wr_net_loss DOUBLE NULL ENCODING AUTO_ENCODING COMPRESSION
> DEFAULT_COMPRESSION, |
> | PRIMARY KEY (wr_returned_date_sk, wr_order_number, wr_item_sk)
> |
> | )
> |
> | PARTITION BY HASH (wr_order_number, wr_item_sk) PARTITIONS 140
> |
> | STORED AS KUDU
> |
> | TBLPROPERTIES ('STATS_GENERATED_VIA_STATS_TASK'='true',
> 'kudu.master_addresses'='redacted', 'numRows'='68758263') |
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
