xy720 opened a new issue #4520:
URL: https://github.com/apache/incubator-doris/issues/4520
**Describe the bug**
There is a 17 column source data:
```
2007397|3|2374|40342|1899|19950627|1-URGENT|0|38|4872892|8942348|8|4483060|76940|6|19950905|SHIP|
2007398|1|24337|186404|904|19970624|5-LOW|0|9|1341360|1405208|3|1301119|89424|8|19970817|SHIP|
2007399|1|11533|117000|1627|19930425|4-NOT
SPECI|0|23|2339100|2268927|3|2268927|61020|0|19930611|SHIP|
...
```
Given the same column terminator '|, broker load determines that it is 18
columns, and spark load determines that it is 17 columns.
**To Reproduce**
Steps to reproduce the behavior:
1. Submit a broker load.
```
load label ssb_db.broker_load_label
(
data infile ("hdfs://ymy-host:port/user/palo/table1")
into table test_tbl
COLUMNS TERMINATED BY "|"
(lo_orderkey, lo_linenumber, lo_custkey, lo_partkey, lo_suppkey,
lo_orderdate, lo_orderpriotity, lo_shippriotity, lo_quantity, lo_extendedprice,
lo_ordtotalprice, lo_discount, lo_revenue, lo_supplycost, lo_tax,
lo_commitdate, lo_shipmode )
)
with broker "doris" ("username" = "test", "password" = "test");
```
2. Submit a spark load.
```
load label ssb_db.spark_load_label
( data infile ("hdfs://ymy-host:port/user/palo/table1")
into table test_tbl
COLUMNS TERMINATED BY "|"
(lo_orderkey, lo_linenumber, lo_custkey, lo_partkey, lo_suppkey,
lo_orderdate, lo_orderpriotity, lo_shippriotity, lo_quantity, lo_extendedprice,
lo_ordtotalprice, lo_discount, lo_revenue, lo_supplycost, lo_tax,
lo_commitdate, lo_shipmode )
) with resource "spark0"
("spark.executor.memory" = "24g", "spark.executor.cores" = "2",
"spark.executor.instances" = "8");
```
3. Broker Load will report an error "quality not good enough to cancel"
**Expected behavior**
The number of columns in broker load and spark load should be the same.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
