是不是你有fe没有升级?偶尔会把查询发送到没升级的fe上就报错了。如果升级了,不应该有default_cluster才对。
崔苗(联通集团西安软件研究院) <cui...@chinaunicom.cn> 于2024年2月20日周二 11:10写道: > 1、问题描述 > spark-doris-connector 读取doris中存在的表,偶发报错如下: > Doris FE's response cannot map to schema. res: > {"exception":"requested database and table must consistent with sql: > request > [ default_cluster:public_sms.dwd_r_smcontrol_rule]and sql > [public_sms.dwd_r_smcontrol_rule]","status":400} > 无需修改代码,重试后又可以正常读取表的数据 > > 2、版本信息 > doris 版本:doris-2.0.4-rc05 > spark 版本:3.3.1 > spark-doris-connector版本: > <dependency> > <groupId>org.apache.doris</groupId> > <artifactId>spark-doris-connector-3.4_2.12</artifactId> > <version>1.3.1</version> > <scope>provided</scope> > </dependency> > > 3、表结构如下: > create TABLE dwd_r_smcontrol_rule( > `region_code` VARCHAR(10) NOT NULL COMMENT "省分ID", > `sms_type` VARCHAR(10) NOT NULL COMMENT "短信类型", > `id` int NOT NULL, > `day_contact_frequency` int NOT NULL COMMENT "每天接触频次", > `week_contact_frequency` int NOT NULL COMMENT "每周接触频次", > `month_contact_frequency` int NOT NULL COMMENT "每月接触频次", > `no_disturb_list` VARCHAR(50) NULL COMMENT "免打扰名单", > `am_send_start_time` VARCHAR(50) NULL COMMENT "上午发送开始时间", > `am_send_stop_time` VARCHAR(50) NULL COMMENT "上午发送结束时间", > `pm_send_start_time` VARCHAR(50) NULL COMMENT "下午发送开始时间", > `pm_send_stop_time` VARCHAR(50) NULL COMMENT "下午发送结束时间", > `update_time` datetime NULL DEFAULT CURRENT_TIMESTAMP COMMENT "更新时间" > ) ENGINE = OLAP > UNIQUE KEY(`region_code`,`sms_type`) > COMMENT "频次配置表" > DISTRIBUTED BY HASH(`REGION_CODE`) BUCKETS 1 > PROPERTIES ( > "replication_allocation" = "tag.location.default: 3" > ); > > 5、read代码: > val data = spark.read.format("doris") > .option("doris.table.identifier", table) > .option("doris.fenodes", map.get("fenodes")) > .option("user", map.get("user")) > .option("password", map.get("password")) > .option("doris.request.tablet.size",10) > .option("doris.batch.size",10000) > .load() > > 如果您错误接收了该邮件,请通过电子邮件立即通知我们。请回复邮件到 > hqs-s...@chinaunicom.cn,即可以退订此邮件。我们将立即将您的信息从我们的发送目录中删除。 > If you have received this email in error please notify us immediately by > e-mail. Please reply to hqs-s...@chinaunicom.cn ,you can unsubscribe from > this mail. We will immediately remove your information from send catalogue > of our. >