是不是你有fe没有升级?偶尔会把查询发送到没升级的fe上就报错了。如果升级了,不应该有default_cluster才对。

崔苗(联通集团西安软件研究院) <cui...@chinaunicom.cn> 于2024年2月20日周二 11:10写道:

> 1、问题描述
> spark-doris-connector 读取doris中存在的表,偶发报错如下:
> Doris FE's response cannot map to schema. res:
> {"exception":"requested database and table must consistent with sql:
> request
> [ default_cluster:public_sms.dwd_r_smcontrol_rule]and sql
> [public_sms.dwd_r_smcontrol_rule]","status":400}
> 无需修改代码,重试后又可以正常读取表的数据
>
> 2、版本信息
> doris 版本:doris-2.0.4-rc05
> spark 版本:3.3.1
> spark-doris-connector版本:
> <dependency>
>     <groupId>org.apache.doris</groupId>
>     <artifactId>spark-doris-connector-3.4_2.12</artifactId>
>     <version>1.3.1</version>
>     <scope>provided</scope>
> </dependency>
>
> 3、表结构如下:
> create TABLE dwd_r_smcontrol_rule(
> `region_code` VARCHAR(10) NOT NULL COMMENT "省分ID",
> `sms_type` VARCHAR(10) NOT NULL COMMENT "短信类型",
> `id` int NOT NULL,
> `day_contact_frequency` int NOT NULL COMMENT "每天接触频次",
> `week_contact_frequency` int NOT NULL COMMENT "每周接触频次",
> `month_contact_frequency` int NOT NULL COMMENT "每月接触频次",
> `no_disturb_list` VARCHAR(50)  NULL COMMENT "免打扰名单",
> `am_send_start_time` VARCHAR(50)  NULL COMMENT "上午发送开始时间",
> `am_send_stop_time` VARCHAR(50)  NULL COMMENT "上午发送结束时间",
> `pm_send_start_time` VARCHAR(50)  NULL COMMENT "下午发送开始时间",
> `pm_send_stop_time` VARCHAR(50)  NULL COMMENT "下午发送结束时间",
> `update_time` datetime NULL DEFAULT CURRENT_TIMESTAMP COMMENT "更新时间"
> ) ENGINE = OLAP
> UNIQUE KEY(`region_code`,`sms_type`)
> COMMENT "频次配置表"
> DISTRIBUTED BY HASH(`REGION_CODE`) BUCKETS 1
> PROPERTIES (
>   "replication_allocation" = "tag.location.default: 3"
> );
>
> 5、read代码:
> val data = spark.read.format("doris")
>       .option("doris.table.identifier", table)
>       .option("doris.fenodes", map.get("fenodes"))
>       .option("user", map.get("user"))
>       .option("password", map.get("password"))
>       .option("doris.request.tablet.size",10)
>       .option("doris.batch.size",10000)
>       .load()
>
> 如果您错误接收了该邮件,请通过电子邮件立即通知我们。请回复邮件到 
> hqs-s...@chinaunicom.cn,即可以退订此邮件。我们将立即将您的信息从我们的发送目录中删除。
> If you have received this email in error please notify us immediately by
> e-mail. Please reply to hqs-s...@chinaunicom.cn ,you can unsubscribe from
> this mail. We will immediately remove your information from send catalogue
> of our.
>

Reply via email to