pan3793 commented on issue #7664: URL: https://github.com/apache/kyuubi/issues/7664#issuecomment-5427190687
it sounds like you are using KSHC in an unsupported way > The current implementation has some limitations: > > the catalog configuration must be present on the Spark application bootstrap, which means the catalog configurations should be set in `spark-defaults.conf` or append as `--conf` like: > ``` > spark-[shell|submit] \ > --conf spark.sql.catalog.xxx=org.apache.kyuubi.spark.connector.hive.HiveTableCatalog > --conf spark.sql.catalog.xxx.hive.abc=xyz > ``` > > note: `spark-sql` may not work properly, because of some tricky code inside Spark ... > > but does not work for dynamic registering through SET statement, e.g. `SET spark.sql.catalog.xxx=` see more details at https://github.com/apache/kyuubi/pull/4560 and seems our KSHC docs are outdated, @maomaodev are you interested in updating it to mention the above limitation and include your recent improvements? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
