Re: Spark on K8s : property simillar to yarn.max.application.attempt

Hi Pralabh, I understand that this is a question more related to K8s than to Spark itself. In K8s you have a set of objects to control the state of your pods, which allow you, among other things, to redeploy pods that have failed. This would apply to the pod containing the driver container. https:

Re: Difference in behavior for Spark 3.0 vs Spark 3.1 "create database "

Hi Pralabh, If it helps, it is probably related to this change https://github.com/apache/spark/pull/28527 Regards On Mon, Jan 10, 2022 at 10:42 AM Pralabh Kumar wrote: > Hi Spark Team > > When creating a database via Spark 3.0 on Hive > > 1) spark.sql("create database test location '/user/hive

regex_column_names users feedback

Hi Spark devs & users, I’m writing to get some feedback from the users of the regex_column_names feature (spark.sql.parser.quotedRegexColumnNames) ( https://spark.apache.org/docs/latest/sql-ref-syntax-qry-select.html) Now, some queries like SELECT `col_.*`/col_b FROM (SELECT 3 AS col_a, 1 as col