Hi all, I am experiencing a date field formatting issue when loading data from an Hive table in Spark via Spark Connect (On AWS EMR cluster) using R sparklyr package. The date field is converted to a char type, where as the same field is loaded as a date type when using our On-Premise Spark with YARN connected to the same On-Premise Hive table.
Could you please advise on how to ensure that the date fields are loaded in their native date type format when using Spark Connect? Thanks, Elango
