Hi Mich,
Thanks for the suggestions. I checked the documentation regarding the issue
in data types and found that the different timezone settings being used in
spark & snowflake was the issue. Specifying the timezone in spark options
while writing the data to snowflake worked 😁
Documentation link
Hi Varun,
I am no expert on Snowflake, however, the issue you are facing,
particularly if it involves data trimming in a COPY statement and potential
data mismatch, is likely related to how Snowflake handles data ingestion
rather than being directly tied to PySpark. The COPY command in Snowflake
i
