Re: Spark with bigquery : Data type issue

2023-02-22 Thread Mich Talebzadeh
Hi, What version of Spark and how are you are writing to GBQ table? Is the source column in ETL has NUMERIC(38) say coming from Oracle? view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it

Re: Spark with bigquery : Data type issue

2023-02-22 Thread nidhi kher
In addition to below Can we cast a column to bignumeric in spark sql dataframe like below code for decimal: df= spark.sql("""SELECT cast(col1 as decimal(38,20)) as col1 from table1""") Regards, Nidhi On Wed, 22 Feb 2023 at 9:21 PM, nidhi kher wrote: > Hello, > > I am facing below issue in spar