Hi Yogesh,
It would be easier to help if you included your code and the exact error
messages that occur. If you are creating a Spark DataFrame with a Pandas
DataFrame, then Spark does not read the schema and infers from the data to
make one. This might be the cause of your issue if the schema is
Hi,
I am writing a pyspark streaming job in which i am returning a pandas data
frame as DStream. Now I wanted to save this DStream dataframe to parquet
file. How to do that?
I am trying to convert it to spark data frame but I am getting multiple
errors. Please suggest me how to do that.
Regards,
