If you know your json schema you can create a struct and then apply that using from_json:
val json_schema = StructType(Array(StructField(“x”, StringType, true), StructField(“y”, StringType, true), StructField(“z”, IntegerType, true))) .withColumn("_c3", from_json(col("_c3_signals"),json_schema)) From: Nirav Patel <npa...@xactlycorp.com> Date: Thursday, August 30, 2018 at 7:19 PM To: spark users <user@spark.apache.org> Subject: CSV parser - how to parse column containing json data Is there a way to parse csv file with some column in middle containing json data structure? "a",102,"c","{"x":"xx","y":false,"z":123}","d","e",102.2 Thanks, Nirav