NoSuchElementException when trying to use dataset

My code throw an exception when I am trying to create new DataSet from within SteamWriter sink Simplified version of the code   val df = sparkSession.readStream     .format("json")     .option("nullValue", " ")     .option("headerFlag", "true")     .option("spark.sql.shuffle.partitions", 1)

java.util.NoSuchElementException when trying to use dataset from worker

My code throws an exception when I am trying to create new DataSet from within SteamWriter sink Simplified version of the code   val df = sparkSession.readStream     .format("json")     .option("nullValue", " ")     .option("headerFlag", "true")     .option("spark.sql.shuffle.partitions", 1