Hi All When trying to read a stream off S3 and I try and drop duplicates I get the following error:
Exception in thread "main" org.apache.spark.sql.AnalysisException: Append output mode not supported when there are streaming aggregations on streaming DataFrames/DataSets;; Whats strange if I use the batch "spark.read.json", it works Can I assume you cant drop duplicates in structured streaming Regards Sam