Re: How to disable 'spark.security.credentials.${service}.enabled' in Structured streaming while connecting to a kafka cluster

Hi Gabor, Thanks for the reply. Yes, I have created a JIRA here and have added the details over there - https://issues.apache.org/jira/browse/SPARK-30495 Please let me know if that is the right place to create it. If not, where should I be creating it ? Also would like to know, whether it is ma

Re: How to disable 'spark.security.credentials.${service}.enabled' in Structured streaming while connecting to a kafka cluster

Hi Gabor, Thanks for the reply. Yes, I have created a JIRA here and have added the details over there - https://issues.apache.org/jira/browse/SPARK-30495 Please let me know if that is the right place to create it. If not, where should I be

RE: [Spark Structured Streaming] Getting all the data in flatMapGroup

Let me rephrase the question more succinctly. I have a 1. Aggregation (sum) with a groupBy on a column (facetId) and a eventtime window (1 minute) followed by 2. groupByKey on the column and flatMapGroup I am expecting the flatMapGroup function to be called with all the time windows when