I am using applyInPandasWithState in PySpark 3.5.0. I noticed that records with timestamp==NULL are processed (i.e., trigger a call to the stateful function). And, as you would expect, does not advance the watermark.
I am taking advantage of this in my application. My question: Is this a supported feature of Spark? Can I rely on this behavior for my production code? Thanks, Juan
