carloea2 opened a new issue, #8241: URL: https://github.com/apache/texera/issues/8241
### Current behavior Hash-based and range-based shuffle partitioners emit pending tuples during control and state flushes but leave those tuples in their buffers. A later flush sends the same tuples again. Round-robin, broadcast, and one-to-one partitioners already drain their flushed buffers. Before: first flush sends data and control; second flush sends the same data again After: first flush sends data and control; second flush sends only control ### Steps to reproduce On `50321e403c82df299a13deb50a7f9849dd93bdba`, add one tuple to a hash shuffle partitioner and flush the same receiver twice. Observed result: ```text first=['list', 'EmbeddedControlMessage'] second=['list', 'EmbeddedControlMessage'] ``` The same retained-buffer behavior occurs for range shuffle and for state flushes. ### Expected behavior A successful flush should drain only the emitted receiver buffer so tuples cannot be duplicated across control or state boundaries. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
