rluvaton opened a new pull request, #20482:
URL: https://github.com/apache/datafusion/pull/20482

   ## Which issue does this PR close?
   
   N/A
   
   ## Rationale for this change
   
   Looks like from playing around with local tests and debugging memory issue I 
have that `SortMergeJoinStream` wait for all input before start emitting, which 
shouldn't be the case as we can emit early when we have enough data.
   
   also, less memory usage. 
   
   ## What changes are included in this PR?
   
   Trying to fix the issue, not sure yet
   
   ## Are these changes tested?
   
   Manually, will add tests later, just wanna see if something breaks.
   
   ## Are there any user-facing changes?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to