Re: [I] A complete solution for stable and safe sort with spill [datafusion]

2025-07-28 Thread via GitHub
2010YOUY01 closed issue #14692: A complete solution for stable and safe sort with spill URL: https://github.com/apache/datafusion/issues/14692 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [I] A complete solution for stable and safe sort with spill [datafusion]

2025-04-07 Thread via GitHub
qstommyshu commented on issue #14692: URL: https://github.com/apache/datafusion/issues/14692#issuecomment-2783589078 Got it @2010YOUY01 , Since you are already working on this issue, I won't do it then. I'll try my best to provides some feedbacks (if there is any). -- This is an au

Re: [I] A complete solution for stable and safe sort with spill [datafusion]

2025-04-05 Thread via GitHub
2010YOUY01 commented on issue #14692: URL: https://github.com/apache/datafusion/issues/14692#issuecomment-2771604094 > > This is a reproducer for an external sort query failure under a very low memory limit [#15028](https://github.com/apache/datafusion/issues/15028) Discord discussion:[dis

Re: [I] A complete solution for stable and safe sort with spill [datafusion]

2025-04-04 Thread via GitHub
qstommyshu commented on issue #14692: URL: https://github.com/apache/datafusion/issues/14692#issuecomment-2771022723 > This is a reproducer for an external sort query failure under a very low memory limit [#15028](https://github.com/apache/datafusion/issues/15028) Discord discussion:[disco

Re: [I] A complete solution for stable and safe sort with spill [datafusion]

2025-04-04 Thread via GitHub
alamb commented on issue #14692: URL: https://github.com/apache/datafusion/issues/14692#issuecomment-2779016719 There is a bunch of work ongoing in this area, most of which is linked from - https://github.com/apache/datafusion/issues/15271 -- This is an automated message from th

Re: [I] A complete solution for stable and safe sort with spill [datafusion]

2025-04-04 Thread via GitHub
qstommyshu commented on issue #14692: URL: https://github.com/apache/datafusion/issues/14692#issuecomment-2778461103 > Thanks @qstommyshu ! I think @2010YOUY01 has been working on this one most recently, so I would recommend checking in with them before coding too mich Sounds good, no

Re: [I] A complete solution for stable and safe sort with spill [datafusion]

2025-04-04 Thread via GitHub
alamb commented on issue #14692: URL: https://github.com/apache/datafusion/issues/14692#issuecomment-2778254506 Thanks @qstommyshu ! I think @2010YOUY01 has been working on this one most recently, so I would recommend checking in with them before coding too mich -- This is an automated

Re: [I] A complete solution for stable and safe sort with spill [datafusion]

2025-04-03 Thread via GitHub
qstommyshu commented on issue #14692: URL: https://github.com/apache/datafusion/issues/14692#issuecomment-2777376142 take -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] A complete solution for stable and safe sort with spill [datafusion]

2025-04-03 Thread via GitHub
qstommyshu commented on issue #14692: URL: https://github.com/apache/datafusion/issues/14692#issuecomment-2777376035 This issue looks interesting to me. I'll try to work on it! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

Re: [I] A complete solution for stable and safe sort with spill [datafusion]

2025-03-17 Thread via GitHub
alamb commented on issue #14692: URL: https://github.com/apache/datafusion/issues/14692#issuecomment-2729485594 I started collecting sort larger than RAM related things here: - https://github.com/apache/datafusion/issues/15271 -- This is an automated message from the Apache Git Service

Re: [I] A complete solution for stable and safe sort with spill [datafusion]

2025-03-05 Thread via GitHub
2010YOUY01 commented on issue #14692: URL: https://github.com/apache/datafusion/issues/14692#issuecomment-2702697221 This is a reproducer for an external sort query failure under a very low memory limit https://github.com/apache/datafusion/issues/15028 Discord discussion:https://discord.

Re: [I] A complete solution for stable and safe sort with spill [datafusion]

2025-02-19 Thread via GitHub
alamb commented on issue #14692: URL: https://github.com/apache/datafusion/issues/14692#issuecomment-2668835909 Thank you for filing this @zhuqi-lucas . I have also added it to our list here - https://github.com/apache/datafusion/issues/14077 -- This is an automated message from the Ap