Re: Query Resource Management and Handling Large Queries in Apache Doris

2025-03-03 Thread Joice Jacob
Hi Shirley and Team, Thank you for the update and for sharing the details regarding the spill-to-disk feature and its inclusion in the upcoming 3.1.0 release. We appreciate the team's efforts in ensuring stability and continuous improvements in Apache Doris. Could you kindly provide an estimated t

Re: Query Resource Management and Handling Large Queries in Apache Doris

2025-03-03 Thread Shirley Hu
Hi Joice, Just confirmed with the team: The code related to the spill-to-disk feature has been merged into the master branch, but after our evaluation, we found that including this work in version 3.0.X could lead to instability, so we plan to release it with our next major release instead, which

Re: Query Resource Management and Handling Large Queries in Apache Doris

2025-02-28 Thread Joice Jacob
Hi shirley and dev team, As we continue our evaluation, we would like to check whether the upcoming *Apache Doris 3.0.4* version includes any improvements related to query execution under constrained resources. Specifically, we are interested in: - Any configuration options or enhancements that

Re: Query Resource Management and Handling Large Queries in Apache Doris

2024-12-19 Thread Joice Jacob
Dear Shirley, Thank you for the update! I appreciate the clarification regarding the release schedule. I’ll plan to give it a spin for testing purposes before the official release. Best regards, Joice On Mon, Dec 16, 2024 at 9:35 AM Shirley Hu wrote: > Hi Joice, > > I just confirmed with @GuoLe

Re: Query Resource Management and Handling Large Queries in Apache Doris

2024-12-15 Thread Shirley Hu
Hi Joice, I just confirmed with @GuoLei. The official big release is scheduled for late February. Before that, you can give it a spin for testing purposes. We are preparing the relevant docs lately. I will keep you posted :) Best, Shirley H. Developer Advocate for Apache Doris Joice Jacob 于202

Re: Query Resource Management and Handling Large Queries in Apache Doris

2024-12-11 Thread Joice Jacob
Dear Apache Doris Development Community, Thank you for the update and the link to the branch! Could you kindly let us know when the next release of Apache Doris, including the disk spill feature, is expected to be available? On Tue, Dec 10, 2024 at 10:07 AM Joice Jacob wrote: > Dear Apache Dori

Re: Query Resource Management and Handling Large Queries in Apache Doris

2024-12-09 Thread GuoLei Yi
Currently, we are developing SPILL DISK now, you can refer the code from this branch. https://github.com/apache/doris/tree/spill_and_reserve This feature is almostly finished, we are doing some tests now. You can use it in next release. Joice Jacob 于2024年12月10日周二 12:37写道: > > Dear Apache Doris De