+1 for this! I just have a couple of tiny Q's/comments that I'll put in the APE on the wiki. Let's get this stuff up and running!
On 2025/01/16 22:56:59 Hongyu Shi wrote: > Hi *DB Dev community, > > Starting a discussion thread to propose new DDL/DML syntax that allows > users to define group names with corresponding priorities, adjust query > scheduler parameters for dynamic management, and incorporate these > configurations into queries. > > *Feature:* Syntax for configuring the dynamic workload scheduler's metadata > via DDL/DML and related statements. > *Details:* The new scheduler allows the system to prioritize queries > according to user-defined classifications and priorities. Additionally it > also ensures that short, low-resource queries are prioritized, while also > maintaining fair scheduling by balancing wait times relative to execution > times. > This proposal outlines the syntax for configuring relevant metadata. To > provide users with a structured approach to manage these configurations, > scheduler settings are stored in a dedicated metadata table. The proposed > syntax enables users to add or remove query groups, adjust their > priorities, and modify parameters related to the dynamic workload module as > described in this document. > > The new syntax APE: > *Metadata Configuration Syntax APE > <https://cwiki.apache.org/confluence/display/ASTERIXDB/APE+18%3A+Dynamic+Workload+Configuration+Statement+Syntax> > * > To view the previous DWM APE: > *Dynamic Workload Management APE* > <https://cwiki.apache.org/confluence/display/ASTERIXDB/APE+13%3A+Dynamic+Workload+Management> > > > Greatly appreciate any feedback on the syntax design to help identify > potential issues and refine it further. Thanks so much! > > Best, > Hongyu >