caiconghui edited a comment on pull request #6292: URL: https://github.com/apache/incubator-doris/pull/6292#issuecomment-886213876
> I don't get it, why it get faster than before? > I notice that you put a limit number of active jobs in a new thread pool and let them run concurrently? on our production environment, there are usually some tables added columns at the same time, and now these table are loaded data all time by stream load, so We hope that adding column operation can be accomplished as soon as possible, or stream load can be more slower when it should write two copies of data. now, it waste time to sleep and schema change jobs will affect each other, so here I change the interval for schema change check and add threadpool to make schema change jobs wouldn't affect each other. and if alter worker thread count is big enough, even big table with many tablets, adding column operation can be accomplished in short time. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org
