Manish Maheshwari created IMPALA-13491:
------------------------------------------
Summary: Add config on catalogd for controlling the number of
concurrent loading/refresh commands
Key: IMPALA-13491
URL: https://issues.apache.org/jira/browse/IMPALA-13491
Project: IMPALA
Issue Type: Improvement
Reporter: Manish Maheshwari
When running Table Loading or Refresh commands, catalogd requires working
memory in proportion to the number of tables been refreshed. While we have a
table level lock, we dont have a config to control concurrent load/refresh
operations.
In case of customers that run refresh in parallel in multiple threads, the
number of load/refresh command can cause OOM on the catalog due to running out
of working memory.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
