Hello Quanlong Huang, Riza Suminto, Jason Fehr, Joe McDonnell, Csaba Ringhofer,
Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/22738
to look at the new patch set (#17).
Change subject: IMPALA-14339: Cancel catalog ops for queries
......................................................................
IMPALA-14339: Cancel catalog ops for queries
Adds support to cancel metadata operations with catalogd by sending a
Cancel request to catalogd for the relevant query ID. Registers Java
Threads executing select catalog operations by their query ID.
UserCancelledException is implemented as a RuntimeException for the
moment because exception propagation requires a lot of updates; this is
similar to LocalCatalogException, and both should be cleaned up.
Updates locks to lockInteruptibly. Provides an implementation of
getUninterruptibly that allows cancellation.
Retries piggybacked queries that fail because the catalog load was
interrupted.
Adds a ImpylaHS2ResultSet.__str__ method to simplify interacting with
HS2 result sets in tests.
Testing:
- added local catalog mode tests for interrupting metadata operations
Change-Id: Iab22855bd2d63b64da008b52aa33230a6f422537
---
M be/src/catalog/catalog-server.cc
M be/src/catalog/catalog-service-client-wrapper.h
M be/src/catalog/catalog.cc
M be/src/catalog/catalog.h
M be/src/exec/catalog-op-executor.cc
M be/src/exec/catalog-op-executor.h
M be/src/service/client-request-state.cc
M be/src/service/fe-support.cc
M common/thrift/CatalogService.thrift
M fe/src/main/java/org/apache/impala/catalog/CatalogServiceCatalog.java
M fe/src/main/java/org/apache/impala/catalog/FeCatalog.java
M fe/src/main/java/org/apache/impala/catalog/ImpaladCatalog.java
M fe/src/main/java/org/apache/impala/catalog/ParallelFileMetadataLoader.java
M fe/src/main/java/org/apache/impala/catalog/local/CatalogdMetaProvider.java
M fe/src/main/java/org/apache/impala/catalog/local/LocalCatalog.java
M fe/src/main/java/org/apache/impala/catalog/local/MetaProvider.java
M fe/src/main/java/org/apache/impala/common/UserCancelledException.java
M fe/src/main/java/org/apache/impala/service/Canceller.java
M fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java
M fe/src/main/java/org/apache/impala/service/JniCatalog.java
M tests/common/impala_connection.py
M tests/custom_cluster/test_web_pages.py
M tests/util/web_pages_util.py
23 files changed, 498 insertions(+), 29 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/38/22738/17
--
To view, visit http://gerrit.cloudera.org:8080/22738
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Iab22855bd2d63b64da008b52aa33230a6f422537
Gerrit-Change-Number: 22738
Gerrit-PatchSet: 17
Gerrit-Owner: Michael Smith <[email protected]>
Gerrit-Reviewer: Csaba Ringhofer <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Jason Fehr <[email protected]>
Gerrit-Reviewer: Joe McDonnell <[email protected]>
Gerrit-Reviewer: Michael Smith <[email protected]>
Gerrit-Reviewer: Quanlong Huang <[email protected]>
Gerrit-Reviewer: Riza Suminto <[email protected]>
