Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/23396 )
Change subject: IMPALA-14411: enable_workload_mgmt should work with V2 profile ...................................................................... IMPALA-14411: enable_workload_mgmt should work with V2 profile Impalad crash (hitting DCHECK) when both enable_workload_mgmt and gen_experimental_profile enabled. This is because lambda function process_exec_profile expect "Averaged Fragment" node exist in query profile. But it is actually not exist in V2 query profile. This patch fix the issue by gathering ScratchBytesWritten, ScannerIoWaitTime, and DataCacheHitBytes counters differently in V2 profile. Testing: - Add TestQueryLogTableHS2::test_with_experimental_profile. - Manually start minicluster with both enable_workload_mgmt and gen_experimental_profile flag enabled. Run few queries and confirm no crash happen. Also verify that the columns of sys.impala_query_log that summarize the scan node counters are correct. Change-Id: Iccb4ad9279b0d66479b1e7816ffc732028e71734 Reviewed-on: http://gerrit.cloudera.org:8080/23396 Reviewed-by: Impala Public Jenkins <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- M be/src/service/query-state-record.cc M tests/custom_cluster/test_query_log.py 2 files changed, 84 insertions(+), 19 deletions(-) Approvals: Impala Public Jenkins: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/23396 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: Iccb4ad9279b0d66479b1e7816ffc732028e71734 Gerrit-Change-Number: 23396 Gerrit-PatchSet: 9 Gerrit-Owner: Riza Suminto <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Jason Fehr <[email protected]> Gerrit-Reviewer: Michael Smith <[email protected]> Gerrit-Reviewer: Riza Suminto <[email protected]>
