Michael Smith has posted comments on this change. ( http://gerrit.cloudera.org:8080/23335 )
Change subject: IMPALA-13957: Enable Hive/Yarn with Ozone ...................................................................... Patch Set 2: (2 comments) http://gerrit.cloudera.org:8080/#/c/23335/1//COMMIT_MSG Commit Message: http://gerrit.cloudera.org:8080/#/c/23335/1//COMMIT_MSG@10 PS1, Line 10: Excludes HBase as HBASE-27740 is not yet available. > I haven't tried full data load yet. So probably. If not using HDFS, HBase tests and loading HBase tables are already skipped. I needed to also skip create-hbase.sh. http://gerrit.cloudera.org:8080/#/c/23335/1//COMMIT_MSG@9 PS1, Line 9: run data : load with Ozone > I've only been using it to manually run load-data.py on specific tables. So The full cleanup is going to be a lot bigger. There's some cruft that needs cleanup: - we keep adding tests that fail on Ozone because they assume /test-warehouse is universal - lots of similar variables and methods that are used inconsistently - load data has a lot of assumptions around using /test-warehouse that was fairly concise to rewrite when loading snapshots, but I need to clean up if we're going to load data from scratch. I think it does make sense to separate HBase and Kudu data load more, and have them controllable from an env var set in impala-config.sh. This would move us towards supporting simpler dev environments where we don't set them up. Ozone is aiming to be a replacement for HDFS. Eventually I think we would want to be able to run Impala + HBase + Ozone. But I don't expect to solve that today, since the versions of Ozone and HBase we have doesn't work together. -- To view, visit http://gerrit.cloudera.org:8080/23335 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I64bd0a8dc71f189becf410731285a9af147e25d2 Gerrit-Change-Number: 23335 Gerrit-PatchSet: 2 Gerrit-Owner: Michael Smith <[email protected]> Gerrit-Reviewer: Csaba Ringhofer <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Jason Fehr <[email protected]> Gerrit-Reviewer: Michael Smith <[email protected]> Gerrit-Reviewer: Riza Suminto <[email protected]> Gerrit-Reviewer: Yida Wu <[email protected]> Gerrit-Comment-Date: Tue, 26 Aug 2025 21:34:13 +0000 Gerrit-HasComments: Yes
