Joe McDonnell has posted comments on this change. ( http://gerrit.cloudera.org:8080/23588 )
Change subject: IMPALA-9715: Add devdata dataload option ...................................................................... Patch Set 11: > > Patch Set 11: > > > > If a developer has this dev dataload, what is the right way to > run tests? i.e. is there something that skips tests that need > tables that aren't loaded? > > I haven't gotten that far yet. buildall.sh will limit formats for > test vectors, but it needs more work as a complete testing > workflow. I'm ok with experimenting with new idioms for this. We have a couple existing idioms that don't quite do this. exploration_strategy does determine the table formats that we test and some tests skip below exhaustive (in addition to table format restrictions). It currently doesn't impact dataload (functional-query is always loaded at exhaustive and tpch/tpcds are loaded at core). One could imagine an exploration_strategy=minimal option and modifying dataload to respect exploration strategy (which should also help core tests). That wouldn't exclude the tables that are loaded with Hive, so it wouldn't be as fast or small. I do think that a bunch of tests would probably run fine. If we wanted to exclude additional tables, the tests would need some way to say that they need those tables. workloads are mostly meaningless, because almost everything is functional-query. I wish we knew which tests needed which tables. -- To view, visit http://gerrit.cloudera.org:8080/23588 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Ia942c2df5f238c570a2fc5e547786ac62b9f3af4 Gerrit-Change-Number: 23588 Gerrit-PatchSet: 11 Gerrit-Owner: Michael Smith <[email protected]> Gerrit-Reviewer: Csaba Ringhofer <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Jason Fehr <[email protected]> Gerrit-Reviewer: Joe McDonnell <[email protected]> Gerrit-Reviewer: Michael Smith <[email protected]> Gerrit-Reviewer: Pranav Lodha <[email protected]> Gerrit-Comment-Date: Mon, 17 Nov 2025 19:56:21 +0000 Gerrit-HasComments: No
