It's a great job. I have a suggestion on writing a case more easily. We should accept cases in sql and check the result by comparing the content of stdout and stderr. This way, anyone can contribute a case easily, for example I just execute sql and put output. The cases can also be used easily by other tests like fuzzy.
Can the framework run parallely and randomly? We need to run functional and regression tests parallely and randomly to discover more problems. Thanks, Dataroaring.