Re: The new scalable regression testing framework(#8125)

[ling miao]

First, we need to open source the P0 test set (From Baidu)~

Ling Miao
924060929 <924060...@qq.com.invalid> 于2022年2月19日周六 18:43写道：

> Thinks for greate&nbsp;suggestions.
>
>
> The print result function is missing, and can run&nbsp;parallely
> and&nbsp;randomly.
> But&nbsp;it is easy to implement, I can support in next pull request.
>
>
>
>
> ------------------&nbsp;原始邮件&nbsp;------------------
> 发件人: "1 0"<dataroar...@gmail.com&gt;;
> 发送时间: 2022年2月19日(星期六) 下午4:30
> 收件人: "dev"<dev@doris.apache.org&gt;;
> 主题: Re: The new scalable regression testing framework(#8125)
>
>
>
>
> It&#39;s&nbsp;a&nbsp;great&nbsp;job.&nbsp;I&nbsp;have&nbsp;a&nbsp;suggestion&nbsp;on&nbsp;writing&nbsp;a&nbsp;case&nbsp;more&nbsp;easily.&nbsp;&nbsp;We
>
> should&nbsp;accept&nbsp;cases&nbsp;in&nbsp;sql&nbsp;and&nbsp;check&nbsp;the&nbsp;result&nbsp;by&nbsp;comparing&nbsp;the&nbsp;content&nbsp;of
>
> stdout&nbsp;and&nbsp;stderr.&nbsp;This&nbsp;way,&nbsp;anyone&nbsp;can&nbsp;contribute&nbsp;a&nbsp;case&nbsp;easily,&nbsp;for
>
> example&nbsp;I&nbsp;just&nbsp;execute&nbsp;sql&nbsp;and&nbsp;put&nbsp;output.&nbsp;The&nbsp;cases&nbsp;can&nbsp;also&nbsp;be&nbsp;used
> easily&nbsp;by&nbsp;other&nbsp;tests&nbsp;like&nbsp;fuzzy.
>
>
> Can&nbsp;the&nbsp;framework&nbsp;run&nbsp;parallely&nbsp;and&nbsp;randomly?&nbsp;We&nbsp;need&nbsp;to&nbsp;run&nbsp;functional&nbsp;and
>
> regression&nbsp;tests&nbsp;parallely&nbsp;and&nbsp;randomly&nbsp;to&nbsp;discover&nbsp;more&nbsp;problems.
>
> Thanks,
> Dataroaring.