Yeah. A performance regression test would be very nice. There are a lot of
times we need to do binary search to find the commit causing regression.
---
[Visit
Topic](https://discuss.tvm.apache.org/t/rfc-building-a-new-reproducible-benchmark-for-tvm/8496/3)
to respond.
You are receiving t
Great suggestion!
Can we make it as a nightly/weekly regression test utils and also consider
adding accuracy evaluation for quantization model into this loop?
---
[Visit
Topic](https://discuss.tvm.apache.org/t/rfc-building-a-new-reproducible-benchmark-for-tvm/8496/2)
to respond.
You are
## Motivation
Currently, TVM lacks an up-to-date and reproducible benchmark. The only
benchmark is hosted at
[tvm/apps/benchmark](https://github.com/apache/incubator-tvm/tree/main/apps/benchmark).
However, this benchmark is too old and has several flaws.
1. The results were obtained 2 years ag
I enjoy the reading of https://arxiv.org/abs/2006.03031 which supports dyn
model support in the TVM using relay vm.
However, i want to ask some quick questions:
1. Do we have uploaded completely of Nimble code on the mainstream? Especially
about the memory performance issue like this :
https