[TVM Discuss] [RFC] Canonicalizing AutoTVM Log Format

2020-06-25 Thread Lianmin Zheng via TVM Discuss
## Difference between the logs for Ansor and AutoTVM There are two major differences between ansor's log and autotvm's log 1. The workload for Ansor is a subgraph defined by multiple `tvm.compute`, while the workload for autotvm is a single operator. To index log quickly, Ansor stores a hash

[TVM Discuss] [Development/RFC] [RFC] Ansor: An Auto-scheduler for TVM (AutoTVM v2.0)

2020-06-18 Thread Lianmin Zheng via TVM Discuss
Thanks for the discussion. Here are my thoughts. ### API Usage The API for tuning a whole neural network will be the same as autotvm (extract tasks and tune all of them). The API for writing templates is still under development. But it will be similar to autotvm. ### Performance in absolu

[TVM Discuss] [Development/RFC] [RFC] Ansor: An Auto-scheduler for TVM (AutoTVM v2.0)

2020-06-17 Thread Lianmin Zheng via TVM Discuss
# Motivation The current autotvm requires pre-defined schedule templates. This makes autotvm only semi-automated: the search is automated, but the search space has to be manually defined by developers using the schedule templates. This approach has several drawbacks: 1. The templates are har

[TVM Discuss] [Development] [DISCUSS] and Documentation of AlterLayout Pass

2019-03-20 Thread Lianmin Zheng via TVM Discuss
@yzhliu You are right. At that time, we thought `AlterOpLayout` does not have dependency problem and can be done in a single forward pass, so we tried to do a lot of things in a single pass, which includes operator substitution, layout inference, and layout-transformation insertion. I agree t