### Description
I want to tune a operator, export it to library `.so`, load it from library and
benchmark it finally. My coded are as follows.
I defined the op here:
```python
@auto_scheduler.register_workload
def element_add(m, n, dtype):
A = te.placeholder((m, n), name="A", dtype=dtype)
B = te.placeholder((m, n), name="B", dtype=dtype)
C = te.compute(
(m, n),
lambda i, j: A[i, j] + B[i, j],
name="C",
attrs={"layout_free_placeholders": [B]},
)
return [A, B, C]
```
then I tuned the kernel
```python
# ...
task = auto_scheduler.SearchTask(
func=element_add, args=(m, n, dtype), target=target)
task.tune(tune_option)
sch, args = task.apply_best(log_file)
```
then built and exported it as the [return type description in the
document](https://tvm.apache.org/docs/reference/api/python/auto_scheduler.html?highlight=apply_best#tvm.auto_scheduler.SearchTask.apply_best)
```python
m_l = tvm.lower(sch, args, name=f"add")
m = tvm.build(m_l, target = target)
m.export_library(lib_file)
```
loaded it again and ran the benchmark
```python
dev = tvm.device(str(target), 0)
lib: tvm.runtime.Module = tvm.runtime.load_module(lib_file)
module = graph_executor.GraphModule(lib[f"add"](dev))
a_tvm = tvm.nd.array((np.random.uniform(
size=(m, n))).astype(dtype))
b_tvm = tvm.nd.array((np.random.uniform(
size=(m, n))).astype(dtype))
c_tvm = tvm.nd.array(np.zeros((m,n), dtype=dtype))
module.set_input("A", a_tvm)
module.set_input("B", b_tvm)
module.set_input("C", c_tvm)
timer = module.benchmark(dev, number=20)
```
But I got a TVMError:
```bash
Traceback (most recent call last):
File "op_tuning.py", line 45, in element2helper
module = graph_executor.GraphModule(lib[f"add"](dev))
File "/home/xxx/tvm/python/tvm/_ffi/_ctypes/packed_func.py", line 237, in
__call__
raise get_last_ffi_error()
tvm._ffi.base.TVMError: Traceback (most recent call last):
4: TVMFuncCall
at /home/xxx/tvm/src/runtime/c_runtime_api.cc:475
3: tvm::runtime::PackedFunc::CallPacked(tvm::runtime::TVMArgs,
tvm::runtime::TVMRetValue*) const
at /home/xxx/tvm/include/tvm/runtime/packed_func.h:1151
2: std::function<void (tvm::runtime::TVMArgs,
tvm::runtime::TVMRetValue*)>::operator()(tvm::runtime::TVMArgs,
tvm::runtime::TVMRetValue*) const
at /usr/include/c++/7/bits/std_function.h:706
1: _M_invoke
at /usr/include/c++/7/bits/std_function.h:316
0: operator()
at /home/xxx/tvm/src/runtime/library_module.cc:80
File "/home/xxx/tvm/src/runtime/library_module.cc", line 80
TVMError:
---------------------------------------------------------------
An error occurred during the execution of TVM.
For more information, please see: https://tvm.apache.org/docs/errors.html
---------------------------------------------------------------
Check failed: ret == 0 (-1 vs. 0) : Assert fail: (num_args == 3), add:
num_args should be 3
```
I'm sure the `args` in `tvm.lower(sch, args, name="add")` have 3 arguments, so
what is the cause of this error?
---
[Visit
Topic](https://discuss.tvm.apache.org/t/question-about-load-module-from-library/11840/1)
to respond.
You are receiving this because you enabled mailing list mode.
To unsubscribe from these emails, [click
here](https://discuss.tvm.apache.org/email/unsubscribe/5ad8598c31461c9294e5b2efed0730d943aac56b25e0247fdd98df1dc1027785).
