@tqchen: I seek your expert advice for below point. Please help!

This is regarding NDArray Design.

As in this feature i am trying to bridge between TVM.NET runtime(Managed 
Memory) and TVM C runtime(Unmanaged Memory) .

Below is a snapshot of NDArray Class Design which i have currently.

![image|690x371](upload://zRiXeJUaXeyGQyg6o6nfmLSlA3K.png) 

In case of Runtime Inference input it is okay, as its lifetime is short, so it 
will be auto destroyed when no longer in use and so forth the unmanaged memory 
encompassed.

My concern here is in the case where DotNet wants to retain the NDArray for a 
longer time for future use.
For example when fetch the inference output and store it for further analysis 
or tasks.

So i want to have an API to detach the NDArray(Managed) from 
NDArray(UNmanaged), as the unmanaged memory is no longer required.

  I have proposal for 2 APIs as below:
   1. --> NDArray().Detach() --> Once Get output from TVM runtime, and keep it 
only for read only purpose.
2.    --> NDArray().Attach() -->  When User wants to Feedback the same NDArray 
into the Runtime.

Please share your thoughts in this.

Thanks you!





---
[Visit 
Topic](https://discuss.tvm.ai/t/introducing-tvm-net-for-bringing-tvm-features-into-net-world/6213/10)
 to respond.

You are receiving this because you enabled mailing list mode.

To unsubscribe from these emails, [click 
here](https://discuss.tvm.ai/email/unsubscribe/5ebf45d7a699f94ce9fddc17bc3951447721e44ba9bbbc6822e5abb3334aa375).

Reply via email to