tlopex opened a new pull request, #19789:
URL: https://github.com/apache/tvm/pull/19789
This pr fixes #19609. TensorRT 10 removed a large set of APIs that the Relax
TensorRT BYOC integration relied on, so it failed to compile against TRT >= 10.
Port the runtime and codegen to the TRT10 API and require TensorRT >= 10:
- Lifetime: obj->destroy() -> delete (destroy() removed in TRT10).
- Builder: drop implicit-batch mode (networks are always explicit-batch via
createNetworkV2(0); setMaxBatchSize removed); setMaxWorkspaceSize ->
setMemoryPoolLimit(kWORKSPACE); buildEngineWithConfig -> buildSerializedNetwork
+ deserializeCudaEngine, keeping the IRuntime alive alongside the engine.
- Execution: the binding-index model (getNbBindings / getBindingIndex /
setBindingDimensions / execute / executeV2) -> the named-tensor model
(getNbIOTensors / setInputShape / setTensorAddress / enqueueV3);
deserializeCudaEngine drops the trailing IPluginFactory* argument.
- Layers: addConvolution / addPooling / addDeconvolution / addPadding ->
the *Nd variants; set{Stride,Dilation} -> *Nd; IFullyConnectedLayer /
addFullyConnected removed -> dense rebuilt with addConstant + addMatrixMultiply.
- Add a build-time guard that emits a clear error on TensorRT < 10.
Also fix pre-existing issues that prevented this path from running
end-to-end: the runtime had drifted from the current tvm-ffi API
(TVMTensorCopyToBytes / TVMGetLastError, VectorToTrtDims over ffi::Array, a
stale `override` on the destructor), and the conv converters read a Relay-era
"channels" attribute that Relax does not emit (output channels are now derived
from the kernel shape).
All tests are verified correct locally. This pr barely includes api updates
and there is no new parts added
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
