tqchen commented on PR #696: URL: https://github.com/apache/tvm-ffi/pull/696#issuecomment-5148947117
Post-publication FlashInfer confirmation against published head `89031a1c`: - Rebuilt the real generated `silu_and_mul` CUDA source against the published headers for H200 (`sm_90a`). The resulting DSO has SHA-256 `8c9e044ce5d239d946274918bd589e9fbdc6dbdb3b433b448facf2c329db0b52`. - The DSO has no undefined `TVMFFIGetCustomAllocator` or `TVMFFISetCustomAllocator` reference. - With `LD_BIND_NOW=1`, isolated released tvm-ffi 0.1.11 and 0.1.12 runtimes both load the DSO and produce the expected argument-count `TypeError`; this exercises cache-side error-object construction without a symbol-resolution failure. - Both released runtimes also complete a valid FP16 `silu_and_mul` launch on H200, synchronize successfully, and match the Torch reference at `rtol=1e-3`, `atol=1e-3`. - In the reverse direction, the pre-allocator-change owned-Shape cache still loads, returns `[2, 3]`, and destroys cleanly with the dormant runtime. The detailed compatibility investigation and benchmark matrix remain on the task issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
