NVIDIA Developer Blog
1 sourcesMake Long-Running NVIDIA TensorRT Engine Builds Observable and Cancelable in Python or C++
NVIDIA TensorRT engine builds can take seconds to minutes, especially for large strongly typed models, deep tactic search, and cold timing caches on new GPU SKUs. This article discusses making these builds observable and cancelable in Python or C++ to improve developer experience.