NVIDIA announces launch of TensorRT 8 designed for chatbots, recommendations and search

The eighth generation of NVIDIA's AI software is able to cut inference time in half for language queries.