Rust Nation UK

Turns out, that when your job is "figure out the best way to deploy AI models on whatever our clients use" you end up testing basically every inference framework in existence. This talk is the summary I wish I'd had when I started. I'll walk you through what inference and training actually are, why there are hundred different frameworks and what I've learned deploying models across the hardware spectrum. We'll look at which Rust frameworks support what layers and quantization, how fast they actu

Player unavailable or embedding blocked? Use the YouTube link above.