Skip to content
Rust Search
← Rustikon 2026

Building a self-hosted LLM ecosystem in Rust: from infrastructure to applications

SoftwareMill
Rustikon 17:00 217 views

This talk explores building a complete self-hosted LLM stack in Rust: Paddler, a distributed load balancer for serving LLMs at scale, and Poet, a static site generator that consumes those LLMs for AI-powered content features.

Player unavailable or embedding blocked? Use the YouTube link above.