LLM inference in Rust ecosystem
Conference Talk, Rust China Conference 2024, China
Talk on LLM inference in Rust ecosystem, covering Rust-native LLM serving stacks including xInfer, Candle-vLLM, and related kernel/runtime design choices for production inference.
