Guoqing Bao

Guoqing Bao

Senior staff researcher at Enflame Technology, obtained PhD in Artificial Intelligence & Image Processing from School of Computer Science, University of Sydney. Currently doing research in AI framework optimization & computer vision. Before his oversea study in Australia, he had worked as a senior software engineer in Beijing (e.g., iQiYi.com) from 2008 to 2016.

LLM inference in Rust ecosystem

Date:

Talk on LLM inference in Rust ecosystem, covering Rust-native LLM serving stacks including xInfer, Candle-vLLM, and related kernel/runtime design choices for production inference.