San Francisco Bay Area

Xuan LuAI Infrastructure Engineer

Building the systems behind AI.

I work on large-scale LLM inference at AWS SageMaker HyperPod, focusing on distributed serving, Kubernetes, performance and reliability.

Xuan Lu

About Me

I’m an AI infrastructure engineer based in the San Francisco Bay Area. I approach engineering through practical systems design: understand the bottleneck, test assumptions and verify how a system behaves in production.

At Amazon, my work has spanned customer-facing software, machine learning serving platforms and now large-scale LLM inference at AWS SageMaker HyperPod. I’m interested in the questions that appear when a model becomes a service: how requests share GPUs, where latency comes from and how the system stays reliable under load.

Outside engineering, I write about AI and learning, and use AI to make short films and music. I like turning an idea into something people can read, watch or try. The aim is to make room for more interesting work—and more life outside it.

Get in touch