Skip to the content.
LLM inference infrastructure at Meta
Distributed systems and LLM inference infrastructure engineer
View on GitHub
LLM inference infrastructure at Meta
The problem
What I tried first
Why I changed course
The final design
Measured impact