Skip to the content.
Cutting runtime by 80%
Distributed systems and LLM inference infrastructure engineer
View on GitHub
Cutting runtime by 80%
The problem
What I tried first
Why I changed course
The final design
Measured impact