Posts
All the posts I've published.
Two Boxes, One Model - Playing With Multi-Node vLLM
Published: at 10:00 AMA small learning experiment splitting an LLM across two GPU boxes with Ray and vLLM - tensor parallel vs pipeline parallel, and why plain ethernet ruins both.
Building a KV Cache Block Scheduler in Rust
Published: at 10:00 AMA from-scratch PagedAttention-style KV cache block manager in Rust - reference counting, prefix caching via radix trie, LRU eviction, and copy-on-write for beam search.
Elephant VM - stack-based VM written in Rust
Published: at 09:11 AMAn implementation of a simple stack-based VM written in Rust