$ ~/ermolushka
RSS FeedHey there! I'm sharing my journey through the tech world here. You'll find my thoughts on programming, occasional tutorials, and things I learn along the way. No frills, just honest experiences and useful bits of knowledge that might help other developers. This space is where I document my experiments, successes, and yes, those interesting failures that taught me something valuable.
Read the blog posts or check about me for more info.
Featured
rvllm - A Small LLM Inference Engine in Rust
Published: at 10:00 AMA basic local LLM inference engine written from scratch in Rust, running SmolLM2 on CPU with continuous batching and paged KV cache, and where CUDA and Metal support fit in next.
Two Boxes, One Model - Playing With Multi-Node vLLM
Published: at 10:00 AMA small learning experiment splitting an LLM across two GPU boxes with Ray and vLLM - tensor parallel vs pipeline parallel, and why plain ethernet ruins both.
Building a KV Cache Block Scheduler in Rust
Published: at 10:00 AMA from-scratch PagedAttention-style KV cache block manager in Rust - reference counting, prefix caching via radix trie, LRU eviction, and copy-on-write for beam search.
Elephant VM - stack-based VM written in Rust
Published: at 09:11 AMAn implementation of a simple stack-based VM written in Rust
Memory Optimization Deep Dive Running 8B Models on a Single 4090 using vLLM
Published: at 03:01 PMAn exploration of quantization techniques and memory optimization strategies for running Llama 8B models efficiently on consumer hardware using vLLM
Data capture for ML endpoints
Published: at 04:01 PMOne of the approaches of how how you can add data capture to your ML endpoints
Python asyncio internals
Published: at 12:11 PMA brief intro into asyncio internals in Python
Pratt Parsing intro for the compiler development
Published: at 04:12 PMPratt Parser intro and examples of implementation for the basic virtual machine
Snake game in Rust + Webassembly
Published: at 12:44 PMSnake game written in Rust and compiled to Webassemly to run in your browser
Recent Posts
Implementing ZIP unarchiver in Rust
Published: at 03:22 PMA quick overview of a ZIP unarchiver tool written in Rust just for fun.