Archives

A from-scratch PagedAttention-style KV cache block manager in Rust - reference counting, prefix caching via radix trie, LRU eviction, and copy-on-write for beam search.

An implementation of a simple stack-based VM written in Rust

A brief intro into asyncio internals in Python

An exploration of quantization techniques and memory optimization strategies for running Llama 8B models efficiently on consumer hardware using vLLM

One of the approaches of how how you can add data capture to your ML endpoints

Pratt Parser intro and examples of implementation for the basic virtual machine

Snake game written in Rust and compiled to Webassemly to run in your browser

A quick overview of a ZIP unarchiver tool written in Rust just for fun.