Posts
All the posts I've published.
Elephant VM - stack-based VM written in Rust
An implementation of a simple stack-based VM written in Rust
Memory Optimization Deep Dive Running 8B Models on a Single 4090 using vLLM
An exploration of quantization techniques and memory optimization strategies for running Llama 8B models efficiently on consumer hardware using vLLM
Data capture for ML endpoints
One of the approaches of how how you can add data capture to your ML endpoints