Tag: networking
All the articles with the tag "networking".
Two Boxes, One Model - Playing With Multi-Node vLLM
Published: at 10:00 AMA small learning experiment splitting an LLM across two GPU boxes with Ray and vLLM - tensor parallel vs pipeline parallel, and why plain ethernet ruins both.