Welcome to the LLM Garage - documenting the journey of building capable LLM inference machines using consumer GPUs and off-the-shelf hardware. This collection tracks experiments, insights, and pitfalls encountered while creating capable AI systems on [relatively] realistic budgets. From hardware builds to performance optimizations with llama.cpp and vLLM, these posts share the things I encounter while pushing consumer hardware to its limits.