2 articles tagged gpu.
Meta dropped Muse Glimmer 30B and I spent the day trying to unseat my qwen daily driver on the dual-4090 rig. Four apparent hangs, one day-one bug, and a same-harness bench later, I had my answer - and it wasn't the coronation I'd half expected. So, is it better than my daily driver?
· gpu · hardware
In today's guide, we're picking the best GPUs for running local LLMs - why memory bandwidth beats FLOPS, why VRAM decides everything, what I'd buy at each budget from the used RTX 3090 to my own pair of modded 48GB 4090s, the PCIe lanes a second card needs on a gaming board, and a calculator to check whether your model fits.
· local-llm · gpu