3 articles tagged hardware.
Meta dropped Muse Glimmer 30B and I spent the day trying to unseat my qwen daily driver on the dual-4090 rig. Four apparent hangs, one day-one bug, and a same-harness bench later, I had my answer - and it wasn't the coronation I'd half expected. So, is it better than my daily driver?
· gpu · hardware
In today's guide, we're picking the best GPUs for running local LLMs - why memory bandwidth beats FLOPS, why VRAM decides everything, what I'd buy at each budget from the used RTX 3090 to my own pair of modded 48GB 4090s, the PCIe lanes a second card needs on a gaming board, and a calculator to check whether your model fits.
· local-llm · gpu
Turn a gaming GPU into a working local AI model with LM Studio - free, no billing, no API key. In today's guide, we install it, point it at the GPU, download a first model, and then go through the settings: GPU offload, context length, Flash Attention, temperature and top-k, and the Developer mode that unlocks them.
· claude-code · local-llm