Operating · accepting briefs Work with me

Tagged: Local LLMs

5 articles tagged Local LLMs.

How to Run Qwen3-Coder-Next Locally: My vLLM Settings for Two 48GB RTX 4090s

I loaded Qwen3-Coder-Next across my two modded 48GB RTX 4090s with vLLM, and today's post covers the vLLM settings for 192k of context, and how it did on the jobs I use AI for. It answered questions on a whole 86k-token repo in 26 seconds, where Qwen3.8-27B on its 32k one-card preset couldn't take the prompt at all, and it scoped an upgrade in under 30 seconds against about 3 minutes for the 27B. But it got facts wrong, and given git tools it committed on a failing test in 2 of 3 runs.

Local LLMs · vllm
OpenCode vs Claude Code: Setting Up OpenCode Desktop on Windows

OpenCode Desktop runs whichever model you point it at, and it picked up my Claude Code skills without being asked. I connected DeepSeek, GLM-5.3 and a local Qwen, fenced the permissions, and then had GLM-5.3 review an MCP server I'd built with Claude, fix it and get a release ready.

claude-code · mcp
Which AI pitches the best content ideas? Free Workers AI models vs DeepSeek

I cut my own content SaaS down to a free one-page tool to test demand, then ran the same brief through all eight AI engines it offers. In today's post we're taking a closer look at what each one pitched and how long it took, because on the free engines you pay in waiting.

Local LLMs · content marketing
Muse Glimmer 30B vs qwen: my day-one local benchmark on a dual RTX 4090 rig

Meta dropped Muse Glimmer 30B and I spent the day trying to unseat my qwen daily driver on the dual-4090 rig. Four apparent hangs, one day-one bug, and a same-harness bench later, I had my answer - and it wasn't the coronation I'd half expected. So, is it better than my daily driver?

gpu · hardware
Cut your Claude Code bill with houtini-lm, and get a second opinion

We built houtini-lm so Claude Code can stay the orchestrator while other models do the work: a cheaper frontier model, a local model on your own GPU, or a specialist with a skill Claude doesn't have. In today's post we're taking a closer look at what my average Claude Code day costs, what the same work costs elsewhere, and what a second model on the job adds besides the saving.

claude-code · openrouter