Topic

#Local Llm

22 articles on Local Llm — news, releases, guides and analysis from the SourceFeed engine.

Tutorial 1d ago 0

Convert and Quantize Hugging Face Models to GGUF for llama.cpp

Turn any Hugging Face checkpoint into a 4-bit GGUF that runs fast and small on your own hardware.

Mariana Souza

The MLX Crowd Finally Gets Its Own LM Studio

mlx-vlm maintainer Prince Canuma ships Nativ, an open-source Mac app built to feed local models to coding agents.

Article · 3w ago6

The mlx-vlm Maintainer Just Came for LM Studio's Lunch

Nativ is an MIT-licensed macOS app from the developer whose inference code already powers rival local-AI frontends.

Article · 3w ago5

Old Xeons Can Run Gemma 4 at Reading Speed

MoE math, CPU kernels, and speculative decoding turn retired enterprise boxes into real local inference hosts.

Article · 4w ago1

Mesh LLM Makes Spare GPUs Look Like One API

Iroh-backed peer routing and layer splits turn mixed local boxes into an OpenAI-compatible mesh—with familiar latency and trust caveats.

Article · 1mo ago0

Run a Fast, Fully Local Coding Agent on macOS

Ditch the cloud and run Gemma 4 locally with llama.cpp and speculative decoding for blazing-fast terminal assistance.

Tutorial · 2mos ago0

whichllm: Hardware-Aware LLM Rankings in One Command

Forget parameter count. This open-source CLI auto-detects your GPU, pulls live HuggingFace data, and ranks local models by real benchmark scores weighted for your exact rig.

Article · 2mos ago0