Tag: local-llm
-
Local LLMs with Ollama: Keeping a small local model honest with tight prompts
A field-tested take on keeping a small local model honest with tight prompts with Local LLMs with Ollama: what it rewards, where it breaks, and how to keep the workflow honest.
-
Local LLMs with Ollama: Picking a local model for the specific task, not for the benchmark
A field-tested take on picking a local model for the specific task, not for the benchmark with Local LLMs with Ollama: what it rewards, where it breaks, and how to keep the workflow honest.
-
Local LLMs with Ollama: Sunday-afternoon project: your own code reviewer that runs offline
A field-tested take on a Sunday-afternoon project: your own code reviewer that runs offline with Local LLMs with Ollama: what it rewards, where it breaks, and how to keep the workflow honest.
-
Local LLMs with Ollama: Quantisation choices that actually matter for code
A field-tested take on quantisation choices that actually matter for code with Local LLMs with Ollama: what it rewards, where it breaks, and how to keep the workflow honest.
-
Local LLMs with Ollama: RAG over internal docs without handing them to a third party
A field-tested take on RAG over internal docs without handing them to a third party with Local LLMs with Ollama: what it rewards, where it breaks, and how to keep the workflow honest.
-
Caching embeddings locally for a private retrieval layer
Running retrieval against a local Ollama embedding model is easy. Not re-embedding the same document twice, and never letting anything sensitive touch an external API, is the part worth getting right. A local cache and a content hash do most of the work.
-
The Complete Mac AI Setup, 2026 Edition — Everything in One Guide
The complete guide to a Mac AI setup in 2026 — Ollama, Whisper, MLX, RAG, and local LLMs organized into four tiers by cost and time, with a RAM-to-model hardware table and honest guidance on when to stop upgrading.
-
What 100 Days of Daily Local AI Use Taught Me About the Hype
100 days of daily local AI use on Apple Silicon, audited honestly — what stuck, what got abandoned, real productivity numbers vs the 10x hype, and the durable lessons about local LLMs, Whisper, and workflow design.
-
Local LLMs with Ollama: When a local 7B beats a cloud 70B in latency-sensitive loops
A field-tested take on when a local 7B beats a cloud 70B in latency-sensitive loops with Local LLMs with Ollama: what it rewards, where it breaks, and how to keep the workflow honest.
-
The Multi-Mac AI Cluster — Insane Overkill or the Future?
Can you build an AI cluster from multiple Macs? A hands-on look at exo distributed inference on Apple Silicon, Thunderbolt bridge performance, real token-per-second numbers, and when a Mac cluster beats one big Mac Studio.
-
Why I Downgraded From the Biggest AI Model — and Got Better Results
The contrarian case for small local LLMs on Apple Silicon. Why downgrading from a 70B to an 8-14B model improved real productivity through latency, iteration speed, and prompt discipline — plus the escalation rule for when big models still win.
-
The Backup Strategy for People With 500GB of AI Models
Storage and backup strategy for local AI model hoarders: deduplicating Ollama, LM Studio, and Hugging Face caches, Time Machine exclusions for model blobs, external SSD symlinking, and what actually deserves a backup.
More posts tagged local-llm
- Local AI for Students — The Study System That Beats Tutoring
- I Tracked Every AI Query for a Month — The Results Changed My Setup
- Local LLMs with Ollama: Thermal budget of a MacBook pretending to be a server
- The Spreadsheet Killer — Local AI Data Analysis on Your Mac
- Why Your Next Home Server Should Be a Mac Mini, Not a Raspberry Pi
- I Made My Mac Read Every Contract Before I Sign It
- LM Studio vs. Ollama — The Local AI Showdown Nobody Wrote Honestly
- Your MacBook Battery Can Handle 8 Hours of Local AI — Here's How
- Run DeepSeek-Class Models on a Mac — The Complete Guide
- I Gave AI Full Access to My Calendar — Here's My Week Now
- The Mac Terminal Commands That Unlock Hidden AI Power
- Local LLMs with Ollama: Running evals locally before trusting a new model
- What's Coming Next for AI on Mac — and How to Be Ready
- The 7 AI Mistakes Mac Power Users Keep Making
- I Connected AI to My Smart Home Through a Mac Studio
- The AI Email Workflow That Saves Me 5 Hours Every Week
- Why Every Writer Needs a Local LLM (and How to Set One Up)
- The M-Series Chip Buying Guide for AI — What Actually Matters
- Local AI Translation Beats Google Translate — and It's Private
- RAG on Your Own Notes — Build a Second Brain That Actually Answers
- Local LLMs with Ollama: Pairing Ollama with Continue or Cline for a private IDE
- Your Mac Studio Can Replace a $1,500/Month AI API Bill
- Fine-Tune Your Own AI Model on a MacBook — Yes, Really
- Apple Intelligence vs. Local LLMs — What Apple Doesn't Tell You
- I Built a Private ChatGPT for My Family on a Mac Mini
- The 128GB Mac Studio Trick AI Researchers Don't Want You to Know
- Local LLMs with Ollama: Keeping a small local model honest with tight prompts
- Apple MLX Is the Most Underrated AI Framework Right Now
- The MacBook Pro Setting That Doubles Your AI Performance
- I Replaced My $20 AI Subscriptions With One Mac Studio
- Your Mac Is a Local AI Supercomputer You're Using at 10% Capacity
- Local LLMs with Ollama: Picking a local model for the specific task, not for the benchmark
- Local LLMs with Ollama: Sunday-afternoon project: your own code reviewer that runs offline
- Local LLMs with Ollama: Quantisation choices that actually matter for code
- Local LLMs with Ollama: RAG over internal docs without handing them to a third party
- Local LLMs with Ollama: Caching embeddings locally for a private retrieval layer
- Local LLMs with Ollama: When a local 7B beats a cloud 70B in latency-sensitive loops
- Choosing Hardware for Local AI: The Complete Guide to Running Small Language Models at Home
- Local LLMs with Ollama: Thermal budget of a MacBook pretending to be a server
- Local LLMs with Ollama: Running evals locally before trusting a new model
- Local LLMs with Ollama: Pairing Ollama with Continue or Cline for a private IDE
- Local LLMs with Ollama: Keeping a small local model honest with tight prompts
- Local LLMs with Ollama: Picking a local model for the specific task, not for the benchmark
- Local LLMs with Ollama: Teaching a team to trust a model they own end to end
- Local LLMs with Ollama: First honest benchmark between local and cloud models
- Local LLMs with Ollama: Cost-per-token in wall time, discovered by accident
- Local LLMs with Ollama: Air-gapped development as a serious practice, not a demo
- Local LLMs with Ollama: Pairing Ollama with Continue for a first private IDE setup
- Local LLMs with Ollama: Offline code reviewer that survived a flaky Wi-Fi week
- Local LLMs with Ollama: Caching embeddings locally for a beginner RAG
- Local LLMs with Ollama: Moment a local 7B beat the cloud on a real task
- Local LLMs with Ollama: Local evaluations that predicted our first cloud regression
- Local LLMs with Ollama: Quantisation choices with incomplete information
- Local LLMs with Ollama: Thermal limits on the first serious local code session
- Local LLMs with Ollama: Private RAG pipelines, assembled out of a weekend of curiosity
- Local LLMs with Ollama: Picking a local model for code without benchmarks to lean on
- Local LLMs with Ollama: First week running Ollama on a work laptop
- Local LLMs with Ollama: Teaching a team to trust a model they own end to end
- Local LLMs with Ollama: First honest benchmark between local and cloud models
- Local LLMs with Ollama: Cost-per-token in wall time, discovered by accident
- Local LLMs with Ollama: Air-gapped development as a serious practice, not a demo
- Local LLMs with Ollama: Pairing Ollama with Continue for a first private IDE setup
- Local LLMs with Ollama: Offline code reviewer that survived a flaky Wi-Fi week
- Local LLMs with Ollama: Caching embeddings locally for a beginner RAG
- Local LLMs with Ollama: Moment a local 7B beat the cloud on a real task
- Local LLMs with Ollama: Local evaluations that predicted our first cloud regression
- Local LLMs with Ollama: Quantisation choices with incomplete information
- Local LLMs with Ollama: Thermal limits on the first serious local code session
- Local LLMs with Ollama: Private RAG pipelines, assembled out of a weekend of curiosity
- Local LLMs with Ollama: Picking a local model for code without benchmarks to lean on
- Local LLMs with Ollama: First week running Ollama on a work laptop