Tag: ollama
-
Local LLMs with Ollama: Keeping a small local model honest with tight prompts
A field-tested take on keeping a small local model honest with tight prompts with Local LLMs with Ollama: what it rewards, where it breaks, and how to keep the workflow honest.
-
Local LLMs with Ollama: Picking a local model for the specific task, not for the benchmark
A field-tested take on picking a local model for the specific task, not for the benchmark with Local LLMs with Ollama: what it rewards, where it breaks, and how to keep the workflow honest.
-
Local LLMs with Ollama: Sunday-afternoon project: your own code reviewer that runs offline
A field-tested take on a Sunday-afternoon project: your own code reviewer that runs offline with Local LLMs with Ollama: what it rewards, where it breaks, and how to keep the workflow honest.
-
Local LLMs with Ollama: Quantisation choices that actually matter for code
A field-tested take on quantisation choices that actually matter for code with Local LLMs with Ollama: what it rewards, where it breaks, and how to keep the workflow honest.
-
Local LLMs with Ollama: RAG over internal docs without handing them to a third party
A field-tested take on RAG over internal docs without handing them to a third party with Local LLMs with Ollama: what it rewards, where it breaks, and how to keep the workflow honest.
-
Caching embeddings locally for a private retrieval layer
Running retrieval against a local Ollama embedding model is easy. Not re-embedding the same document twice, and never letting anything sensitive touch an external API, is the part worth getting right. A local cache and a content hash do most of the work.
-
The Complete Mac AI Setup, 2026 Edition — Everything in One Guide
The complete guide to a Mac AI setup in 2026 — Ollama, Whisper, MLX, RAG, and local LLMs organized into four tiers by cost and time, with a RAM-to-model hardware table and honest guidance on when to stop upgrading.
-
Local LLMs with Ollama: When a local 7B beats a cloud 70B in latency-sensitive loops
A field-tested take on when a local 7B beats a cloud 70B in latency-sensitive loops with Local LLMs with Ollama: what it rewards, where it breaks, and how to keep the workflow honest.
-
Why I Downgraded From the Biggest AI Model — and Got Better Results
The contrarian case for small local LLMs on Apple Silicon. Why downgrading from a 70B to an 8-14B model improved real productivity through latency, iteration speed, and prompt discipline — plus the escalation rule for when big models still win.
-
Local AI Security — What Can Actually Leak and How to Lock It Down
Local AI security guide for Mac users. What actually stays on-device with Ollama, what leaks through telemetry and exposed servers, OLLAMA_HOST binding mistakes, Little Snitch verification, and a complete lockdown checklist.
-
The Backup Strategy for People With 500GB of AI Models
Storage and backup strategy for local AI model hoarders: deduplicating Ollama, LM Studio, and Hugging Face caches, Time Machine exclusions for model blobs, external SSD symlinking, and what actually deserves a backup.
-
Your Mac Can Watch Videos for You — Local Vision Models Explained
How to run local vision models on Apple Silicon with Ollama and LM Studio: reading screenshots, extracting receipt data, summarizing videos via frame sampling, plus RAM requirements and honest accuracy limits.
More posts tagged ollama
- Local AI for Students — The Study System That Beats Tutoring
- Make Siri Actually Smart — The Local LLM Bridge Trick
- Local LLMs with Ollama: Thermal budget of a MacBook pretending to be a server
- I Made My Mac Read Every Contract Before I Sign It
- LM Studio vs. Ollama — The Local AI Showdown Nobody Wrote Honestly
- The AI Reading Workflow That Lets Me Process 50 Articles a Day
- Run DeepSeek-Class Models on a Mac — The Complete Guide
- The Mac Terminal Commands That Unlock Hidden AI Power
- Local LLMs with Ollama: Running evals locally before trusting a new model
- The 7 AI Mistakes Mac Power Users Keep Making
- Why Every Writer Needs a Local LLM (and How to Set One Up)
- Local AI Translation Beats Google Translate — and It's Private
- Apple Shortcuts + AI Is the Automation Stack Nobody Talks About
- Local LLMs with Ollama: Pairing Ollama with Continue or Cline for a private IDE
- Your Mac Studio Can Replace a $1,500/Month AI API Bill
- The Raycast AI Workflow That Replaced 5 Mac Apps for Me
- Apple Intelligence vs. Local LLMs — What Apple Doesn't Tell You
- Your Mac Can Summarize Any YouTube Video in 30 Seconds
- The AI Coding Setup That Made Me 3x Faster on My MacBook
- I Built a Private ChatGPT for My Family on a Mac Mini
- Local LLMs with Ollama: Keeping a small local model honest with tight prompts
- Your Mac Is a Local AI Supercomputer You're Using at 10% Capacity
- Local LLMs with Ollama: Picking a local model for the specific task, not for the benchmark
- Local LLMs with Ollama: Sunday-afternoon project: your own code reviewer that runs offline
- Local LLMs with Ollama: Quantisation choices that actually matter for code
- Local LLMs with Ollama: RAG over internal docs without handing them to a third party
- Local LLMs with Ollama: Caching embeddings locally for a private retrieval layer
- Local LLMs with Ollama: When a local 7B beats a cloud 70B in latency-sensitive loops
- Local LLMs with Ollama: Thermal budget of a MacBook pretending to be a server
- Local LLMs with Ollama: Running evals locally before trusting a new model
- Local LLMs with Ollama: Pairing Ollama with Continue or Cline for a private IDE
- Local LLMs with Ollama: Keeping a small local model honest with tight prompts
- Local LLMs with Ollama: Picking a local model for the specific task, not for the benchmark
- Local LLMs with Ollama: Teaching a team to trust a model they own end to end
- Local LLMs with Ollama: First honest benchmark between local and cloud models
- Local LLMs with Ollama: Cost-per-token in wall time, discovered by accident
- Local LLMs with Ollama: Air-gapped development as a serious practice, not a demo
- Local LLMs with Ollama: Pairing Ollama with Continue for a first private IDE setup
- Local LLMs with Ollama: Offline code reviewer that survived a flaky Wi-Fi week
- Local LLMs with Ollama: Caching embeddings locally for a beginner RAG
- Local LLMs with Ollama: Moment a local 7B beat the cloud on a real task
- Local LLMs with Ollama: Local evaluations that predicted our first cloud regression
- Local LLMs with Ollama: Quantisation choices with incomplete information
- Local LLMs with Ollama: Thermal limits on the first serious local code session
- Local LLMs with Ollama: Private RAG pipelines, assembled out of a weekend of curiosity
- Local LLMs with Ollama: Picking a local model for code without benchmarks to lean on
- Local LLMs with Ollama: First week running Ollama on a work laptop
- Local LLMs with Ollama: Teaching a team to trust a model they own end to end
- Local LLMs with Ollama: First honest benchmark between local and cloud models
- Local LLMs with Ollama: Cost-per-token in wall time, discovered by accident
- Local LLMs with Ollama: Air-gapped development as a serious practice, not a demo
- Local LLMs with Ollama: Pairing Ollama with Continue for a first private IDE setup
- Local LLMs with Ollama: Offline code reviewer that survived a flaky Wi-Fi week
- Local LLMs with Ollama: Caching embeddings locally for a beginner RAG
- Local LLMs with Ollama: Moment a local 7B beat the cloud on a real task
- Local LLMs with Ollama: Local evaluations that predicted our first cloud regression
- Local LLMs with Ollama: Quantisation choices with incomplete information
- Local LLMs with Ollama: Thermal limits on the first serious local code session
- Local LLMs with Ollama: Private RAG pipelines, assembled out of a weekend of curiosity
- Local LLMs with Ollama: Picking a local model for code without benchmarks to lean on
- Local LLMs with Ollama: First week running Ollama on a work laptop