Tag: ollama
-
Local LLMs with Ollama: RAG over internal docs without handing them to a third party
A field-tested take on RAG over internal docs without handing them to a third party with Local LLMs with Ollama: what it rewards, where it breaks, and how to keep the workflow honest.
-
Caching embeddings locally for a private retrieval layer
Running retrieval against a local Ollama embedding model is easy. Not re-embedding the same document twice, and never letting anything sensitive touch an external API, is the part worth getting right. A local cache and a content hash do most of the work.
-
The Complete Mac AI Setup, 2026 Edition — Everything in One Guide
The complete guide to a Mac AI setup in 2026 — Ollama, Whisper, MLX, RAG, and local LLMs organized into four tiers by cost and time, with a RAM-to-model hardware table and honest guidance on when to stop upgrading.
-
Local LLMs with Ollama: When a local 7B beats a cloud 70B in latency-sensitive loops
A field-tested take on when a local 7B beats a cloud 70B in latency-sensitive loops with Local LLMs with Ollama: what it rewards, where it breaks, and how to keep the workflow honest.
-
Why I Downgraded From the Biggest AI Model — and Got Better Results
The contrarian case for small local LLMs on Apple Silicon. Why downgrading from a 70B to an 8-14B model improved real productivity through latency, iteration speed, and prompt discipline — plus the escalation rule for when big models still win.
-
Local AI Security — What Can Actually Leak and How to Lock It Down
Local AI security guide for Mac users. What actually stays on-device with Ollama, what leaks through telemetry and exposed servers, OLLAMA_HOST binding mistakes, Little Snitch verification, and a complete lockdown checklist.
-
The Backup Strategy for People With 500GB of AI Models
Storage and backup strategy for local AI model hoarders: deduplicating Ollama, LM Studio, and Hugging Face caches, Time Machine exclusions for model blobs, external SSD symlinking, and what actually deserves a backup.
-
Your Mac Can Watch Videos for You — Local Vision Models Explained
How to run local vision models on Apple Silicon with Ollama and LM Studio: reading screenshots, extracting receipt data, summarizing videos via frame sampling, plus RAM requirements and honest accuracy limits.
-
Local AI for Students — The Study System That Beats Tutoring
A complete local AI study system for students: refurbished M1 MacBook with Ollama, Whisper lecture transcription, Feynman-technique prompts, Anki flashcard generation, and an honest take on AI vs human tutoring and academic integrity.
-
Make Siri Actually Smart — The Local LLM Bridge Trick
How to bridge Siri to a local LLM using Apple Shortcuts, Ollama's API, and Tailscale. Voice-query your Mac's AI from your iPhone anywhere, with the exact JSON config and realistic latency numbers.
-
Local LLMs with Ollama: Thermal budget of a MacBook pretending to be a server
A field-tested take on the thermal budget of a MacBook pretending to be a server with Local LLMs with Ollama: what it rewards, where it breaks, and how to keep the workflow honest.
-
I Made My Mac Read Every Contract Before I Sign It
How to review contracts with a local LLM on Mac. PDF to text extraction, a complete structured legal review prompt, context window settings for long documents, and why local AI matters for leases, NDAs, and employment contracts.
