All stories
250 stories found
Open WebUI Ignoring Your Uploaded Documents? Fix It
The upload succeeded, the file shows in the sidebar, and the model still says it has no access to the document. Here is what is actually going wrong.
Make Ollama Start on Boot: A systemd Service That Works
The install script sets up a service that works on a desktop and quietly fails on a headless box. Here is the unit I actually run.
Why Ollama's First Response Is Slow (Cold Start Fix)
The first prompt after a pause takes forever, then everything is fast again. That is a model load, not a slow GPU — and it is fixable.
Running Two Local Models on One GPU Without Crashing
A coding model plus an embedding model on one 16 GB card is doable — but only if you budget VRAM deliberately instead of hoping.
Fix Roo Code Ollama Connection Errors in 5 Steps
Stop connection refused errors, CORS failures, and context crashes when connecting Roo Code to local Ollama models. Here is the step-by-step fix.
Fixing Painfully Slow Whisper Transcription
Base Whisper is a reference implementation, not a production tool. If your transcriptions take as long as the audio itself, here is the exact stack I use to get 10x to 30x faster speeds locally.
Fix Open WebUI Showing No Models in the Dropdown
If Open WebUI is running but your model dropdown is empty, you likely have a Docker networking mismatch or an unpopulated Ollama instance. Here is the exact fix.
Fix Continue in VS Code Not Connecting to Ollama
If your Continue extension in VS Code is throwing ECONNREFUSED or failing to fetch from Ollama, the fix is usually a mismatch between Node.js IPv6 resolution and your config.json file.
Secure Ollama with Nginx, HTTPS, and a Password
Stop exposing your raw Ollama port to the internet. Here is exactly how I put Ollama behind Nginx with a real SSL certificate and password protection so I can access my local models safely.
How to Stop Ollama From Unloading Models (keep_alive)
Ollama unloads models from VRAM after 5 minutes of inactivity. Here is exactly how to use the keep_alive parameter to force your models to stay loaded so you never wait for a cold start again.
A One-File Docker Compose Stack for Ollama and Open WebUI
Run Ollama and Open WebUI together effortlessly. This single Docker Compose file handles networking, data persistence, and Nvidia GPU passthrough so you can start prompting immediately.