Private AI that runs at home
Small open models running entirely on my own machines: an offline chat in the browser, and a home assistant that never leaves the network.
One version runs a model inside the browser, so after the first download it works with no connection at all. Another powers a voice assistant for the house on a model that is only reachable inside the home network.
What I’ve learned so far
Small local models are good enough for a surprising amount of everyday work, and slow enough to make you choose carefully what you ask them.