I have it running locally, but speed is a problem. I have the 35GB model running on a PC with 64GB, a fairly new processor and a mid-level GPU. Ask a question, go drink a coffee.
I mean, it's great that so many models are open-source and readily available. That is hugely important. Running models locally protects your data. But speed is a problem, and likely to remain a problem for the foreseeable future.
Let's be clear: this is a first step. The obvious next step is to require proof of age.
This ties in nicely with the international movement to require ID to use social media.
Why is this an international movement? Suddenly, simultaneously, all over the Western world? It's enough to make on believe in conspiracies...