Man I need to get off my ass and do that. I almost did last year but then some news dropped about firmware backdoors discovered in some routers, and I got scared lol.
To anyone else like me who wants to do it, there is a big list of supported hw by OpenWRT here. Also you can click around, they have listings for other mfgs.
+1.
I. Fucking. Hate. Cloudflare.
It’s such a huge % of the internet now. Intercepted by cloudflare. Which says I “passed”. But then, gets stuck in an endless reload loop back to the cloudflare page. And never forwards me to the site itself.
Sometimes it does work. But at least half the sites, it doesn’t. Totally normal things. Like recipe sites. Or a site cataloging vintage toys.
This shit is making the internet unusable for anyone who tries to keep their privacy from the co’s that track every click you ever make, every site you read. I get it, sites need protection against DDOS attacks and stuff. But there has got to be a way w/o so much collateral damage.
If you ahve a mid range or above GPU you can run local models. You can even run them in a VM or firejail so they do not get any network access.
But please use llama.cpp, not ollama. Ollama has a storied history of poor behavior toward the OSS community. It used llama.cpp as its core tech, while trying to conceal that it did. It refused to disclose that, despite being required by the MIT open source license. It took venture capital money as it concealing its reliance on llama.cpp. And layering closed source components on top.
Lots more info here, and many other sources. It made bad technical choices and acted sleazy toward OSS projects. Pls don’t reward this kind of behavior. It’s better to directly use llama.cpp. Also there is less obscuration that way, since ollama insists on misleading renamings, etc.
Friends Don’t Let Friends Use Ollama
Under the hood, it was llama.cpp doing all the work. For over a year, Ollama’s README contained no mention of llama.cpp. Not in the README, not on the website, not in their marketing materials. The project’s binary distributions didn’t include the required MIT license notice for the llama.cpp code they were shipping. This isn’t a matter of open-source etiquette, the MIT license has exactly one major requirement: include the copyright notice. Ollama didn’t.
0 points on Router question in !privacy@lemmy.ml ·
Yes, you are certainly right. At least as far as the firmware goes. But then I started thinking about how powerful the incentive is, to compromise hardware too, or other components that run their own separate firmware that isn’t the one you can replace with OpenWRT. Although I have no evidence of that happening, so I’m prob just too tinfoil hatty about it.
But yah. You make a good point. I shouldn’t let the perfect be the enemy of the good.