User avatar
Elizabeth therian cascadia 🏳️‍⚧️ @Elizafox@treehouse.systems
1w
I’m convinced local models will absolutely demolish the commercial ones eventually as they get better and better.

Why?
Despite what people want, it is increasingly obvious this isn’t going to go away; wishing it would very very hard won’t make this happen
Local models are rapidly improving and almost as good as the commercial ones
One may complain about it being slop but most commercial code is slop. They basically hire horribly-paid temporary contractors; LLMs are not worse than them, because $30 an hour gets you a shitty and desperate programmer, and that’s what many companies are often willing to pay for projects that aren’t critical (or depressingly, sometimes ones that are). Commercial companies are who’s going to be using local models, to replace these awful contractors and H-1B slaves.
The costs upfront are much more but the long-term costs after are low
Not having to pay rent to OpenAI or Anthropic is appealing especially given the strategy is obviously to create dependence on them
You can run your local models in a few cabinets for a whole company; no lake-draining required, no token limits

You don’t gotta like it (yes, tech is going to have a competency crisis years from now) but this is what’s already starting to happen.
2
5
0
0
User avatar
🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca
1w
@Elizafox Local models could already replace meta glasses for blind folks. The primary issues are UX and protocol ones. There is no glasses connectivity standard, like for bluetooth headphones. So every pair you purchase locks you into a particular app. New phones are already powerful enough to run them, but Apple and Google lock everything down so the only models that are allowed to run in the background are the cloud ones provided by them. Will this ever be fixed? No. The people who could fix it are too busy hating all AI, so blind folks will continue to use AI from Facebook and Google. Because once AI that is good enough exists, they take away the humans and other services we used to depend on, forcing us all onto the AI, like it or not.
0
1
0
0