User avatar
Matt Campbell @matt@toot.cafe
2w
Question for blind people who use LLM coding agents, vibe-coding or otherwise: Have you done any useful coding projects with a local, open-weights model yet? If so, what agent harness do you use? Is there one that works with at least one local model and has a reasonably accessible UI?
1
8
0
0
User avatar
🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca
2w
@matt @jonathan859 That question isn’t all that meaningful. Kimi k3 can run on a Mac mini and is about as good as gpt4. With an OpenAI compatible endpoint you can then do whatever you want. But I suspect “run a separate computer just for AI” may not have been what you meant. But I’ve moved eighty percent of what I do to k3. But that’s more running the server myself, not running a local model on my laptop.
1
1
0
0
User avatar
Matt Campbell @matt@toot.cafe
2w
@fastfinge I'm still interested in knowing how you do it. Do you actually run Kimi K3 on a Mac mini, or something else? Using Ollama or some other tool? And what coding agent do you use with it?
4
0
0
0
User avatar
🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca
2w
@matt Yup, it runs on a mac with deltafin: github.com/gavamedia/deltafin
0
0
1
0