Note by @fastfinge

Matt Campbell @matt@toot.cafe

2w

Question for blind people who use LLM coding agents, vibe-coding or otherwise: Have you done any useful coding projects with a local, open-weights model yet? If so, what agent harness do you use? Is there one that works with at least one local model and has a reasonably accessible UI?

1

8

0

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

2w

@matt @jonathan859 That question isn’t all that meaningful. Kimi k3 can run on a Mac mini and is about as good as gpt4. With an OpenAI compatible endpoint you can then do whatever you want. But I suspect “run a separate computer just for AI” may not have been what you meant. But I’ve moved eighty percent of what I do to k3. But that’s more running the server myself, not running a local model on my laptop.

1

0

Matt Campbell @matt@toot.cafe

2w

@fastfinge I'm still interested in knowing how you do it. Do you actually run Kimi K3 on a Mac mini, or something else? Using Ollama or some other tool? And what coding agent do you use with it?

4

0

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

2w

@matt I currently use Hermes Agent with it to handle server monitoring, network diagnostics, troubleshooting, and basic admin tasks. I also use it with Hermes Agent to produce and handle batch scripts and services: a lightning strike monitor that sends me notifications when lightning is near, a security monitor that emails me new vulns for anything I run, a price checker that checks prices at my local grocery store and sends me any significant downward changes, a speedtest monitor, uptime monitors, and various other jobs. I'm working on moving stuff over to opencode for coding on Windows; right now Hermes can only run code on mac or Linux, so is of no use for the Windows projects I have in the pipeline. I do use Hermes to maintain my hermes-xmpp plugin and submit changes to the hermes-deltachat plugins with K3, because it can easily run and test both of those codebases.

1

2

0

Josh @Orinks@mastodon.stickbear.me

2w

@fastfinge @matt I love Hermes, but over time I've gradually moved back to Claude Code/Codex for actual coding work. Hermes is great for jobs like monitor these server logs over a 12/24 hour period and let me know if anything abnormal happens etc

2

1

0

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

2w

@Orinks @matt The nice thing about Hermes is that you can use it on your phone, without being locked into some particular company's app. It can also access your memories from other sessions; I use hindsight for memory storage and rag. It can also be configured to shell coding tasks out to claude code or codex via the command line. The only issue I have with it is that there's no easy way to get it to run code on a remote machine. Well, okay, there is: it can ssh into another Linux machine, and I let it do that sometimes. But if I want to build and test on Windows, Hermes just can't help me. I'm looking into buzz for this purpose, but Buzz has other annoying accessibility issues.

1

0

Josh @Orinks@mastodon.stickbear.me

2w

@fastfinge @matt Yeah, I just downloaded Buzz myself and am having trouble setting up the CLI bridges for Codex and Claude.

1

0

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

2w

@Orinks @matt It took me like two days to set up a relay. Getting Hermes into it was easy. But adding the other agents was super annoying. And then when you set up your own relay, notifications on the phone app don't work. If it's not self-hosted first, I'm just not interested. And it looks like buzz is only pretending.

1

0

Josh @Orinks@mastodon.stickbear.me

2w

@fastfinge @matt Only pretending to be self-hosted? I don't recall it being self-hosted, just able to run local LLMs etc.

1

0

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

2w

@Orinks @matt If you don't run your own nostr relay, you depend on there servers and infrastructure for accounts, etc. You can set up your own relay though. They've just made it an annoying process so you don't.

0