@fastfinge

Admin

completely blind computer geek, lover of science fiction and fantasy (especially LitRPG). I work in accessibility, but my opinions are my own, not that of my employer. Fandoms: Harry Potter, Discworld, My Little Pony: Friendship is Magic, Buffy, Dead Like Me, Glee, and I'll read fanfic of pretty much anything that crosses over with one of those.
keyoxide: aspe:keyoxide.org:PFAQDLXSBNO7MZRNPUMWWKQ7TQ

Location Ottawa

Birthday 1987-12-20

Pronouns he/him (EN)

matrix @fastfinge:interfree.ca

keyoxide aspe:keyoxide.org:PFAQDLXSBNO7MZRNPUMWWKQ7TQ

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@hosford42 When it comes to requirements, in general, if it can work with both the SAPI5 and NVDA addons API, it will suit the requirements of speech dispatcher on Linux and the mac API's. The important thing is that most screen readers want to register indexes and callbacks. So, for example, if I press a key to stop the screen reader speaking, it needs to know exactly where the text to speech system stopped so that it can put the cursor in the right place. It also wants to know what the tts system is reading so it can decide when to advance the cursor, get new text from the application to send for speaking, etc. I really really really wish I had a better example of how that works in NVDA than this: github.com/fastfinge/eloquence_64/blob/master/eloquence.py

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@hosford42 Absolutely yes to all of the above. I can think of another 10 people on Mastodon at minimum who are also ready and willing to help where ever they can. Just none of us with the skillset to do the actual work.

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@hosford42 Sadly, this is so far outside of my expertise and abilities it's not even funny. I have an excellent handle on what's needed, and the vague shape of the path forward, but actually doing any of it is way outside of my skillset. If it was anywhere near something I could do, I would have started already. :-)

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@hosford42 Also, if you enjoy comparing modern AI efforts with older rule-based text to speech systems, and listening to the AI fail hard, this text is wonderful for that. As far as I'm aware not a single text to speech system, right up to the modern day, can read this one hundred percent correctly. github.com/mym-br/gnuspeech_sa/blob/master/the_chaos.txt

But eloquence gets the closest, gnuspeech second, espeak third, dectalk fourth, and every AI system I've tried a distant last.

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@hosford42 If you're going to reimplement something, you might be better to go with gnuspeech, as it's known to be in the GPL. At the least, it gives you a vocal model to improve on, that was coded with open research in mind, rather than proprietary code probably written for job security.

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@hosford42 I also have no idea about any associated IP or patents, though. Wouldn't whoever does it need to be able to prove they never saw the original code, just its outputs? Otherwise you're still infringing, aren't you? In this regard, it's probably actually a bad thing that the dectalk sourcecode is so widely available.

And most of the commits seem to be about just getting it to compile on modern systems with modern toolchains. I dread to think how unsafe closed-source C code written in 1998 is.

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@RegGuy @hosford42 The issue is that then you lose all semantic meaning. Older screen readers did, in fact, work like this, especially back in the DOS days. But also, you're conflating two different systems, here: the text to speech system, and the overall screen reading system. All the text to speech system does is take text, and turn it into speech. The screen reader is responsible for everything else. And in general, we have perfectly good screen readers. Screen readers can also, by the way, drive Braille displays and other output devices.

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@hosford42 In general, for training the rules for pronouncing English, the CMU pronouncing dictionary is used: www.speech.cs.cmu.edu/cgi-bin/cmudict

When it comes to open-source speech data, LJSpeech is the best we have, though far from perfect: keithito.com/LJ-Speech-Dataset/

And here's a link to GnuSpeech, the only open-source fully articulatory text to speech system I'm aware of: github.com/mym-br/gnuspeech_sa?tab=readme-ov-file

I'm afraid I don't have any particular data of my own.

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@hosford42 The sourcecode for dectalk is out there. Unfortunately, It's...legally dubious at best. It was leaked by an employee back in the day, and now the copyright status of the code is so unclear that nobody can safely use it for anything, but also nobody can demonstrate clear enough ownership to submit a DMCA and get it taken off github. GNUspeech is also pretty close to what's needed, but it won't even compile without all the NeXT development tools, I don't think. So at best all that would be is a base for something else; modernizing it would probably effectively be a complete rewrite anyway.

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@hosford42 The reason I say systems-level programming is mostly because for a text to speech system used by a blind power user, you need to keep an eye on performance. If the system crashes and the computer stops talking, the only choice the user has is to hard reset. It would be running and speaking the entire time the computer is in use, so memory leaks and other inefficiencies are going to add up extremely quickly.

From what I can tell, the ideal is some sort of formant-based vocal tract model. Espeak sort of does this, but only for the voiced sounds. Plosives are generated from modeling recorded speech, so sound weird and overly harsh to most users, and I suspect this is where most of the complaints about espeak come from. A neural network or other sort of machine learning model could be useful to discover the best parameters and run the model, but not for generating audio itself, I don't think. This is because most modern LLM-based neural network models can't allow changing of pitch, speed, etc, as all of that comes from the training data.

Secondly, the phonemizer needs to be reproducible. What if, say, it mispronounces "Hermione". With most modern text to speech systems, this is hard to fix; the output is not always the same for any given input. So a correction like "her my oh nee" might work in some circumstances, but not others, because how the model decides to pronounce words and where it puts the emphasis are just a black box. The state of the art, here, remains Eloquence. But it uses no machine learning at all, just hundreds of thousands of hand-coded rules and formants. But, of course, it's closed source (and as far as anyone can tell the source has actually been lost since the early 2000's), so goodness knows what all those rules are.

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@hosford42 Sadly, there is no money in solving any of my problems. If there was, someone would have solved them. See, for example, my complaints about text to speech systems. stuff.interfree.ca/2026/01/05/ai-tts-for-screenreaders.html

I can go into more detail about why all the options are bad if you want. But this is the sort of problem that eats years of your life, requires advanced mathematics (digital signal processing at a minimum), and advanced linguistics, on top of being a good systems-level programmer.

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@Tamasg Have you tried Gemini? I find it's the best for stuff where I don't know exactly what I want.

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@MostlyBlindGamer But I can't really make a proof of concept that works the way I want it to until all the plumbing exists.

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@jscholes Maybe. I've played enough of this style of game that I have pretty strong opinions about how it should all work, though.

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@MostlyBlindGamer @RegGuy You're probably right about localization. The rest? Yeah, I totally will.

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@jscholes If I ever finish the basics, the thing I'm aiming for, probably in 70 years or so, is a singleplayer trade wars/elite style space game. Planetary exploration, trading, combat, procedurally generated galaxy, etc. All the stuff we have in that style is either multiplayer PVP, or only semi-accessible like smugglers5. Interface via console menus, because that feels both simple and retro. But with stuff happening in realtime like textspaced used to be (it's now discontinued), and high quality sound. The idea is you just let it run on your taskbar and check in every 20-30 minutes when you hear something that needs doing. So kind of casual all-day play while multitasking. I've dreamed of something like that for like 20 years, but nobody has done anything even close. Textspaced was the nearest, but it never quite got there, and it's gone, now.

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@jscholes Hah. So this all started when I decided I wanted a class where I could create a new menu, add the selection key, a name, and a callback function for each item, then call the menu to print itself and do all the input and error checking, and call the callback for whatever item was chosen. And then it just kept growing. I'm not even at the object graph stage. I just hate most of the text games I mentioned, where every menu looks and acts different, because print statements and case statements are just sprinkled all over the code.

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@MostlyBlindGamer @RegGuy And we haven't even talked about localization. Because if I want that it has to be done at the start, or else it becomes a huge impossible thing later.

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@jscholes If I do it that way, it just means refactoring later, though. And that's even harder and less fun because now you're rebuilding things that already exist.

🇨🇦Samuel Proulx🇨🇦 @fastfinge@interfree.ca

@MostlyBlindGamer @RegGuy Right, but it would take me just as long to understand someone else's engine as it would to right my own. And none of them do quite what I want, anyway. IE a terminal window with options you select by entering a single number or character and pressing enter. They're all command-based. But if I want sighted players I have to think about output colors. And so that means a settings object. And some people want ASCII boarders ("---------" etc) and some don't. So now we have a bunch of case statements and need to check colour and ascii art settings. And if we're doing that we might as well do sound, too, to have an earcon when prompting for an option and a click when an option is selected. But now that means an audio library. And utilities to think about file paths and including assets. And now we're at 2000 lines just for menus.

❮ Previous page Next page ❯