Tagging @Tamasg odorediamanka600-source/FYLs-G2P: A lightweight hybrid G2P engine with less than 1.8M parameters and can be deployed on any devices (almost) github.com/odorediamanka600-source/FYLs-G2P
@fastfinge oooh this looks really neat. Only English - other languages would still need eSpeak or another solution. Also, no sentence-level prosody - FYLs-G2P doesn't output intonation/prosody markers. Hmm.
@fastfinge also bundling Onnxruntime (but maybe easier as a DLL module not full Python bloat?) for older NVDA. This would be smaller than your Gruut experiment: I'm looking at about 11 MB for the lightweight model, and then another 15-20 MB for onnxruntime DLLS, then anothr 20 MB for numpy. Which it also requires. So in total the add-on would become 80 MB. We could do a mechanism where we use this G2P for English only but other G2Ps or Espeak for foreign languages.
@fastfinge and it has zero tuning for single-letter names, which is great. I realized this really quickly, "G" is pronounced as "gwee" and "h" as "hu" haha! So yeah, we'd have to override every single English language letter as a normalization rule, yikes.
@Tamasg I suspect you're going to wind up training your own g2p model. Eloquence can already output its phonemes, so you'd just have to write a script to convert from eloquence to IPA, and then you could just make a bunch of training data.
@fastfinge yeah but, like, lag. I'm noticing it is really really bad when doing full sentences, because it all gets pushed to the G2P. i actually don't think these are viable for relying on Onnxruntime too much and being slower on even worse CPUs - what if someone runs it on something as low-end as an Intel Atom? It's going to take 10 seconds to process the ONNX conversion part. Hmm.
@fastfinge ah darn. not multilingual kind of stings. I think it's why I built Speechbox. Hungary is as much at of an "only comercial TTS is available that sounds horrible with some words" problem as we are with the antiquated eloquence problem for US English. People there only have comercial TTS options for their screen reader, and or Espeak. JAWS switched to using Vocalizer Hungarian voice, over the homegrown Profivox voice. Americans would cry if they had Hungary's TTS situation lol.
@fastfinge But I mean look at this bad list. the lexicon has decent coverage of common words, but the neural model for OOV words is really struggling with compound words and tech terms. And even some in-lexicon words have weird outputs. • equals → ˈikwᵊlz (OOV, wrong - sounds like "eekwulz") • dropdown → truncated W at end • firefox → truncated • bluetooth → truncated • youtube → truncated (jˈutˌu) • github → truncated (ɡˈɪt) • stackoverflow → truncated • localhost → wrong • ctrl → garbage • alt → garbage (ˈI = "eye"??) • spacebar → wrong (spˈAsbˌɑɹ = "spaysbahr") • wifi → wrong stress pattern • combobox → OOV • focusable → OOV, wrong This is a research-quality G2P, not production-quality for screen reader use is sadly my final conclusion.
@Tamasg Also, another stress test I've been using on text to speech systems lately is the name of my friend "Hrvoje". It's croatian, and pronounced "her voy yay". Every AI text to speech system does something new and awful with it. So does every klatt system haha.
@fastfinge oh my gosh I know that person. Cattic I believe is last name. Yes. I'm very glad you two are friends :) Yep. met in high school I think or something like that, back in the good old days of Live Messenger. Haha.
@fastfinge hahahahahaaha well I'm always more surprised when it's someone international, because honestly the blind community operates in little cliques too especially in ones that don't cross international boundaries as far. Argueably the web has improved this a lot in some groups but not all.
@Tamasg Yeah true. I remember one time I was on the train, and a random sighted person said to me "Hey! There's another blind person just down the car! Don't you two know each other? Why aren't you sitting together? Here, I'll take you to him." I was like "No, I'm traveling alone. We're not together." Then the other blind person overheard the conversation, and it turned out we'd known each other for years. So we sat together and chatted for the rest of the train ride. I was so tempted to pretend I didn't know him at all, just so I didn't validate this random sighted person's stereotypes.
@fastfinge lol the irony in that story isn't lost at all! Hahahaa too funny. I had similar experiences when at Microsoft because I would know people who were blind working there, but then at times I'd go out to a bar or somewhere and same thing. Sighted person asks if I know the blind man sitting across the bar, I'm like "probably not, ha, ha!" but start chatting and it's a one of my coworkers who's blind and happened to be in the same bar. So yeah, that feeling's real :D
@fastfinge@Tamasg Hehehe tru dat! There's a blind dude that supposedly looks like me. I was walking close to the CNIB once and this guy kept wanting me to go into his house to tune his piano. I finally clued in and told him that was my brother. Turns out I know him, so I called him to tell him that we were mistaken as each other again.
