Note by @fastfinge

@ppatel @Tamasg Good luck with that. The more I dig in, the more complex it all gets. But you could make a big difference if you focused on the phonemizer (IE going from text to IPA). Then we wouldn't depend on espeak at all anymore, and would effectively be a speech engine from scratch. The phoneme editor includes support for third party phonemizers already, so you can test easily.