Yes, I get that with Vietnamese too (I'm not a native speaker, so it's a learned language for me too). Although at least with Vietnamese if you can read a word you can pronounce it - with Chinese there's also the problem of learning a new character and not knowing how to say it.