My sister in law was pregnant and scared she may get infected because she has a cat. So she talked to the vet and she replied in her typical uncouth way and said: just refrain from licking the cats ass, when she comes from the litterbox and you're good!
Where I live the typical recommendation is to skip cleaning the litterbox while you're already immune compromised (sick, pregnant, ...) and you don't have any trouble.