I agree with Tam, as long as you stay away from the cat poop there should be no problems. Either have your OH clean out the litter box for you (which is what I did as soon as we TTC

not necessarily for those reasons though...) If you can't avoid cleaning it out just wear gloves when you do and wash your hands thoroughly afterwards. There really is no reason to get rid of your cats while pregnant.