I would keep TTC too. My SIL put off TTC for a whole year cos her sister was getting married in Oz and she was going to be bridesmaid. When they finally started they got no result, and eventually found out they both had fertility issues. IVF didn't work and they have now adopted 3 kids, so it's a happy end, but they didn't achieve anything by putting TTC on hold. Go for it - your family will understand
