You are meant to have a dip in temperature at OV then after your temp should rise and stay above your coverline. There isn't a particular temperature as eveyone is different. are you using a chart of website like FF?
See this is partly why I am not convinced about temping. According to OPKs and my gyn I Oed one day and then the next day I had still high-ish temps then a dip and only now it's raising a tad.