When I was having my babies, both were overdue. They induced me both times and I was in hospital waiting to go to the delivery room for 2 nights each time. They sent my husband home then which the first time wasn't too bad because nothing was happening. He didn't got till sometimes gone midnight and he was back in at 7am so I didn't really realise he was gone.
However the second time they induced me my body reacted very quickly and they sent him home whilst I was having really strong contractions. They did an internal and a stretch and sweep just before he was sent home and then told me to go to sleep. Obiviously there was no way I could sleep because I was having contractions and I'd already been told that I was 3cms dilated!

At 3am I was screaming for pain relief and to be taken to a delivery room but in the end they gave me drugs to stop the contractions as they said I was at the stage where they could just pop my waters when they had room for me to be delivered. That was a horrible night and I wish I'd complained really.
I would definately have a word with your midwife about your worries. The reason why I was told that he couldn't stay was because it was invasive for the other women but I think if you really push for it, they can't force him to go home.