It would have bother me too.
But what I would love to know is how wearing a house coat going to effect how you care for the children. Its not. But "first" impressions and all. As long as we are not wearing something too revealing what does it matter.