My families also just come in and don't knock. I can't be running to answer the door all the time. I would be keeping your door locked from now on until you are ready to open