Well I think you just explained why he is doing it, he is used to having a soother in his mouth all day and you are breaking him of the habit. I would reinforce "not in your mouth" and he should start to get it