It horrible habit and I always tell child to take out of mouth. Very small child, I would gentle pull fingers away from mouth. It might not be totally broke habit if not being correct at home but it normally enough to make sure child removes finger, during time here.