I leave them in. I have a 3.5 year old that takes hers out when she naps. When she wakes up I put it in her bag. I find most parents don't use clips until the child is old enough to not put things in their mouth anyways