This makes me happy, I'm very glad you removed your child from a bad situation and found a great caregiver.
My picture permission form gives me the right to use the photos and states that they are my possessions even after families leave my care but I promise that I will use the pictures on my website and no other place ever. If an ex-client asked me politely to remove their children's pictures from my website, no matter the reason, I'm sure I would do so. Lord knows I have enough other pictures to use! I hope you and the ex-caregiver can come to an agreement without too much trouble. LUCK!