Some might disagree with me but you have the right to leave immediately and owe nothing. You entered into a contract for care and with that comes obligations of the caregiver. If what you are saying, unchanged diapers, etc. are true then the caregiver has breached the contract and you can void it. I assume you are providing the diapers. Do you do this on a daily basis or did you give the caregiver a full package. In the diaper bag you would be able to count the diapers and food provided.

As far as the eating goes it is very common for a child to refuse to eat for the caregiver until they feel comfortable. The child may be very fussy and not settling in and the provider finds it easier to just leave the child to their own devices rather than deal with the tears. If that were your only complaint I would say give them a chance to learn to like each other but since there are other issues then yes you should take your baby and find a new arrangement.