I agree... you need to evaluate whether you think the parents will be willing to adapt with you, and help you here. If you think that they will, and that what's going on right now is just due to ignorance/new parenting, then you can move forward. State your expectations, and ask them to do what you feel they need to.
If you have the idea, though, that no matter what you say it's not going to change anything; I would terminate, under the idea that it's just not the right fit. You will just be beating your head against the wall, until you end up terminating eventually anyways.
GOOD LUCK!!