Yikes. Sorry you have to deal with this. This would be pretty awkward and hard for me to deal with. I hope you can find a good solution.
On one hand you like the kids and mother and would be losing two kids incomes but I can see where it is a struggle to have to deal with angry and disrespectful outbursts. That is just not right or healthy for anyone.
Good luck