I would say...always follow your heart/gut! Even if the decision puts the others in an uncomfortable spot...you need to think about YOURSELF first! Exactly like you wrote...they could up and leave in a heart beat without giving it much thought.
I have only been open since January and already had to make 2 huge decisions. One cost me a friendship...and in a small town with our kids being the exact same age, it is very awkward BUT I had to do it for ME, my family and my program and I don't regret it at all.