Party members' relationships. (Possible mild spoilers).

Hi, all.
Do party member fight amongst themselves in SoD?
Cause I am at the Crusaders' camp and I want to drop Minsc for Dorn and Dynaheir for Neera. My only concern is that Dorn is evil and the rest of the party are not. Would there be any consequences and how severe. Is it safe to go that route? Because I do not want anybody to leave or fight, or If I have to choose sides.