Don’t do storyline missions or any regular ones where you’re attacking them. If you only choose pirate missions and ignore storylines, you shouldn’t suffer a decrease to the others. Train up your social skills though. They help in that regard significantly.