Tactically. Well... and for a lot of other reasons.

My Pops was protecting Fishman Island, and best friends with the King, but it's the only through-way point to get from one half of the Grand Line to the next so it's highly desired. And in the wrong hands slavery would flourish.