I mean, if Garp really cared about justice, then Arlong wouldn't have been free to loot and rape for literally a decade, right? I mean, he's given no indication he's the type of Marine who believes in sacrificing the lesser cause for the greater cause, so it's not like he should turn a blind eye to Arlong for just a Jinbe.