"Let go" of it might be a better way to put it. [Giving up implies that he had stopped trying, when really what he had done was start trying harder.]

The Survey Corps is a fucking shitty place to be, not gonna lie. But I'd rather die doing something than live doing nothing.