That "power through" idea is what messes people up. You gotta do the opposite, work with the shake. If my hand is shaky, I loosen my grip and let the tool move a bit, using lighter, faster passes. On a bumpy wall, I follow the shape instead of fighting it, so the finish looks even even if the surface isn't. Trying to force it perfect just makes the flaws stand out more.
@noah_anderson93 that's actually a solid way to look at it - does that mean you sort of accept the wall has its own shape and work around it instead of trying to make it flat?