Actually depends on the design. A 45 degree offset can spread the weight better than a straight vertical stack in some cases. It's all about how the bricks are laid and supported. Seen some wild ones that have stood for a hundred years.
Hold up, @anthony_jackson, I actually feel you on that - it does seem backwards at first glance. I've seen enough old houses to know that masonry is trickier than it looks though. You ever had a chimney that had to be rebuilt?