My buddy built this huge cardboard castle for his daughter's birthday. Used hot glue on every single seam because he wanted it to look clean. Thing was solid as a rock for the party. Two days later he tried to drag it to the garage and the whole front wall just snapped off in his hands. All that time spent on tiny glue lines and it broke in one move. He said he should've just run tape down the inside corners. You live and you learn I guess.

The gas smell giving you a headache by noon is what got me. Like, you're breathing that stuff in for hours on a glue down? No wonder your head was pounding. And the jamming every 20 shots would drive me nuts. That's a ton of stopping and messing with it all day. Four thousand square feet is already a long day without the tool fighting you the whole time.

Did you check your GPU memory during the run or just after it crashed? Because that spike could also be from the log writing itself if wandb was buffering a lot of data on the same card. Next time try watching nvidia-smi in a second terminal while it trains, you'll usually see the memory creep up right before things go sideways.