I'd think that leaving the car unbuffed means that when you do get around to buffing, all the contaminants that have settled on your paint (which will happen unless you leave your car in a hermetically sealed environment) will potentially damage the finish as you rub them all over your paintwork...