Natural fibers will still combust with shocking speed without flame retardants, they just won’t stick to you while doing so. From the moment of being exposed to flame to the point at which the entire garment is on fire can be as little as a few seconds. No matter the increased risk I still rather keep the flame retardants, because death from large burns is a nasty way to go.