Correcting Errors or Just Let It Go?