Clean as You Go, But Not Too Much