That pinch of seasoning is why you're not losing weight