“Nothing once begun should be abandoned, unless it is proved to be morally wrong.”

Gandhi writes it as a rule of conduct rather than a piece of encouragement, and the exception matters as much as the rule. It separates perseverance from stubbornness, since only a proven wrong makes stopping legitimate.