On The Origin of Species by Charles Darwin Chapter 2 Page 14

one form is ranked as a variety of another, not because the intermediate links have actually been found, but because analogy leads the observer to suppose either that they do now somewhere exist, or may formerly have existed; and here a wide door for the entry of doubt and conjecture is opened.

Hence, in determining whether a form should be ranked as a species or a variety, the opinion of naturalists having sound judgment and wide experience seems the only guide to follow.

We must, however, in many cases, decide by a majority of naturalists, for few well-marked and well-known varieties can be named which have not been ranked as species by at least some competent judges.

That varieties of this doubtful nature are far from uncommon cannot be disputed.