On The Origin of Species by Charles Darwin Chapter 9 Page 62

The infertility which may be observed in various dimorphic and trimorphic plants, when they are illegitimately fertilised, that is by pollen taken from stamens not corresponding in height with the pistil, differs much in degree, up to absolute and utter sterility; just in the same manner as occurs in crossing distinct species. As the degree of sterility in the latter case depends in an eminent degree on the conditions of life being more or less favourable, so I have found it with illegitimate unions. It is well known that if pollen of a distinct species be placed on the stigma of a flower, and its own pollen be afterwards, even after a considerable interval of time, placed on the same stigma, its action is so strongly prepotent that it generally annihilates the effect of the foreign pollen; so it is with the pollen of the several forms of the same species,