On The Origin of Species by Charles Darwin Chapter 9 Page 26

these hybrids are remarkably sterile. On the other hand, there are species which can be crossed very rarely, or with extreme difficulty, but the hybrids, when at last produced, are very fertile. Even within the limits of the same genus, for instance in Dianthus, these two opposite cases occur.

The fertility, both of first crosses and of hybrids, is more easily affected by unfavourable conditions, than is that of pure species. But the fertility of first crosses is likewise innately variable; for it is not always the same in degree when the same two species are crossed under the same circumstances; it depends in part upon the constitution of the individuals which happen to have been chosen for the experiment.

So it is with hybrids, for their degree of fertility is often found to differ