Because controlling whether some people are allowed to have children primarily affects women. Many many many women were sterilized against their will on the basis of this kind of question - women of color and women with disabilities especially. In practical, historical terms, men were much less likely to be sterilized "for their own good."