Cause Of Infertility: After a year of trying, infertility is defined as the inability to conceive. Infertility in women can be caused by endometriosis, uterine fibroids, and thyroid issues. Infertility in men can be caused by a low sperm count or testosterone levels. Your odds of being infertile rise as you get older.