I think it’s a huge component for a lot of people. A book I recently read and LOVED was Women’s Bodies, Women’s Wisdom by Christiane Northrup. It is about women’s health and a lot about emotional and psychological components. Another good one on emotional stuff and infertility specifically is Conquering Infertility by Alice Domar.
It’s definitely a difficult thing to think about because it’s a a lot harder to control than diet, but look into those books, particularly the first one. It’ll give you things to think about.