My guess: these men never learned how to maintain and care for a relationship or cannot stand up for themselves. At the beginning of a relationship everything is exciting and without maintenance (from both sides) it quickly goes downhill. I can imagine for some of those men this downhill part is their equivalent view of marriage / long term relationship. Which checks out if your experience is dominated by passive or active neglect from/of their partner ,