In an interview with 'Howard Stern', Ben admits that the negative media attention put a strain on his first relationship with Jennifer Lopez.
"I would say it was about 50 percent [of what destroyed our relationship]. The idea that people hate you and they hate you together and that being together is poison and ugly and toxic and the thing none of us want to be part of,” the Tender Bar actor said on SiriusXM's The Howard Stern Show. “And who the f**k would want to have them to dinner? And what the f**k are they doing together?’”
Affleck, 49, and Lopez, 52, began dating in 2002, became engaged in 2003 and called off their engagement in 2004
Now, Affleck admits that he did feel some hesitation about starting their romance over again because of his children
"Well, look, my responsibility to my children is the highest responsibility I have. So I won't do anything that's painful or destructive to them if I can help it”
source