Falling for a Married Taurus Man. What to do?

I am falling hard for a married Taurus man. I cannot even explain how I feel when we are together in so many words. The energy is electric! So much sexual tension. I can't take it anymore! He is intelligent, hilarious, caring, sensitive, AND gorgeous.

When we are together, he jokes around and teases me (in a playful/sexy way), which I love, but I hate that this kind of flirting is going on when he's taken. (One time, while we were arguing over something silly, he said quite loudly, "wow, there is so much sexual tension between us!" He said later that he'd said it as a joke to see the reactions of the people around us, but I could feel it on my end.)

As a Cancer woman, I value family (a lot). This is where my dilemma lies. I know that he is not getting the kind of love and affection that Taureans crave (from his wife), but I think he is staying in the relationship for his children (he's an incredible father). I would never want to be the cause of a broken home, so I am at a crossroads. Should I continue to be his friend and silently suffer, or cut off contact with him?

What do you think?