a. It's not [other person's] fault, s/he didn't owe anyone anything, wasn't breaking any promises, etc.
b. Part of being a decent person is not getting involved with people who have a SO, [other person] is just as guilty, etc.
Which stance do you take? Why?
ETA: Assume the other person knows that the cheater is in a relationship.