I don't understand why this should matter to voters. Guy's not seeking election as Husband of the Year. All the personality driven crap is what's wrong with politics. Policy is much more important.
A doctor having an affair with a patient and then pressuring her to undergo an optional surgical procedure for purposes of covering his ass rather than her medical need is a gross violation of professional ethics that surely casts doubt on someone's ability to maintain the public trust in office. This is totally consistent with thinking that extramarital sex shouldn't normally be politically relevant and that abortion isn't immoral as such.