It's her choice whether to keep the baby. It's you choice whether to divorce her. You are in a position to out the pastor's very inappropriate behavior (his efforts to hide his indiscretion are more offensive than the original indiscretion, in my opinion). Nevertheless, I’d leave that decision to the pastor, your wife and higher powers.