knowing when to end an affair