A husband shared his wife with neighbors in a steamy swap