The older brother suggests to his younger brother that they swap wives for a change of pace after the family gathering