When either selecting to start a Private match or trying to join a friend in their Private match (either way) I would receive the "Unable to join match as a party" message:

(click image to enlarge)

But I wasn't in a party and neither were they.

We managed to fix it most the time by exiting Nosgoth and then re-loading it and remaking the Private Server.