Is anyone else having issues with Tetra Master?

If I lose a card, the person brings that card back but when you win it, every time after that they still keep bringing that exact card back (with the same arrows and stats).

It seems to be causing an issue with getting rare cards from characters unless you exit then go back and play.
I ended up with 8 Alexandria cards after winning them back each time the NPC brought it back. It helps big time if you lose one of the rares but it's making it hard to get any other cards other than the standard ones.