I unno. You might have but because of how infinity housing works it was probably just trying to cycle them back in to that specific house but couldn't because someone was already in there. I unno. Could always test it out later on another save or something and see if the same issue arises.
I believe it's a fault in the mod, as in a Vanilla world, I generally use Infinity houses until I feel like building actual houses. Never had an issue before with this, so I'm guessing something in the NPC Spawn code isn't playing nice with the weirdness of the Infinity House.