
I very much got that impression too (and I don't watch GoT, hehe). I think it's likely he would threaten or kill another male who got too close to "his" women. If he's possessive enough to prevent them from seeing their families, and has an interest in ensuring the only man they lie with is him, why would he allow otherwise? He has nothing to gain from allowing men in his gang, and everything to lose.
He's a nasty piece of work, basically.
He's a nasty piece of work, basically.