I think you actually get one retainer per character, but then each character can have additional retainers. That's at least what I'm interpreting it as right now.. I may be entirely wrong (hope not!)
http://www.tale-ffxiv.com
The Adventure League of Eorzea: A progression & RP guild. FFXIV's longest-running RPLS