Levelling extra classes doesn't take away anything, if that's what you're thinking. If you get every class to 50, you can use all the cross-class abilities as noted for whatever your current class is.
And no. Gladiator isn't so restricted. However, it's not great for anything else.
And no. Gladiator isn't so restricted. However, it's not great for anything else.