Define user rights per folder or short url domain

I have defined three custom domains, and each domain are created inside separate folder. As an admin, I would like to be able to define what role each user has for a domain or folder, whatever is easiest.