The Plugin manager allows users permissions to be setup on a plugin by plugin level. This permits greater flexibility across the system which in turn means that one toolbar layout can be used by multiple user groups!
To do this click on the 'Plugin Manager' button, select the toolbar plugin you want to edit and click to edit.
These parameters are found under the 'Editor Options' tab, as seen below.