Group Privacy Settings Limited to Admins & Organizers on Membership Website

It be nice if the website had the ability to have group privacy setting ONLY available to group admins and organizers and NOT all members of the site. Since on our Membership only website we were wondering if we could limit those group privacy settings to show only to admins