It should be possible to remove the 'sysadmin' group setting from /etc/sudoers