How to allow users to only manage certain lookups

Hi Community. 
I have a need to allow users to only manage certain lookups, but I don't want to grant them the "CanManageLookups" operation to be able to change any lookup