Some registry keys can not be removed because the currently logged in user has not "permissions" to modify or delete that key. Some keys will not allow any user to modify or delete them.
So you will have to edit the key's Access Control List (ACL).
How to manage that, you can find here (click on that link : )