Leave them on. You don't remove the caps from your vehicles do you?