Categories - Cannot Delete a Parent Category

It is possible to assign different parent categories but once a parent category has been assigned it cannot be deleted, only changed.