From your description, it is probably caused by dry eyes. Also, it could be from many things such as eye makeup allergies or disfunction of the oil glands in the eyelids. If it is caused by dry eyes, you can release your eyes by eye drops. Also, you can check if your eyes are red, burning or watering. If you have those symptoms, it may caused by eye infection. For sure, I suggest consult your physician if it's very bothersome after you remove the contact lenses. Good luck.
It is weird to get hurt when after remove the contacts out. It may be caused by dry eyes. In common, people with dry eyes may feel uncomfortable after removing the contact lenses. Maybe applying some eye drops before you remove the contact can help you. If you still feel weird or hurt when you remove the lenses after applying eye drops, you'd better talk to your eye doctor about the e situation so as to know what exactly the symptoms are. Good luck.