OK, from what you said, I know you are very eager to get a pair of contact lenses, however, as you can see, astigmatism could sometimes be quite serious and generate some inconvenience for your life. So, as far as I know, you are ok with some special contact lenses that is designed for people with astigmatism, also, I still recommend that you wear less of them and try to protect your eyes. You probably should consult an eye doctor before making any further decisions.
Well, of course, you can wear contact lenses. First, you should know that wearing too much contact lens can not make astigmatism worse, and on contrary, contact lens designed for astigmatism can do a better job to correct the astigmatism. According to some experts, astigmatism is merely a visual condition of the eye that is caused by its shape, just like myopia and hyperopia. We can also say that astigmatism is the result of an eye, which has two different powers, and it splits the focus point into two different partial focus points. When it occurs, it can lead to blurry vision, shadow images, eye muscle spasms, eyestrain, and headaches. But according to the doctors, you can just wear contact lenses to correct it, and contact lenses can be better than glasses. So you can just wear contact lenses.