Of course, you can not go to swim when you have scratched eyes, for it can make your eyes be infected by some irritants, or pollution. Eye infection can be caused by bacteria, viruses or environmental agents, such as pollens and other irritants. As we know that there are many chemicals in the pool and it can be the irritants. And your scratched eyes can be infected by them. So in many cases, people get eye infection when they are with irritants. And eye infection can make your scratched eyes become worse; and also can lead to blurry vision, which is also caused by the bacteria, and other allergies. Anyway, when your eyes are infected by some viruses, you can get eye infection. At the same time, your blurry vision can occur too. so you are not supposed to have swimming.