As far as I know, caffeine wouldn't cause puffy eyes, but on the contrary, can even eliminate edema, because it has the effect of diuresis, The reason that caused your puffy eyes, as you have mentioned, could probably be that you've been doing hard work for a period. Although you are accustomed to drinking coffee, the puffy eyes caused by the tiredness still couldn't be removed, and what is worse, caffeine as a kind of stimulant, can't help you to recover from fatigue. So in order to have a good rest in the coming days, drink less coffee and try to feel relaxed.