As long as you washed your hands thoroughly as soon as possible afterwards, you should be fine. Unless you may be pregnant - pregnant women tend to be very vulnerable to a pathogen in cat poop called toxoplasmosis. But even this is not a concern with very fresh cat poop - it takes at least 48 hours for the pathogen to become infectious.

Aside from the risk of disease, this is a pretty unpleasant occurrence and an excellent reason why one should always wear gloves while gardening. There are all manner of toxins present in the garden and wearing gloves and washing well after working outdoors will keep them all at bay.