STOP WORRYING! The chances that you would infect your baby in this way is incredibly tiny if not zero. You did wash your hands (even if a short one) and soap is death to the virus. Also, the wipe I am certain has some antigerm stuff going on. It also takes a significant volume to infect someone. Also, how old is your baby?
The incubation period from infection to symptoms is 2-10 days.
Terri