Unless someone else had used the inanimate object immediately before you did, this is not a method of transmission.
Your first symptoms were a while beyond the assault, so either it’s not herpes or the first outbreak was unrecognized.
I see now that you’ve not yet been tested, thanks for that clarification.
It isn’t normal for outbreaks to flake.
Additional, the chances of getting HSV with a single sexual encounter are very low but not impossible.
Glad you are getting tested to know for sure.