It absolutely does not worry me one little bit.
Acquiring herpes on your finger in this way would be extremely unusual indeed. And herpetic whitlow looks nothing like what you describe. It is normally a group of tense, tender blisters filled with watery fluid.
I think you can put this particular worry behind you.
Terri