My honest opinion here is that you have nothing to worry about. I have, once in 32 years, seen one person who may or may not have acquired HSV 1 genitally after having HSV 1 orally. They did test positive for HSV 1 genitally by PCR but reported having had cold sores in the past. They were HSV 1 positive by antibody test, so there was no way to sort out whether this was truly new or old infection. So MAYBE once in 32 years. Generally speaking, the antibody that you acquire from an infection in one place protects you from getting it in a new location.
So tell me about the sexual encounter – you said it was brief and protected. Was the oral sex given to you given while you were using a condom also?
I think there are so many things that should reassure you.
1) the negative swab test at the time of your symptoms
2) the fact that you are already infected with HSV 1
3) the symptoms that you describe to me sound nothing like herpes to me.
4) fungal medicine made it go away
5) it has never returned (though that is not inconsistent with HSV 1)
Yes, you would be far more likely to infect someone by giving them oral sex than through the remote chance that you could have genital herpes type 1. I think there is absolutely no reason you should tell people you think you have HSV 1 genitally. But as you know there is some risk of you infecting someone with HSV 1 from your oral infection, so I think you should give some thought to disclosing this fact
Terri