Good for you! I don’t believe there was anything malicious here with the transmission – an honest mistake if it came from him.
While your IgG test value is pretty high, it is still under 5 and if you want to confirm you could. I just haven’t seen a value this high not confirm.
Remember that you could have gotten HSV 1 from a grandparent kissing you with a cold sore years ago or someone else that you’ve kissed along the way, it doesn’t have to be this person.