First, if you are getting sores 2-3 times per year orally, you should have them swab tested and determine if they are HSV 1 or HSV 2 or herpes at all. Having oral HSV 2 is rare and having it recur that often is even more rare.
It sounds like the activities that you participated in with him presents very little risk of transmission of herpes to him, regardless of the type of HSV you have orally.
Terri