I think you likely can differentiate between an outbreak and something else. Herpes lesions are filled with clear fluid. Pimples have white pus in them. But you could easily have a single lesion that isn’t dramatic with a recurrence. In terms of sex with him, you both have it, I think you don’t need to worry about this any longer.