No, you should not be worried. It is not a risk. You are overestimating the risk of transmission in this scenario. First, we have no idea if you were shedding virus at that moment. Two, the contact of your finger and your vagina was very brief and three, putting your finger in your mouth probably removed any potential virus that was present. And fourth, you used other fingers mostly when touching her. Stop worrying.