Bump On The Inner Lip Of My Vagina - Herpes Or Shaving?

About 5 days ago I noticed a bump on the inner lip of my vagina. It is about the size of a pencil eraser. It did not hurt or look like it had fluid in it. Last night I got tired of it and tried to pop it (I know I shouldn't have) after a while of trying some white liquid puss came out followed by clear liquid and blood just as a pimple does. I stopped after that. Today the bump is still there and is swollen and now it is sore. Now it looks sort of raw (could have been my fingernail) and slightly yellow in color and there is red like stained blood or blood under the skin where it came out. I'm wondering if this is herpes. Like I said it did not hurt before I did all this and it was there for 5 days and didn't change until I messed with it. It did not look like a clear fluid filled blister but I know cases are different. I do shave also so I know that could have something to do with it. I've just never gotten an ingrown hair in this spot. It's on the inner lip of my vagina kinda on sensitive skin. So I thought that might be why if it was an ingrown hair or something it was sensitive while popping and hard to pop. I'm also having some vaginal discharge, burning during and after urination, and a smell. I think it's possible I have a yeast infection. But I don't know what the bump is and it's really worrying me. I've only ever been with one guy, we've used a Condom every single time. I try very hard to protect myself so I'm really hoping this isn't herpes. I haven't had any symptoms like fever nausea or abdominal pain either. I just don't know what this bump would be and I'm especially worried since I popped it.