Ingrown hairs, boils, or cysts? Appeared after shaving, caused by chafing from wearing pads. Feel like pea sized hard lumps beneath skin. More info in comments
Went to the doctor as recommended by everyone in this post. Some people wanted an update so for anyone wondering, they are just cysts and harmless. Check your balls guys.
