If you shave regularly, you've probably suffered from ingrown hairs. Ingrown hairs grow back sideways under your skin, instead of growing out, and can cause inflammation. Improper hair removal is usually the culprit, but excess dead skin clogging the hair follicle can also lead to ingrown hairs.