Try to see what is causing those flare ups.
I've had to deal with rosacea, cysts, acne, etc, you name it. For me, anytime I would eat out (and tried to eat Paleo). I came to the conclusion it was because of soy, dairy, or anything with white vinegar in it.
But the most important thing right now is to let your skin heal. Don't be fooled by those acne washes or creams. I've tried them all and they only further irritate your skin. Your skin is sensitive and we're not meant to be putting all these harsh chemicals on it. Try just using water and sticking strictly Paleo and record what happens.