If I were you, I absolutely wouldn't panic about consuming wheat from time to time. Sure, it may give you a blood sugar rush, and it may inhibit uptake of nutrients, but if you are fairly well adapted to tolerate wheat, then you are fairly well adapted to tolerate wheat. Things such as fiber, phytic acid and lectins negatively affect everybody, but once in a while, I think negative components like these are perfectly fine to ingest. Just like I think its perfectly fine to have some grapes or some cheese once in a while. Not every one has a strong auto-immune reaction to wheat. Just like not every one has a strong reaction to dairy. This is your body and your paleo life style, and you should bend and/or make your own rules according to your body and to your specific needs.
An Edit:
Op! Just read this at Melissa's blog -- apparently there is some evidence that everyone has an immune response to gluten:
"One of these things is a protein called gliadin, which celiac individuals are sensitive to. But it turns out that others are sensitive to it as well: Is gliadin really safe for non‐coeliac individuals?
The answer is NO:
The data obtained in this pilot study support the hypothesis that gluten elicits its harmful effect, throughout an IL15 innate immune response, on all the individuals. This innate response is found in both patients with and without CD, although the triggering of an adaptive response is CD specific.
So for celiac individuals it's really really bad. For most people it's not so bad, it only "induces epithelial stress and reprogrammes intraepithelial lymphocytes into natural killer (NK)‐like cells leading to enterocyte apoptosis and an increase in epithelium permeability" a little. Enjoy your bagels!"
From: http://huntgatherlove.com/content/gluten-its-bad-news