I'm leaning more towards sugar than gluten. It's probably not helpful to make the distinction. But fructose at current rates of consumption is drastically hampering the bodies ability to detoxify itself. I wouldn't at all be surprised to find fructose as the major factor in metabolic derangement.
Per usual, Sugar the Bitter Truth: http://www.youtube.com/watch?v=dBnniua6-oM
The question a lot of people seem to be answering is what's the better binge: Sugar, PUFAs, or gluten. Sugar is the better binge because of the level of dosage it takes for problems to arise. But looking at the current levels of consumption, I'd say more benefit would come for removing sugar than removing the other two. But really we don't know is the answer. All of them suck.