Yes, E will protect them.
This is also the reason that in all liquid fish oils you have some E or ascorbyl palmitate. I put extra 200 IU mixed tocopherols in my fish oil and keep it in fridge.
About PUFAs in almonds, and nuts in general, they seem to be protective. There are number of studies claiming that. They seem to prevent galstones, Mg deficiency, diabetes, promote DNK repair, fiber, rasveratrol, arginine etc. If you eliminate industrial PUFAs, those that you consume in nuts aren't going to overload your system.
Alpha says 30g of most of the nuts have low amount of PUFA, except walnut.
(click on 'more' in fat section to see details and thank me later for letting you know about Alpha)
Brazil nut is, surprisingly, next on the list [looking at Quilt].
Not counting walnuts, you get at most 1 tea spoon of such non-processed oil so its easy to counter it with the same amount of w-3 PUFA.
However, young walnuts are rich source of Iodine and W-3 (ALA). In my country people make Rakija from young walnuts as Iodine supplementation which is very tasty.
To others that claim w-6 is inflammatory, keep in mind that w-6 IS essential fat. There are essential fats, amino acids AND probably carbohydrates on the long run.
Limit your industrialized food, not non-paleo-food whatever that might mean...