Paleo does sound a little dufus-y when you are attempting to explain why you won't eat the glow-in-the-dark nacho chips but you'll gladly take a spoon to the homemade guacamole. I usually tell people I'm trying to eat clean, healthy food prepared at home, and stay away from sugar and anything processed. Most folks aren't shocked when you tell them a typical day consists of eggs and sausage for breakfast, a Cobb salad (heavy on the meat) for lunch, steak and asparagus for dinner, and an apple for dessert. Sounds pretty All-American, really, just ditching the potatoes, bread, jello and other basura that comes out of a box.
I do get hit with the "isn't that just Atkins?" comment constantly, and it's a little tiresome to keep telling folks it's similar, but sort of a lactose-intolerant version that doesn't allow processed food (e.g., Atkins bars) and focuses on whole foods rather than glycemic index.
I do wear a tee shirt that says Grok sometimes, though, so I might just be a big dufus after all.