Yep, it does make me cringe. Paleolithic is fine and dandy. It's a shortening that seems to emasculate and render twee. Like 'uni' for university. Despicable.
Around others, I anticipate derision by saying I eat a caveman diet. No fucking about. Sometimes, a 'caveman, with access to Pubmed and the health and beauty section of Amazon, diet.'