I think it sounds absolutely fine. If you're happy with eggs and fish most of the time then eat that.
Also remember you don't have to have meat every day or with every meal - take all the paleo advice and then make it your own - you have your own requirements.
On the subject of spiritual beliefs - I have been at this crossroads too... remember that plants are alive too, and if that isn't enough, loads of insects and other small creatures are killed in the production, shipping and storage of plant foods. Be grateful and respectful for what you receive, as whatever it is, almost inevitably something else gave its life for you to have it. At least a caveman hunted wild food, so the creature had a real life before it died - I think trying to eat wild where possible is a positive thing, obvious health benefits aside.
