I don't think it's so implausible to eat a paleo acceptable diet while being your sort of quasi-vegetarian. Personally I prefer low-carb animal fat heavy paleo, but if you're modelling your diet on societies like the kitavans, then it's much easier.
If you're getting your calories from paleo carbohydrate rather than animal fat, then that already covers a lot of your nutritional requirements. The kitavans eat about 70% carbohydrate mostly from sweet potato. If you plug that into nutrition-data then it compares favourably to the same amount of calories from fatty meat in terms of micronutrients. There's no reason, in principle, why you couldn't get even more calories from sweet potato if you like. In the Kitavan case another 20% of their calories comes from coconut, which if you wanted to eat lower carb, you could obviously eat for a lot of your calories, but with the downside that this would leave you lacking a lot of nutrients.
With the paleo-calories and a lot of your micronutrients covered, protein is presumably the next big issue. Assuming you have no problems eating eggs though, this shouldn't be an issue in principle either. On a high carb diet you'll only need 10% (kitavan level) to 15% calories from protein, which should be 90-100g per day. Naturally eating more protein leads to higher satiety (one of the main draws of the paleo style of eating I assume), but for optimal healthy plenty of people think you should eat just enough protein to meet your needs (c.f. the Optimal Diet- which looks like a quack site, but is ably defended on Hyperlipid) or Perfect Health diet- which actually doesn't require the very low 50g of protein the main page suggests, see the colour supplement). If you're trying to gain weight, then of course you'll want more protein, but bodybuilders eating tonnes of eggs and milk is quite common. Eggs aren't the optimal protein source (less nutritious than meat, might provoke allergies/intolerance, more omega6 in the yolk), but are very widely eaten by standard paleos. Also note that eating sweet potato/potato (the latter is higher in protein and complete, but arguably less paleo) will give you 40g+ of only slightly incomplete protein. I would most definitely ditch the soy protein, given the soy is full of what are essentially toxins.
As to all the various nutrients that come predominantly from meat, hopefully your egg yolks will largely see to this. Also since you're not eating low fat vegetarian (as most are) and are eating dairy fat etc with your vegetables, you should have much better nutrient-absorption than is typical of vegetarians and should get some vitamin K2 as well.
I think that covers all the positive needs of a paleo-mostly-vegetarian diet, so what should be removed from your current diet? I would suggest the grains, totally, without reservation, given the potential long-term harm of gluten and the myriad other anti-nutrients therein. Legumes, even if fully fermented, I am personally suspicious of, but some people on here seem to think that properly prepared, they're fine (my view is that anything that needs that much processing to be tolerable is probably not healthy, whereas the converse view seems to be that after so much elaborate preparation they're bound to be safe). Soy protein as mentioned before, falls into the same category of wheat as something that will not merely be unnutritious, but disruptive in a variety of ways. Fruit, I would minimise, since there's no need for it if you're eating vegetables/tubers and fructose is better limited. I would view them as an indulgence to 'satisfy one's sweet tooth' rather than a staple, but some people on here think they're healthy (and that's certainly the Cordain orthodoxy). I would also suggest cutting the nuts, since you'll be getting enough omega-6 from eggs anyway.
