If your poop comes out easily and smoothly then I wouldn't worry. Fiber is one of those controversial things in the paleo world. Some find that they need a lot of it. Some of us do fine with less. Some Paleohackers don't consume any fiber. Most important to poop formation is the amount of good bacteria in your gut.
We've all been programmed to believe that we need to poop two or three times a day and that the poops should be big. Well, if you're eating lots of grain and lots of fiber your poops will be big and you don't want to be backed up. So, you only need to worry if you're getting constipated, developing hemorrhoids, or having rough poops.
Forget fiber and eat your vegetables whether you like them or not. To paraphrase some of my favorite authors, you're all grown up now, eat you veggies. Also try some raw fermented foods like raw sauerkraut or kim chi.