OK, when you talk about 'insulin meds' I am assuming you are not taking insulin itself, just some kind of meds to assist your still functioning pancreas. I am also assuming you have a glucometer and can test your own bgs. If so, this helps as you can see how you are progressing and make sure your bg numbers aren't getting too low. As a type 2, your eventual goal will be to keep carb intake low to minimize blood glucose spikes and allow your pancreas some relief. SOme people find they can eventually get off meds this way, but a lot depends on how much damage has already been done. Low carb is not a miracle cure and can't fix everyone. It can help a lot of people though.
There are two ways to go paleo. One is to jump in and do it all at once from day one. The other is to slowly transition. The advantages of jumping in is you can get the health benefits faster and for those who have temporary cravings for their old types of foods, they can get past those faster. The downside is that some people's bodies take a while to transition and if they do it quickly, they will sometimes experience a temporary state of overall tiredness nicknamed 'the lowcarb flu' until their body adjusts.
Another method, is to cut out things one at a time. My advice would be to cut out processed food and wheat first. Transition to whole foods and maybe a bit of whole fruit and cooked potatoes. Adapt to that and see your blood sugars are doing. And then slowly downgrade the amount of carb you are eating. Watch your blood sugars as you go. Some find they need to stay away from fruit and tubers in order to keep either their weight or their blood sugars in a good range. Others find they can have a bit more of those and still be fine. You will have to learn what is best for you. Obviously, this little synopsis isn't going to cover everything, but at least you can get the gist of it.