You ask a good question that deserves contemplation. Guilt is definitely a terribly common emotion about food, but I like to challenge it whenever it surfaces because I find it mostly destructive.
I'm interested to know if you truly feel guilt or something else. I feel guilt works best when it prevents us from doing something unethical or harmful to others, and seems less helpful in controlling our behavior when it concerns only ourselves.
I've repeated this refrain before, but we don't owe our dietary fidelity to anyone else (excepting during pregnancy/nursing, perhaps), so guilt doesn't seem the best tool for behavioral modification in terms of diet. Like most people, I do experience moments of guilt when I choose foods I find less ethical, whether from an environmental/sustainable point of view, or animal/human welfare. Having said all that, I recognize the impact of having our goals frustrated, and that's the emotion--frustration--that I experience, not guilt.
I realize this musing doesn't really help you control your eating behavior, but feel strongly that the kind of self-talk we do around food can reinforce negative emotions instead of diminishing them, and can lead to some obsessive thinking that doesn't seem helpful. This is something I'd like to see us challenge more often. (The same goes for the use of the term "cheat" regarding food.)
Even at 70 grams, your carbs seem pretty low, and if I understood correctly, they typically come from nutrient rich berries whose carbohydrate content includes fiber. I don't believe most people will get or stay fat on berries, and every vegetable or fruit one eats contains carbohydrates--even if mostly fiber. If eating some berries helps keep you sane, and prevents you from indulging in candy and other refined, nutrient-depleted foods, the overall benefit might outweigh the benefit of a faster weight loss. As usual, no black and white answer/solution exists, only shades of grey.