I need to eat a lot of calories too, and actually, the leaner a person is, the more calories they need. This reasons are manifold, but there are two primary ones. First, muscle burns more energy than fat, so the leaner you are, the higher your basal metabolic rate will be. This means that if you're a young (wo)man who is skinny-fat and 150lbs with 25% bodyfat, your BRM will be lower than your twin who is also 150lbs, but only 7% body fat. Additionally, the leaner you are, the more calories you need to consume to do work. This is because you have little reserve energy (adipose tissue), so you must get your energy endogenously in order to keep moving if you do not want to start breaking down your internal organs and muscle for energy. So, long story short, it's a misconception that the bigger you are, the more calories you need. The truth is the LEANER you are and the less stored energy you have (body fat) the more calories you need, ceteris paribus.
Anecdotally, I have a few friends who are out of shape and not obese, but definitely fat. They literally all eat like birds. Literally they'll get up, drink coffee until noon, and then eat like a cobb salad or a club sandwich at lunch. Wait till dinner, and have something like steak frites or another salad. If I ate that little I'd literally waste away and get skinny fat, which is the last thing I want.