XP

Although this might sound obvious, low body fat will cause you to feel cold very easily. Just think of the fat as insulation.

You'll also feel colder than others if you're tall, since you're body will have a harder time with circulation.

If you're tall and skinny (or lean), then you'll just have to deal with feeling cold often or move to a warmer country.