It's the pattern type of the LDL that matters most.
Pattern-A (large, fluffy) LDL is not associated with an increase in heart disease.
Pattern-B (small, dense) LDL is associated with an increase in heart disease.
You need to find out from your doctor the breakdown of your LDL, not just the total number.
Having a high LDL level that is mostly pattern-A (big LDL) is good, imho. People with high LDL levels (that are pattern-A) actually live longer, have lower cancer risks, have fewer infectious diseases (LDL is also part of your immune system), and are NOT at higher risk of a heart attack.
Take a look at this study by UCLA:
They got hold of the medical records of 59% of all heart attack patients between 2000 and 2006 and analyzed them for cholesterol levels. It's laid out in a pretty easy to read table. One of the interesting facts is that people that had both high HDL (over 60) and high LDL (over 160) only had 0.7% of heart attacks. Note, that wasn't 7% that was 0.7%, as in less than 1%, as in only 7 of every 1,000.
The other thing you need to get from your doctor is the Lp(a) number. LP(a) is a type of LDL with a protein molecule attached. High levels of Lp(a) have been associated with heat disease. The reason most doctors don't focus on it is (1) the levels are primarily due to heredity, and (2) there is no magic pill to lower (although niacin is supposed to have some effect), so big pharma doesn't push lowering it.
Lp(a) is not the same as LDL pattern-A, but a lot of people get them confused.