My numbers were in the "normal" range for 40 year old male - 579 ng/dl was my total test number and free test was proportional.
Of course that was actually low for me b/c up until I was 37 my normal test levels were consistently close to 1000 ng/dl. So, 579 ng/dl was a 40% drop off for me. No wonder I didn't feel quite so well!
What you need to do is tell your physician that your numbers have been a lot higher in the past and you don't want to feel like a "normal" 50 year old guy. You want your numbers back where they were when you were 25.
That is the approach I used and after some hesitation, my urologist agreed and let me run my Hormone Replacement Therapy (HRT) the way that I would "feel the best" not based on some dumb "normal" scale.
Again, the big point is tell your physician that you don't want to be "normal." Normal people feel crappy, get sick, are fat, have no energy, and poor quality of life.
You want to be a high performer a with a high quality of life just like when you were 25 years old.