Fat aromatizes test into estrogen, so being obese/overweight can lead to lower test levels. Nicotine (so I've been told), alcohol, and any other number of substances. Also, some people are just born to have naturally low(er) test levels. That's the most likely cause, IMO.