I always had the opposite problem. Even when I weighed 206 (six feet tall) and benched 315 for 4 reps, people did not believe what I weighed until they saw the scale (most guessed 175-180) and what I could bench until they were there in the gym with me and saw it with their own eyes.
When I dieted down to 181, my family and friends all were asking me if something was wrong and sharing their concern that I was being unhealthy - crap, it took me a year to lose that 25 pounds, and I did not lose any strength until the last 8 pounds or so . . . I was healthier than I had ever been and had visible abs for the first time in my life.
189 on the scale today . . .
People's perceptions are weird. Facts are facts, and the scale does not lie.