I agree with Megatron28, talk to your doc first.
However, I have had a past doc - and one that was supposedly "up on the latest with TRT" tell me that anytime I wanted to stop TRT, I should just stop and everything would come back on its own...which, IMHO is a bad idea.