The TV Licence is payable if your set is capable of receiving a signal, so unplugging the aerial does not count as it is still capable.
It may be interesting to ask the question whether you have to pay for an analogue TV if the only signal you receive is digital and have no satellite or cable, as it is not capable of receiving a signal and should not longer be subject to TV licence.