Pruning a Choisya

My neighbour decided to amuse himself this Christmas by cutting down a conifer on our boundry!
On my side there is a choisya which has grown about 6ft high - up to the level of the conifer - and even wider.
Unfortunately I am now left with a large gap between the choisya and the fence.
It would also be nice to regain some of my patio!!
So, I know that you should prune after flowering, but will it do it any harm if I prune it now - given that it is freezing at the moment any may continue to do so until may!!

Thanks

Elaine

Thanks for that Stree, looks like I will have to be patient then!

Elaine