caterpillers on Brussel Sprouts

Went up to the plot over the weekend and the leaves on my Brussels Sprouts have been desimated by Caterpillars.  Should I pull them out or could they recover?  I really hope they will recover as the family were looking forward to them for the Christmas dinner.

I have taken the netting off mine as it did not stop the butterfly .
I was sick of picking the caterpillar off so now the birds can do it for me .
The sprouts are forming nicely so should be ok .
The reason the butterfly got to them was while I was on holiday the plants had a growing spell and reached the top of the netting allowing the butterfly to get at them , next thing I knew half the leaves were gone .
John