if your building them from timber and glass or polycarbonate and make sure there are no big gaps a wouldnt worry too much about insulation. Generally coldframes are used to harden off plants or start off hardier plants. In a bid to keep warmth inside while its cold, you could add some bubble wrap.
Totty