A four-pint plastic milk bottle, carefully cut up into 4" x 1/2" strips, which are then cut to a point, yields around 25 labels, and if you 'slide' them down just inside of the pot, they will not bend into the compost!
Cut arund the straight waist of the bottle, so you have a flat chunk of plastic about a foot by 4", then slice up to size! You can also get a few more from the top half, and as a bonus, the square bottom piece is good for a small pot reservoir!
I tend to chuck them each year, although several turn up all over the place later on, and get reused if they're simple plants like radish etc!
(And the green screw lid, with a nail through it, popped into the top of a supporting cane, will maybe stop you poking your eye out as well)!