I find that my "finished" compost doesn't have many worms or other visible creatures in it.
My dalek which is used mainly for kitchen vegetable waste seems to have more worms in than the ones with just garden waste, although the numbers do seem to vary with the time of year and weather.
Worms are said to not like citrus peel or onion waste, so too much of either would presumably tend to make them go elsewhere.