Problem with peppers?

Most of my bell peppers and chillis have some "goosebumps" on them, especially in the lower half. It doesn't look good - has anyone seen anything like that? Could it be some disease, or is it normal and they'll grow out of it? This is the first year I grow them, so I have no idea whether to worry or not...

On the fruit. I'll try to take a picture...