To add to the confusion, sometimes all-female cukes produce male flowers too (this year being no exception, variety 'Diva'.)
I tend to leave them to get on with it, and haven't had any bitter fruits as yet, although I can't be sure whether or not pollination took place as they are greenhouse grown so not many insect visitors.
If in doubt, it's probably best to remove the male flowers from these particular varieties.