Black Ants next to my peas. A problem?

Planted a little kelvedon Wonder & Sugar Snap on Sunday.  Popped down to put up some netting alongside them today & noticed masses of black ants in that corner of the plot.  The first row are close to a paving slab path dividing me from my neighbour & I'm guessing that's where they've based themselves.

Is this going to be a problem? If so what should I do about them?

I only got the plot in the winter & don't know how established they are there.

(If there's more of them along the path they'll be next to mixed lettuce & spring onions too)

Ants themselves don't damage the plants -- it is their nests that cause issues for the roots, as they are so loose and air filled, so roots can't take up enough water.

Ants do also (later in the year) like aphids and so run up and down plants that are infested, to collect excreted sap.

So, just looksee if either of these aspects will be an issue for you