Please anyone?? "Baby" Gladioli? What do I do with them?

Please can anyone advise me what to do with the several hundred little baby gladiolus spikes that have developed this year all around my 10 glads that I planted last year? I had absolutely no idea that they would reproduce! (Excuse my ignorance). Should I have removed them as they appeared (a  full time job, there are millions of them!) - will they rob the main plants of nutrients if I leave them, do I need to wait till the autumn to move them, will they last all winter like my main plants if I just leave them etc etc.

Last year was the first time I had ever grown these flowers, I am more of a veg gardener really and have no idea what I am doing with flowers! Thank you very much for any advice.