I think I would ask him if he wants to move them to his plots, if not, offer them to the others, why not leave the 3 nearest the end of the plot for now, they may be a windbreak? and also as you thought, may be good for swapsies, that would give you extra land to start with, rather than trying to do too much at once.