Hi
They do look like lice, I've not had a problem with them myself but I think you need to not only treat the coop but also the chickens themselves. I think most people on here use frontline for lice, just one or two drops of kitten strength, but I'm sure someone else can advise you on this.