They had scattered them first spiritually by leading them into idolatry; and secondly, many had literally been taken to Egypt with Jehoahaz, many in Jehoiakim’s time had fled there, while others fell away to the Chaldaeans: and finally the best of the land had been carried to Babylon with Jeconiah.
Driven away - i. e., made them outcasts. In the East, shepherds never drive their flocks, but go ahead of them John 10:4-5.
Have not visited them - i. e., have not concerned yourselves about their conduct.