The men of the city - Perhaps the rulers; who, it is likely, had possession of the tower or citadel, and so could tyrannize over the people. Gideon killed the great men, and beat down their towers, but did not injure the inhabitants.
Related Commentaries of Judges 8:17
Judges 8:17
17 And he beat down the tower of Penuel, and slew the men of the city.