So the heathen - The nations. That is, The surrounding people, who hear what thou hast done for thy people, will see the evidence that thou art God, and learn to love and worship thee.
Shall fear the name of the Lord - Shall reverence and honor thee.
And all the kings of the earth thy glory - The sovereigns of the earth will be especially affected and impressed with thy majesty. If this refers to the return from the captivity at Babylon, then it means that that event would be particularly suited to impress the minds of the rulers of the world, as showing that God had all nations under his control; that he could deliver a captive people from the grasp of the mighty; that he was the friend of those who worshipped him, and that he would frown on oppression and wrong.