His sanctuary: i.e. Zion. See App-68.
this mountain: viz. the one in the writer's view; not in "the memory of an exile in Babylon".
Related Commentaries of Psalms 78:54
Psalms 78:54
54 And he brought them to the border of his sanctuary, even to this mountain, which his right hand had purchased.