The sword probably hath an allusion to the sorrows of Egypt, from whence the Lord brought the people out, into the wilderness, and then brought them to rest in Canaan.
Related Commentaries of Jeremiah 31:2
Jeremiah 31:2
2 Thus saith the LORD, The people which were left of the sword found grace in the wilderness; even Israel, when I went to cause him to rest.