See the gospel sense of this, in that beautiful parable of our Lord: Mat_18:22; Mat_18:25.
Related Commentaries of Exodus 22:4
Exodus 22:4
4 If the theft be certainly found in his hand alive, whether it be ox, or ass, or sheep; he shall restore double.