A people that provoketh me to anger: that the Jews are the people here intended is without question; the prophet, speaking of the calling of the Gentiles upon their rejection, reckons up their sins which were the causes. For though their rejecting and crucifying of Christ was that sin which was the proximate cause; yet God did but visit on that generation their iniquities, and the iniquities of their fathers together, they having by that act filled up their measure. They had provoked God continually to anger to his face. To my face; either in his temple, the place where he used to manifest himself; or (considering what followeth) more probably the phrase signifieth their impudence, not taking notice of God's omnipresence and omniscience. The particular provocations instanced in are deviations in the matter of Divine worship. Sacrificing in gardens is one thing instanced in; and burning incense on brick, or altars of brick, is another, Deuteronomy 12:13: there was a particular altar of gold appointed for incense, Exodus 40:5. God commanded, Exodus 20:24,25, that his altars should be made of earth, or rough stone. This people transgressed both these laws; sacrificing in gardens, for which the prophet reflected on them, Isaiah 1:29, and again Isaiah 66:17; whether in gardens consecrated to idols, or in such gardens, as the heathens worshipped idols in, is not much material for us to know; and burning incense upon altars of brick, directly contrary to the Divine rule. Their worship was doubtless idolatrous, and these phrases signify committing idolatry; but the expressing that sin by these phrases lets us know that the doing contrary to the direction of the Divine rule in God's worship is a great part of the sinfulness of idolatry.
Related Commentaries of Isaiah 65:3
Isaiah 65:3
3 A people that provoketh me to anger continually to my face; that sacrificeth in gardens, and burneth incense upon altars of brick;