‘And when they asked him to remain a longer time, he refused his consent, but taking his leave of them, and saying, “I will return again to you if God will”, he set sail from Ephesus.'
The Jews there seemingly saw his ministry as acceptable for they asked him to remain. But he had his vow to fulfil and presumably wanted to be in Jerusalem for a coming feast. Thus he refused his consent, but promised that he would return again shortly in the near future if it proved to be God's will. Then he set sail from Ephesus.