Wherefore should the Heathen say,.... The nations about Israel, the nations of the world; the Gentiles in any age; the Papists in ours, sometimes called the Heathen, Psa 10:16. The church expostulates with the Lord why those should be suffered to say, in a reproachful, insulting, manner, and by way of triumph, where is now their God? that they have boasted of would help them; in whom they have put their trust and confidence; why does not he help them, as he has promised, and they expect? Thus the church suggests, that if the Lord did not appear for them, his own glory lay at stake. Such language is generally used by their enemies, when the people of God were in any distress; see Psa 42:10.