I give immortal praise. I. Watts, [Praise. A Doxology.] Appeared in his Hymns & Spiritual Songs, 2nd ed., 1709, Bk. iii., No. 38, in 4 stanzas of 8 lines, and entitled, “Song of Praise to the Blessed Trinity." In its original form it is not often found; but as "We give immortal praise," it is in common use in all English-speaking countries. This slightly altered text was given in G. Whitefield's Psalms & Hymns 1753; in M. Madan's Psalms & Hymns, 1760; in A. M. Toplady's Psalms & Hymns, 1776, and others to modern hymn-books. In Kennedy, it is recast as "To God the Father yield," but this form is in limited use.
--John Julian, Dictionary of Hymnology (1907)