Away from every mortal care. I. Watts. [Public Worship.] First published in his Hymns and Sacred Songs, 1709, Bk. ii., No. 123, in 6 stanzas of 4 lines, and entitled, "The benefit of Public Ordinances." It has been republished in all later editions of the Hymns, &c., and in Watts's Works. G. Whitefield included stanzas i., ii., iii., and vi., in his Collection, 1753. This arrangement is often repeated in modern hymnals. In Hatfield's American Church Hymn Book, 1872, No. 122, the full text is given with brings, for "bears down," in stanza iii., l. 3.
-- John Julian, Dictionary of Hymnology (1907)