Joy to the followers of the Lord . Anna L. Barbauld. [Joy .] Written about 1820, and pub. by her sister in The Works of Anna Laetitia Barbauld, with a Memoir, 1825, vol. i. p. 339, in 6 stanzas of 4 lines. In Dr. Martineau's Hymns, 1840, and again in 1873, it is given as "Joy to those that love the Lord." This is also in other collections. In Ellen Courtauld's Psalms & Hymns & Anthems, 1860, it begins with stanza iii., "'Tis a joy that, seated deep," altered to "Joy there is, that, seated deep."
--John Julian, Dictionary of Hymnology (1907)