Lord, for ever at Thy side. J. Montgomery. [Psalms cxxxi.] Published in Cotterill’s Selection, 8th ed., 1819, p. 73, in 4 stanzas of 4 lines, and headed, "For Humility." In 1822 it was repeated by Montgomery in his Songs of Zion, as a paraphrase of Psalms cxxxi.; in his Poetical Works, 1828; and his Original Hymns, 1853, No. 187. It is a most successful paraphrase, and is somewhat widely used.
--John Julian, Dictionary of Hymnology (1907)