the son of Rev John Horsley of Newington Butts and his first wife Anne Hamilton, daughter of Rev Prof William Hamilton of Edinburgh and Mary Robertson.

Entering Trinity Hall, Cambridge in 1751, he became LL.B. in 1758 without graduating in arts. In the following year he succeeded his father in the living of Newington Butts