On 4 October 1887, Victor and Eldred married at St. Margaret's, Westminster. They had two sons, Siward and Oswald, and a daughter, Pamela.

He was knighted in the 1902 Coronation Honours, receiving the accolade from King Edward VII at Buckingham Palace on 24 October that year.

Horsley was a champion of many