had been speaker of the Irish parliament. Ussher's father, Arland Ussher, was a clerk in chancery who married Stanihurst's daughter, Margaret (by his first wife Anne Fitzsimon), who was reportedly a Roman Catholic.

Ussher's younger and only surviving brother, Ambrose, became a distinguished scholar of Arabic and Hebrew. According to his chaplain and biographer, Nicholas Bernard,