William Johnson to replace Moore after Moore resigned in 1804. In 1807, Jefferson appointed two more justices, as Paterson died and Congress added a new seat for an Associate Justice. Jefferson successfully nominated Henry Brockholst Livingston and Thomas Todd. President James Madison appointed Gabriel Duvall and Joseph Story