There was a chapel at 50 Queen Anne's Gate, built in 1706 as a private chapel to serve the residents of Queen Square. By 1870, it had become a charitable school, and later served as a mission hall and a police institute. By 1890, it had become offices. The site is now occupied by the modern Ministry of Justice building.

Originally built as houses, by the later 20th century many of the buildings in Queen Anne's Gate had been converted