with his mother, Anne Spring Denny (Alsop), and his stepfather, Gilder Palmer, on a dairy farm in Tyringham, Massachusetts. Palmer, a college roommate of his father, was deeply involved with his upbringing, as was the family of David Rockefeller, his godfather.

Gilder attended Hamilton School in New York City, Phillips Exeter Academy, and Harvard University,