They had two sons, Julian (1908-1937) and Quentin (1910-1996), who both became writers. Julian joined the Republican side in the Spanish Civil War as an ambulance driver and was killed by an enemy shell, aged 29.

By World War I their marriage was over. Vanessa had begun a lifelong relationship with Duncan Grant,