Oakley was born in Bergen Heights, a section of Jersey City, New Jersey, into a family of artists. Her parents were art devotee Arthur Edmund Oakley and drawing teacher and portrait painter Cornelia Swain. Both of her grandfathers were member of the National Academy of Design. In 1892, she studied at the Art Students League of New York with James Carroll Beckwith