Jones came to prominence in the 1950s as a jazz arranger and conductor before producing pop hit records for Lesley Gore in the early 1960s (including "It's My Party") and serving as an arranger and conductor for several collaborations between Frank Sinatra and the jazz artist Count Basie.

Jones produced three of the most successful albums by Michael Jackson: