His father Harry Brooker was a professional musician, playing steel guitar with Felix Mendelssohn's Hawaiian Serenaders, and as a child Brooker learned to play piano, cornet, and trombone. In 1954 the family moved to the seaside resort of Southend-on-Sea, Essex, where Brooker attended Westcliff High School for Boys.