Roach's family moved to the Bedford-Stuyvesant neighborhood of Brooklyn, New York, when he was four years old. He grew up in a musical home with his gospel singer mother. He started to play bugle in parades at a young age. At the age of 10, he was already playing drums in some gospel bands.

In 1942, as an 18-year-old recently graduated from Boys High School