after the Biblical character Joshua of the Old Testament. His mother introduced him to music when he was five years old, at which age he began singing in his church's choir. White's father threw a white bill collector out of his home in 1921, for which he was beaten so badly that he nearly died, and then was locked up in a mental institution, where he died nine years later.

Two months after his father had been taken away from the family, White left home with Blind Man Arnold, a black street singer,