He regularly attended meetings at the Fulton and Bromfield Street churches, where his enthusiastic behavior earned him the nickname "The Glory to God man". In an attempt to imitate Jesus, Corbett began to wear his hair very long, but the Union Army forced him to cut it upon enlisting.

Corbett was described as friendly and open, helpful to those he saw in need but also quick to condemn those he thought were out of step with God. He routinely gathered up drunken sinners