Carleton was born near Jerusalem, Monroe County, Ohio, but the family moved to Cloud County, Kansas, in 1876 where he worked on his father's farm. He attended Kansas State Agricultural College (now Kansas State University), graduating in 1887 with his bachelor's.