Fred W. Ross was born August 23, 1910 in San Francisco to Fred W. and Daisy C. Ross. He grew up in the Echo Park neighborhood of Los Angeles and attended Belmont High School until 1929. An English literature and social science major, he graduated from the University of Southern California in 1937.