W.H. Brown was born and raised in Alexander City, Alabama. He was an outstanding athlete at Alexander City High School, now Benjamin Russell. Brown lettered in football, basketball, and baseball during his high school playing days.

He was a three-sport letterman at Southeastern Louisiana University and captain of the football team in 1941. Brown as inducted into the Southeastern Louisiana University Hall of Fame in 1949.

Coach Brown was the head football coach at Ashford High School for 15 years from 1950-64. His teams finished with a combined 93-41-6 record. Three of his squads finished the season with only a single loss on their slate during his tenure.

After retiring from the sidelines he served as the principal at the school for another 15 years before retiring from the school system in 1980.

Brown received several outstanding honors for his athletic prowess, coaching ability, and contributions to his community of Ashford. The football stadium at Ashford High School was named in his honor in 1977, and he was selected as Ashfords Man of the Year in 1980. Following his retirement he continued to reside in Ashford.