Jeff Milwee graduated from Sardis High School and Jacksonville State university.

His first head coaching job cam at J.B. Pennington in 1985. At Pennington, he took his teams to the state playoffs eight times in his eleven years as head football coach.

Following the 1995 season, he left a winning Class 3A program at J. B. Pennington in Blount. Milwee landed in Boaz in 1996 and served as the Pirates head football coach from 1996-99, compiling a record of 20-21.

Milwee resigned his coaching duties at Boaz in March of 2000 and later accepted the head coaching job at Susan Moore, where he spent the next two years before stepping down. His 2000 team went 12-1, losing in the third round of the playoffs.

In 2002 Coach Milwee returned to Boaz as a drivers education instructor. He retired from the football field with a 126-64 record in 17 seasons. Eleven of his teams qualified for the playoffs and seven won area and region titles during his career at three schools.