Robby James was named to the 1967 honorable mention All-State team by the Birmingham News as a running back and defensive back at Foley High School his senior season. He was also a star performer on the field for Livingston University and played on the 1971 NAIA National Championship team.

Coach James accepted his first head coaching job at Catherine Academy in 1983. Over the next fourteen seasons his teams combined for a 113-52-1 record with eleven playoff appearances. The Colts won AISA titles in 1983, 1985, 1991 and 1992.

In the fall of 1994 James moved to Morgan Academy where the winning continued. His Senators won 77 games and lost only 10 over the next seven seasons while making the playoffs every year. He won titles in 1997, 1998, 1999 and 2000.

Faith Academy in Mobile was the next stop for Coach James. He helped transform the Faith Academy program from an AISA doormat into a state title contender, compiling 69-24 record in eight seasons. He led the Rams to AISA title game appearances in 2001, 2007 and 2008. The Rams fell to 3-7 in 2008 in the first season as part of the AHSAA ranks and James resigned his head football coaching duties in early 2009.

Robby James, who had experience coaching eight championship teams in the AISA, brought his expertise as the new head coach at Marengo Academy in 2008. He replaced Jesse Little, who led the Longhorns to a 6-6 record in 2008.

Marengo Academy was needing a headmaster and football coach and called upon Coach James. He has remained with the program ever since. Entering the 2015 season his teams at Marengo have gone 39-30 with four playoff appearances and a state championship in 2013.

Coach James was named the AISA Coach of the Year by the Alabama Sports Writers Association in 2003. He was also inducted into the Alabama Independent School Association Hall of Fame in 2003.

He retired following the 2014 season as one of the winningest coaches in state history.

His overall record is 298-116-1 with a playoff record of 46-19 in twenty-eight playoff appearances. He has been a head football coach for 35 seasons and won a total of nine state championships. James coached undefeated teams in 1985, 91, 92, 98, 2000 and 2013.