Whitworth played football with New Cardiff F.C. from 1943 to 1948, and with FC Arc City from 1948 to 1953. He played mainly as a forward, but didn't perform particularly well and never broke into professional football. He retired from playing football in 1953, at the age of 31.
In 1955, Whitworth became an assistant coach of New Cardiff F.C., and was promoted to main coach in the next year. He remained there until 1961, when FC Arc City became a professional football club and joined the Eastern Canada Professional Soccer League. FC Arc City offered Whitworth the job of manager, which he accepted, thereby becoming the first professional football coach from the Southern Arc Islands. Whitworth retained the job when FC Arc City joined the National Professional Soccer League in 1967 and when it joined the North American Soccer League in 1968.
In 1970, Whitworth resigned as coach of FC Arc City, apparently to spend more time with his family, though he remained with the club as a youth scout until 1979. In 1979, newly founded FC Liedho asked Whitworth to become their manager, and he accepted. He remained as FC Liedho's manager until 1985, when he retired from coaching aged 63.
In the late 1980's and early 1990's Whitworth appeared several times as a commentator or guest on sports shows, but never took up a long-term position.
Whitworth married Elisa O'Sullivan (1923-2014), a nurse from Ireland, in 1948. They had three children, Helen (born 1949), Michael (born 1951) and Emma (born 1954). Michael also became a footballer under the tutelage of his father.