The terms "ultra-left" and "left-communist" have been in use since the 1920s, and describe the tendencies put forward by Bordiga, Ruhlë, and Pannekoek. You can read Lenin's thoughts on these do-nothings in "Left-Wing" Communism: An Infantile Disorder.

The term's use in football didn't show up until the 1960s.