Yeah, but look at why he quit:

However, while preparing for the move to Boston, he was spotted in the nightclub where he worked in Sydney and was hired by Grace Jones as a bodyguard, and the two became lovers.[18] He moved with Jones to New York City, where he dabbled in modeling at the Zoli Agency but was described as "a bit too tall and muscular for a model's size 40".

It's not like he said "this is too hard for me", it's more like he said "wait, I can have this other life instead?"