Earlier than that, even. Mark chapter 1 talks about Jesus first setting up his ministry, and in verses 16 and 17 says:

As Jesus walked beside the Sea of Galilee, he saw Simon and his brother Andrew casting a net into the lake, for they were fishermen. “Come, follow me,” Jesus said, “and I will send you out to fish for people.”

This is from the NIV. It's sometimes translated as "fishers of men".

A lot of his early disciples were fisherman, so it likely goes back into that.