Hello sailors,
I have been job hunting for a while and I have felt a great disadvantage in my job search due to my lack of access to high-quality LLMs. Writing cover letters is honestly so bullshit. GPT-3 is honestly quite bad nowadays, but as a true pirate at heart I couldn't quite get myself to cough up the coin for OpenAI's GPT4 out of principle. I hate them for putting their cutting edge technology behind a paywall, making it inaccessible for their own gain. I feel like this is not what the internet was supposed to be. So today, call me the great emancipator cuz i'm teaching u how to get that shi for free baby
Requirements: Docker
It's all gonna be based off of this github repo: gpt4free
Installing through docker (there's also a way to install with Python PIP if that's more convenient for you. The docker worked for me though)
-
docker pull hlohaus789/g4f -
docker run -p 8080:8080 -p 1337:1337 -p 7900:7900 --shm-size="2g" -v ${PWD}/hardir:/app/hardir hlohaus789/g4f:latest -
Open up the webui in your browser at localhost:8080
-
In the "Provider" dropdown in the bottom look for "Liaobots"
-
Choose "gpt-4-plus" under the "Models" dropdown
??? Profit
The cool thing about gpt4free is that there's a lot of providers and a lot of models to choose from! So if gpt-4-plus from Liaobot doesn't work for you you can switch to something else easily. Do note that some models require you to provide an authentication token or be logged in. Most of them work right out of the box tho.
*this post was not made with any use of an llm I promise ;)
^^list of gpt4 providers
Figuring this one out myself too. Liaobots is a chinese site and when asked about the
gpt-4-plusmodel it mentions that it's based on the gpt-4 architecture but i'm not too sure as well. My guess is that the chinese reverse engineered gpt-4 and put it out there, like a bootleg gpt-4.Bing tends to get heavily ratelimited.
So maybe, yes you're there's a sketchiness and too-good-to-be-true factor to this so maybe calling it "free gpt-4" is a bit misleading. But it's still super cool to have an all-in-one interface for all your llm providers and models :)
There is almost no chance that it is truthfully based on gpt 4. If you want a free, open source llm with 32k context and generous limits, I recommend using huggingface.co/chat/
The nous-hermes model (you can select different models) is uncensored, and performs really well for a open source model. Plus, they have data controls so you can turn off data gathering per model. Huggingface is a reputable vendor, and doesn't claim to be something it isn't.
Huggingface is included in the providers listed here actually :) and i agree. I can’t read chinese so i don’t know how legit or sketch liaobots.com is
I mean, be careful. These llms can be honeypots for data. Like, if you're using it for cover letters, or work, you're sending tons of personal info to random websites.
I would recommend sticking to actual, reputable vendors for llms, or running your own. I have a GTX 1070 and can run some pretty decent models these days locally using koboldai.
Bing is probably the only way to use gpt 4 without paying for it, and Microsoft probably won't steal your bank account info.
Good advice 👍