I'm still waiting for a local autonomous AI agent with search. I don't understand why most autonomous agent projects use GPT-4 without incorporating search capabilities. Allowing the model to continuously hallucinate is not productive. Instead, it should be able to discover factual information and perform genuinely useful tasks.

I've got this running. And it's fun!

But it's also bad compared to chatgpt, or even bing.

Im looking forward to foss ai solutions have their breakthrough, but for now, they cant compete with proprietary Software. Except maybe stable Diffusion

Worth noting that if you want a local LLM on android MLCChat can run Vicuna-7B, RedPajama and several other models from huggingface on fairly average hardware. The interface is still basic but it's functional.

how do these compare to gpt3 and 4?

i'll probably stick to automatic1111 oobabooga (mixed up my tools) for now, seeing as they both seem to run the same models. certainly neat to see a more general userfriendly app tho

Been playing around for a couple of weeks with it, and its local server option made it really easy to use with langchain + Orca mini is amazingly fast (but need proper prompts it seems - I still need to work this out it seems :D ) oh and it even lets you see the server side chat, reaaaaally useful when you chain prompts with langchain