this post was submitted on 03 May 2025
17 points (94.7% liked)

LocalLLaMA

2951 readers
35 users here now

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

founded 2 years ago
MODERATORS
 

I'm interested in really leveraging the full capabilities of local ai, for code generation and everything else. let me know what you people are using.

top 8 comments
sorted by: hot top controversial new old
[–] [email protected] 2 points 1 week ago

I mostly still use openwebui, but SillyTavern is pretty powerful too.

[–] [email protected] 2 points 1 week ago

I like Witsy, as it offers a lot of system integration that isn't possible with web apps, such as a quick prompt feature and the ability to select text in any app and have the AI act on it. Oh and it's also FOSS.

[–] [email protected] 2 points 1 week ago

Openwebui has a lot of functionality like custom plugins, filters, pipelines and whatnot.

What are you looking to enhance and what do you feel like you are missing there?

[–] [email protected] 1 points 1 week ago

Good old vs code with llm extensions is pretty awesome. I am testing out roo code right now and there are a bunch of other promising ones.

[–] [email protected] 1 points 1 week ago

I’m just coming to grips with MCP and N8N, which along with things like zapier, make.com and activepieces allow llms to reach into the real world. Openwebui looks like you can add some of these functionalities if you can program a little bit. But the idea is to integrate llms into a workflow so that we can create the idea and then have a lot of things actually executed. Right now i am spending a lot of time in a chat window and then moving around copying, pasting, saving, reformatting.

[–] [email protected] 1 points 1 week ago

LLM Studio is pretty popular, and as for code generation I know IntelliJ (so I would guess all JetBrains IDEs) has support for it with their AI tooling that's built in now. I assume there's a similar VS Code plug-in as well if that's your editor of choice.

[–] [email protected] 1 points 1 week ago (1 children)
[–] [email protected] 1 points 1 week ago

I used lm studio when it first came out for a little bit but then I got attracted to all the shiny objects of The AI companies that are making things a little more like an IDE but then if you're going to go that route vs code with an extension just seems to be a natural better choice. anyway I'm happy with open web ui so far, it just isn't intuitive the way that you can expand it. but I have to learn more about programming there's just no excuse. The ability to add functions and have that based stuff like python code is there in open web ui.