10
submitted 1 week ago by fizzle@quokk.au to c/fosai@lemmy.world

I keep a lot of notes in markdown files, and I'd like an LLM to assist.

I regularly use Open WebUI with with inference routed through huggingface. Open WebUI kind of has this functionality like you can upload a markdown file and prompt it to improve it in whatever way, but of course that's a fairly clunky workflow.

I really want something built into the editor, that can use RAG to consider other files in context.

I also don't want to be locked in to a specific LLM or provider, I'd like to be able to link it to OpenRouter or similar.

you are viewing a single comment's thread
view the rest of the comments
[-] Bluefruit@lemmy.world 1 points 1 week ago

Koboldcpp has a pretty easy way to add a text db built right into it. You can use any model you want, and its pretty customizable.

this post was submitted on 22 Apr 2026
10 points (85.7% liked)

Free Open-Source Artificial Intelligence

4661 readers
19 users here now

Welcome to Free Open-Source Artificial Intelligence!

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

More AI Communities

LLM Leaderboards

Developer Resources

GitHub Projects

FOSAI Time Capsule

founded 2 years ago
MODERATORS