4
As of today what would be the best AI to self-host on Linux (alien.top)
submitted 2 years ago by [B] to c/main@selfhosted.forum
11 comments fedilink hide all child comments
 

I will mainly use it for help in coding and general questions.

all 11 comments

sorted by: hot top controversial new old
[–] [B] 2 points 2 years ago (2 children)

Cant say enough good things about Serge

​

https://github.com/serge-chat/serge

  • permalink
  • fedilink
  • source
  • hideshow 2 child comments
    •
    • [–] [B] 2 points 2 years ago (3 children)

    None, don't host it yourself.
    You will need a ton of ram and a really powerfull PC. Additionally your electricity bill will go up significantly

  • permalink
  • fedilink
  • source
  • hideshow 3 child comments
    •
  • [–] [B] 3 points 2 years ago (2 children)

    You do know this is selfhosted, right? People tell us that what we do is "not a good idea" all the time.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
    • [–] [B] 2 points 2 years ago

    Text Generation WebUI, feature-rich. Download models by yourself.

  • permalink
  • fedilink
  • source
    •
    [–] [B] 2 points 2 years ago (2 children)

    Check ollama.

  • permalink
  • fedilink
  • source
  • hideshow 2 child comments
    •