you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 2 years ago (1 child)

in that case you're looking for llamafiles. single file, llm included, starts into a web gui. the only limitation is that windows limits the size of executable files to 4GB so on that OS you're limited to smaller models.

  • source
  • parent
  • hideshow 1 child comment