submitted 2 years ago* (last edited 2 years ago) by to c/linuxmemes@lemmy.world
 

List of icons/services suggested:

  • Calibre
  • Jitsi
  • Kiwix
  • Monero (Node)
  • Nextcloud
  • Pihole
  • Ollama (Should at least be able to run tiny-llama 1.1B)
  • Open Media Vault
  • Syncthing
  • VLC Media Player Media Server
you are viewing a single comment's thread
view the rest of the comments
[–] [S] 30 points 2 years ago* (last edited 2 years ago)

tinyllama 1.1b would probably run reasonably fast. Dumb as a rock for sure. But hey its a start! My 2015 t460 thinkpad laptop with an i7 6600U 2.6GhZ duo core was able to do llama 3.1 8B at 1.2T-1.7T/s which while definitely slow at about a word per second. Still, was also just fast enough to have fun in real time with conversation.

  • source
  • parent