this post was submitted on 28 Jun 2023
13 points (93.3% liked)

LocalLLaMA

2209 readers
1 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 1 year ago
MODERATORS
 

Long Sequence Modeling with XGen: A 7B LLM Trained on 8K Input Sequence Length -- https://blog.salesforceairesearch.com/xgen/

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 1 year ago

Seems like they're sticking with the 7b series for the time being.