d
A fair bit. EmbeddingGemma is open weights and allows for 128-768 dimensions.
It's not as simple as more dimensions = better, due to size, efficiency, and context rot limitations though.
Introducing EmbeddingGemma: The Best-in-Class Open Model for On-Device Embeddings - Google Developers Blog - https://developers.googleblog.com/en/introducing-embeddinggemma/
For shitposting by people who can smell burnt toast.
Rules:
A fair bit. EmbeddingGemma is open weights and allows for 128-768 dimensions.
It's not as simple as more dimensions = better, due to size, efficiency, and context rot limitations though.
Introducing EmbeddingGemma: The Best-in-Class Open Model for On-Device Embeddings - Google Developers Blog - https://developers.googleblog.com/en/introducing-embeddinggemma/