d

you are viewing a single comment's thread
view the rest of the comments
[–] 10 points 4 months ago* (last edited 4 months ago) (2 children)

Semantic Vectors don't work that way.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 12 points 4 months ago (1 child)

    Yeah, if words were actually encoded as 1-hot vectors this would be pretty trivial, but the rest of LLM training would be somewhere between infeasible and impossible. The actual embedding vectors obscure spelling even more.

    Side note: last time I checked, current embedding vectors were approximately 40 dimensional... Has that gone up significantly in the last couple of years?

  • source
  • parent
  • hideshow 1 child comment