this post was submitted on 19 Dec 2024
70 points (90.7% liked)

Technology

60047 readers
2770 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
 

Apple engineers have shared new details on a collaboration with NVIDIA to implement faster text generation performance with large language models.

top 7 comments
sorted by: hot top controversial new old
[–] DJDarren 20 points 3 days ago (1 children)

Super ironic that Apple are working with NVIDIA, and have launched their own AI offering, but you can't connect any kind of GPU to any Mac that they currently sell.

[–] [email protected] 15 points 3 days ago (1 children)

Because of the diminishing returns in using larger and larger models, I’m hopeful that this could lead to more efficient LLM implementations that aren’t so harmful to the environment. Just maybe.

[–] [email protected] 18 points 3 days ago (1 children)

“We made Siri faster but each request now drains a lake.”

[–] [email protected] 7 points 3 days ago (1 children)

"Hey, Siri, give me a real-time count of all existing lakes and update it every second."

[–] [email protected] 5 points 2 days ago

Siri: “Let me search it on the web.”

[–] [email protected] 5 points 2 days ago

Two

spoilerdickheads
are better than one