[-] [email protected] 1 points 18 hours ago

You can still use the IGP, which might be faster in some cases.

[-] [email protected] 2 points 1 day ago* (last edited 1 day ago)

Or, to be even more crude, him as a caricature of Mohamad.

(Please don't ban me mods, we live in a world where this could actually happen on national TV).

[-] [email protected] 12 points 1 day ago* (last edited 1 day ago)

Sort of?

A comprehensive look at voter turnout from 2000 onwards reveals that the average turnout rate for primary elections is 27% of registered voters, compared to 60.5% for general elections. It should be noted that less than half of the voters who cast a ballot in the general election participate in primaries.

https://goodparty.org/blog/article/primary-vs-general-election

All sorts of problems have solutions. I see this a lot in the tech space, like the need to save a video, Adblock, whatever.

…But generally, people don’t use them. Or know about them.

US primaries feel similar, where voters technically have the ability to choose candidates but, statistically, they don’t.

Attention is finite. Many dont know about primaries. To me, giving people the choice doesn’t matter if it’s obscure and inaccessibly designed.

[-] [email protected] 1 points 1 day ago* (last edited 1 day ago)

Oh actually that's a great card for LLM serving!

Use the llama.cpp server from source, it has better support for Pascal cards than anything else:

https://github.com/ggml-org/llama.cpp/blob/master/docs/multimodal.md


Gemma 3 is a hair too big (like 17-18GB), so I'd start with InternVL 14B Q5K XL: https://huggingface.co/unsloth/InternVL3-14B-Instruct-GGUF

Or Mixtral 24B IQ4_XS for more 'text' intelligence than vision: https://huggingface.co/unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF

I'm a bit 'behind' on the vision model scene, so I can look around more if they don't feel sufficient, or walk you through setting up the llama.cpp server. Basically it provides an endpoint which you can hit with the same API as ChatGPT.

[-] [email protected] 4 points 1 day ago

Is this an ADHD meme?

I'm afraid it might be, cause I have a trail of 'one giant playlists' and songs on repeat.

[-] [email protected] 4 points 2 days ago

I know. I am on Lemmy, heh.

[-] [email protected] 21 points 2 days ago* (last edited 2 days ago)

I feel a strong Streisand Effect here.

Democratic boogoeypeople who aren't literally Hillary Clinton are exactly what the party needs. They wanna obsess over him? Well, Trump seems to have forgotten "there's no such thing as bad attention."

[-] [email protected] 10 points 2 days ago* (last edited 2 days ago)

Not in niche games. Rimworld and Stellaris (for instance) are dramatically faster on Windows, hence I keep a partition around. I'm talking 40%ish better simulation speeds vs Linux native (and still a hit with Proton, though much less).

Minecraft and Starsector, on the other hand, freaking love Linux. They’re dramatically faster.

These are kinda extreme scenarios, but the point is AAA benchmarks don’t necessarily apply to the spectrum of games across hardware, especially once you start looking at simulation heavy ones.

[-] [email protected] 21 points 3 days ago* (last edited 3 days ago)

Thanks.

I found morgthorak (as their post was deleted).

(Offensive Language Warning) https://mk.gabe.rocks/@[email protected]

I figured "Is Morg that bad? Maybe Linus is overreacting, or there's missing context?" Ohhh boy. I can't even quote their posts without violating Lemmy's rules, but its openly white supremacist and crudely homophobic.

But it is kinda... morbidly fascinating to peer into that sort of community. I haven't heard some of those slurs since high school.

[-] [email protected] 60 points 4 days ago* (last edited 4 days ago)

Doing some sleuthing, it appears a former follower was mad about some incidents at the shelter, and started a subreddit against it:

SFW, but click at your own risk.https://web.archive.org/web/20250307232100/https://www.reddit.com/r/saveafoxsnark/

The last web archive backup is old, but my guess is the subreddit snowballed (due to the Reddit engagement algo loving hatesubs, of course) and got us here.

So... yeah.

Rest in peace.

[-] [email protected] 56 points 4 days ago* (last edited 4 days ago)

TBH you should fold this into localllama? Or open source AI?

I have very mixed (mostly bad) feelings on ollama. In a nutshell, they're kinda Twitter attention grabbers that give zero credit/contribution to the underlying framework (llama.cpp). And that's just the tip of the iceberg, they've made lots of controversial moves, and it seems like they're headed for commercial enshittification.

They're... slimy.

They like to pretend they're the only way to run local LLMs and blot out any other discussion, which is why I feel kinda bad about a dedicated ollama community.

It's also a highly suboptimal way for most people to run LLMs, especially if you're willing to tweak.

I would always recommend Kobold.cpp, tabbyAPI, ik_llama.cpp, Aphrodite, LM Studio, the llama.cpp server, sglang, the AMD lemonade server, any number of backends over them. Literally anything but ollama.


...TL;DR I don't the the idea of focusing on ollama at the expense of other backends. Running LLMs locally should be the community, not ollama specifically.

223
submitted 5 days ago* (last edited 5 days ago) by [email protected] to c/[email protected]

As to why it (IMO) qualifies:

"My children are 22, 25, and 27. I will literally fight ANYONE for their future," Greene wrote. "And their future and their entire generation's future MUST be free of America LAST foreign wars that provoke terrorists attacks on our homeland, military drafts, and NUCLEAR WAR."

Hence, she feels her support is threatening her kids.

"MTG getting her face eaten" was not on my 2025 bingo card, though she is in the early stage of face eating.

60
submitted 6 days ago by [email protected] to c/[email protected]

"It's not politically correct to use the term, 'Regime Change' but if the current Iranian Regime is unable to MAKE IRAN GREAT AGAIN, why wouldn't there be a Regime change??? MIGA!!

154
submitted 1 week ago* (last edited 1 week ago) by [email protected] to c/[email protected]

Video is linked. SFW, but keep your volume down.

4
submitted 3 weeks ago* (last edited 3 weeks ago) by [email protected] to c/[email protected]

In a nutshell, he’s allegedly frustrated by too few policies favorable to him.

75
submitted 1 month ago* (last edited 1 month ago) by [email protected] to c/[email protected]
  • The IDF is planning to displace close to 2 million Palestinians to the Rafah area, where compounds for the delivery of humanitarian aid are being built.
  • The compounds are to be managed by a new international foundation and private U.S. companies, though it's unclear how the plan will function after the UN and all aid organizations announced they won't take part
17
Qwen3 "Leaked" (huggingface.co)
submitted 2 months ago by [email protected] to c/[email protected]

Qwen3 was apparently posted early, then quickly pulled from HuggingFace and Modelscope. The large ones are MoEs, per screenshots from Reddit:

screenshots

Including a 235B/22B active and a 30B/3B active.

Context appears to 'only' be 32K unfortunately: https://huggingface.co/qingy2024/Qwen3-0.6B/blob/main/config_4b.json

But its possible they're still training them to 256K:

from reddit

Take it all with a grain of salt, configs could change with the official release, but it appears it is happening today.

23
submitted 2 months ago* (last edited 2 months ago) by [email protected] to c/[email protected]

This is one of the "smartest" models you can fit on a 24GB GPU now, with no offloading and very little quantization loss. It feels big and insightful, like a better (albeit dry) Llama 3.3 70B with thinking, and with more STEM world knowledge than QwQ 32B, but comfortably fits thanks the new exl3 quantization!

Quantization Loss

You need to use a backend that support exl3, like (at the moment) text-gen-web-ui or (soon) TabbyAPI.

62
submitted 2 months ago by [email protected] to c/[email protected]

"It makes me think that maybe he [Putin] doesn't want to stop the war, he's just tapping me along, and has to be dealt with differently, through 'Banking' or 'Secondary Sanctions?' Too many people are dying!!!", Trump wrote.

154
submitted 2 months ago* (last edited 2 months ago) by [email protected] to c/[email protected]

The U.S. expects Ukraine's response Wednesday to a peace framework that includes U.S. recognition of Crimea as part of Russia and unofficial recognition of Russian control of nearly all areas occupied since the 2022 invasion, sources with direct knowledge of the proposal tell Axios.

What Russia gets under Trump's proposal:

  • "De jure" U.S. recognition of Russian control in Crimea.
  • "De-facto recognition" of the Russia's occupation of nearly all of Luhansk oblast and the occupied portions of Donetsk, Kherson and Zaporizhzhia.
  • A promise that Ukraine will not become a member of NATO. The text notes that Ukraine could become part of the European Union.
  • The lifting of sanctions imposed since 2014.
  • Enhanced economic cooperation with the U.S., particularly in the energy and industrial sectors.

What Ukraine gets under Trump's proposal:

  • "A robust security guarantee" involving an ad hoc group of European countries and potentially also like-minded non-European countries. The document is vague in terms of how this peacekeeping operation would function and does not mention any U.S. participation.
  • The return of the small part of Kharkiv oblast Russia has occupied.
  • Unimpeded passage of the Dnieper River, which runs along the front line in parts of southern Ukraine.
  • Compensation and assistance for rebuilding, though the document does not say where the funding will come from.

Whole article is worth a read, as it’s quite short/dense as Axios usually is. For those outside the US, this is an outlet that’s been well sourced in Washington for years.

13
submitted 2 months ago* (last edited 2 months ago) by [email protected] to c/[email protected]

Seems there's not a lot of talk about relatively unknown finetunes these days, so I'll start posting more!

Openbuddy's been on my radar, but this one is very interesting: QwQ 32B, post-trained on openbuddy's dataset, apparently with QAT applied (though it's kinda unclear) and context-extended. Observations:

  • Quantized with exllamav2, it seems to show lower distortion levels than nomal QwQ. Its works conspicuously well at 4.0bpw and 3.5bpw.

  • Seems good at long context. Have not tested 200K, but it's quite excellent in the 64K range.

  • Works fine in English.

  • The chat template is funky. It seems to mix up the and <|think|> tags in particular (why don't they just use ChatML?), and needs some wrangling with your own template.

  • Seems smart, can't say if it's better or worse than QwQ yet, other than it doesn't seem to "suffer" below 3.75bpw like QwQ does.

Also, I reposted this from /r/locallama, as I feel the community generally should going forward. With its spirit, it seems like we should be on Lemmy instead?

41
submitted 2 months ago* (last edited 2 months ago) by [email protected] to c/[email protected]

So I had a clip I wanted to upload to a lemmy comment:

  • Tried it as an (avc) mp4... Failed.
  • OK, too big? I shrink it to 2MB, then 1MB. Failed.
  • VP9 Webm maybe? 2MB, 1MB, failed. AV1? Failed.
  • OK, fine, no video. Lets try an animated AVIF. Failed. It seems lemmy doesn't even take static AVIF images
  • WebP animation then... Failed. Animated PNG, failed.

End result, I have to burden the server with a massive, crappy looking GIF after trying a dozen formats. With all due respect, this is worse than some aging service like Reddit that doesn't support new media formats.

For reference, I'm using the web interface. Is this just a format restriction of lemmy.world, or an underlying software support issue?

-4
submitted 4 months ago by [email protected] to c/[email protected]

53% of Americans approve of Trump so far, according to a newly released CBS News/YouGov poll conducted Feb. 5 to 7, while 47% disapproved.

A large majority, 70%, said he was doing what he promised in the campaign, per the poll that was released on Sunday.

Yes, but: 66% said he was not focusing enough on lowering prices, a key campaign trail promise that propelled Trump to the White House.

44% of Republicans said Musk and DOGE should have "some" influence, while just 13% of Democrats agreed.

view more: next ›

brucethemoose

0 post score
0 comment score
joined 1 year ago