Fediverse

30731 readers

435 users here now

A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, KBin, etc).

If you wanted to get help with moderating your own community then head over to [email protected]!

Rules

Posts must be on topic.
Be respectful of others.
Cite the sources used for graphs and other statistics.
Follow the general Lemmy.world rules.

Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration)

founded 2 years ago

MODERATORS

[email protected]

Preliminary LLM tests (lemmings.world)

submitted 1 day ago by [email protected] to c/[email protected]

13 comments fedilink hide all child comments

So far I tested deepseek r1:7b and llama3.2 post on the fediverse and on detecting AI content (I have no shortage of AI content). Seems like llama3.2 takes preforms worse at detecting AI content compared to deepseek but works quicker. I'm not working with any graphics cards. Deepseek model be really good at generating replies with the right prompt, but it does take several minutes to run. No one has said anything about AI text I submitted other than reply I made to the wrong person and people are even sharing and liking the AI produced text

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 3 points 1 day ago (1 children)

Do you generate replies in a custom way every time, adjusting the prompt and supervising the result, or do you have fully-automatic system? If you do use any sort of manual intervention on per post basis, whatever you're doing is not going to work as a bot.

[–] [email protected] 1 points 1 day ago

Rn I'm supervising the response and iterating the prompt. I haven't even implemented a scraper or api. I haven't fully botted it yet because I don't know the architecture I want. Like do I even want ai detector or a script that puts in grammar mistakes or an basic algorithm to pick prompts