News

23622 readers

2906 users here now

Welcome to the News community!

Rules:

1. Be civil

Attack the argument, not the person. No racism/sexism/bigotry. Good faith argumentation only. This includes accusing another user of being a bot or paid actor. Trolling is uncivil and is grounds for removal and/or a community ban. Do not respond to rule-breaking content; report it and move on.

2. All posts should contain a source (url) that is as reliable and unbiased as possible and must only contain one link.

Obvious right or left wing sources will be removed at the mods discretion. We have an actively updated blocklist, which you can see here: https://lemmy.world/post/2246130 if you feel like any website is missing, contact the mods. Supporting links can be added in comments or posted seperately but not to the post body.

3. No bots, spam or self-promotion.

Only approved bots, which follow the guidelines for bots set by the instance, are allowed.

4. Post titles should be the same as the article used as source.

Posts which titles don’t match the source won’t be removed, but the autoMod will notify you, and if your title misrepresents the original article, the post will be deleted. If the site changed their headline, the bot might still contact you, just ignore it, we won’t delete your post.

5. Only recent news is allowed.

Posts must be news from the most recent 30 days.

6. All posts must be news articles.

No opinion pieces, Listicles, editorials or celebrity gossip is allowed. All posts will be judged on a case-by-case basis.

7. No duplicate posts.

If a source you used was already posted by someone else, the autoMod will leave a message. Please remove your post if the autoMod is correct. If the post that matches your post is very old, we refer you to rule 5.

8. Misinformation is prohibited.

Misinformation / propaganda is strictly prohibited. Any comment or post containing or linking to misinformation will be removed. If you feel that your post has been removed in error, credible sources must be provided.

9. No link shorteners.

The auto mod will contact you if a link shortener is detected, please delete your post if they are right.

10. Don't copy entire article in your post body

For copyright reasons, you are not allowed to copy an entire article into your post body. This is an instance wide rule, that is strictly enforced in this community.

founded 2 years ago

MODERATORS

[email protected]

238

Army Testing Robot Dogs Armed with Artificial Intelligence-Enabled Rifles in Middle East (www.military.com)

submitted 2 months ago by [email protected] to c/[email protected]

78 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 2 points 2 months ago* (last edited 2 months ago) (1 children)

I attended a federal contracting conference a few months ago, and they had one of these things (or a variant) walking around the lobby.

From talking to the guy who was babysitting it, they can operate autonomously in units or be controlled in a general way (think higher level unit deployment and firing policies rather than individual remote control) given a satellite connection. In a panel at the same conference, they were discussing AI safety, and I asked:

Given that AI seems to be developing from less complex tasks like chess (which is still complicated, obviously, but a constrained problem) to more complex and ill-defined tasks like image generation, it seems that it's inevitable that we will develop AI capable of providing strategic or tactical plans, if we haven't already. If two otherwise-equally-matched military units are fighting, it seems reasonable to believe that the one using an AI to make decisions within seconds would win over the one with human leadership, simply because they would react more quickly to changing battlefield conditions. This would place an enormous incentive on the US military to adopt AI assisted strategic control, which would likely lead to units of autonomous weapons which are also controlled by an autonomous system. Do any of you have any concerns about this, and if so, do you have any ideas about how we can mitigate the problem.

(Paraphrasing, obviously, but this is close)

The panel members looked at each other, looked at me, smiled, shrugged, and didn't say anything. The moderator asked them explicitly if they would like to respond, and they all declined.

I think we're at the point where an AI could be used to create strategies, and I would be very surprised if no one were trying to do this. We already have autonomous weapons, and it's only a matter of time before someone starts putting them together. Yeah, they will generally act reasonably, because they'll be trained on human tactics in a variety of scenarios, but that will be cold comfort to dead civilians who happened to get in the way of a hallucinating strategic model.

EDIT: I know I'm not actually addressing anything you said, but you seem to have thought about this a bit, and I was curious about what you thought of this scenario.

[–] [email protected] 1 points 2 months ago* (last edited 2 months ago)

My guess is that they didn't answer your question because they had strict instructions not to stray from the script on this topic. Saying the wrong thing could lead to a big PR problem, so I don't expect that people working in this field would be willing to have a candid public discussion even about topics to which they have given a lot of thought. I do expect that they have given the ability of AI to obey orders accurately a lot of thought at least due to practical (if not ethical) concerns.

I mean, I am currently willing to say "the AIs will almost definitely kill civilians but we should build them anyway" because I don't work in defense. However, even I'm a little nervous saying that because one day I might want to. My friends who do work in defense have told me that the people who gave them clearance did investigate their online presence. (My background is in computational biochemistry but I look at what's going on in AI and I feel like nothing else is important in comparison.)

As for cold comfort: I think autonomous weapons are inevitable in the same way that the atom bomb was inevitable. Even if no one wants to see it used, everyone wants to have it because enemies will. However, I don't see a present need for strategic (as opposed to tactical) automation. A computer would have an advantage in battlefield control but strategy takes hours or days or years and so a human's more reliable ability to reason would be more important in that domain.

Once a computer can reason better than a human can, that's the end of the world as we know it. It's also inevitable like the atom bomb.