Established in 2021, the center uses artificial intelligence (AI) for comprehensive emergency response, monitoring 900 CCTV cameras across 17 of Seoul's 21 pedestrian-accessible Han River bridges. Beyond suicide prevention, its most frequent task, the center also handles criminal tracking, traffic accidents and drug enforcement.

...

Much of that credit goes to AI, which triggers an alarm if an object identified as a person remains for more than 300 seconds in a bridge's "loitering zones," sections where people are able to stand for extended periods.

you are viewing a single comment's thread
view the rest of the comments
[–] 90 points 3 months ago (25 children)

This is one of the good uses of AI. It is called object detection with neural networks and is a very classic use of convolutional neural networks (CNNs) in computer vision.
There was no LLM, no transformer, no huge data center necessary for training this model.

Please distinguish generative from predictive AI, it means a lot to all the data scientists out there inventing cool stuff!

  • source
  • hideshow 25 child comments
  • [+] -21 points 3 months ago* (last edited 3 months ago) (24 children)

    No, this is not a good use for AI. First, the concept here is to treat symptoms instead of the actual issue, second, stopping suicide attempts from happening isn't the only thing AI is used for here and third, in the context of second, a 15% hallucination rate means a lot of innocent people are harassed for doing nothing wrong.

    Edit, because according to the votes and both answers many people seem to have misunderstand this: the 15% false positive means too many innocent people harassed when this surveillance system is used against crime.
    On the suicide issues, the AI just doesn't solve the issue sustainably.

  • source
  • parent
  • hideshow 24 child comments
  • [–] 27 points 3 months ago (9 children)

    When it comes to suicide prevention, I'd prefer having a few false positives than any false negatives.

    Stopping people from dying is good.

  • source
  • parent
  • hideshow 9 child comments
  • [–] -4 points 3 months ago (8 children)

    That's not the issue where I criticised the false positive rate though, if you read my comment carefully. I hope I made it clearer with my edit.

  • source
  • parent
  • hideshow 8 child comments
  • [–] 5 points 3 months ago* (last edited 3 months ago) (1 child)

    people only said suicide detection was a good use of AI, not crime surveillance. and nobody's pretending stopping a suicide attempt treats the underlying issues either, and that's still better than not stopping it

  • source
  • parent
  • hideshow 1 child comment
  • [–] -1 points 3 months ago (5 children)

    Oh no someone might ask the victim of a false positive if they’re okay. The horror.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 1 point 3 months ago (4 children)

    I guess you never have been targeted by unfounded police action. I hope you never will. It is fucking scary and traumatising.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 0 points 3 months ago (3 children)

    American police is in its own category when it comes to cruelty in “police action”.

    Don’t generalise it to other countries where becoming a police officer isn’t a 3 week online course.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 3 months ago (2 children)

    I am not talking american police. I'm talking about experience with german police. You know, where you have to go to university for three years.
    The training doesn't matter when several armed officers are applying forceful measures against you, you have no idea why, are panicing and your panic reaction is read as resisting police officers. Because that is standard procedure.

  • source
  • parent
  • hideshow 2 child comments
  • [–] [S] 10 points 3 months ago* (10 children)

    ... triggers an alarm if an object identified as a person remains for more than 300 seconds in a bridge’s “loitering zones” ...

    I don't know how the AI can hallucinates in such scenario, but it's better to harass some people to prevent some other people from committing suicide on those bridges.

  • source
  • parent
  • hideshow 10 child comments
  • [–] 2 points 3 months ago (1 child)

    Still, the technology has its weaknesses. Kim said the system carries a hallucination rate of about 15 percent, including instances where it misidentifies an object as a person, which is why human judgment remains the final call.

    That is how it hallucinates.

    Besides that, you unfortunately also did not read my comment completely. I specifically pointed out the other instances this AI surveillance system is used on, the article brings up crime as an example. That is where 15 percent hallucination rate means a damn lot of innocent people get harassed by police.

  • source
  • parent
  • hideshow 1 child comment
  • [–] [S] 7 points 3 months ago

    Oops, my bad for didn't read the whole article.

    Still, the technology has its weaknesses. Kim said the system carries a hallucination rate of about 15 percent, including instances where it misidentifies an object as a person, which is why human judgment remains the final call.

    The AI only flagged the people (or the objects it misidentified as people), but the human still decides whether those people are worth checking on. I think it still the human's fault if a lot of innocent people get harrassed by the police.

  • source
  • parent
  • [–] -4 points 3 months ago* (7 children)

    Why is AI necessary for that? I'm not a programmer, but that seems like a simple if/then statement

  • source
  • parent
  • hideshow 7 child comments
  • [–] 12 points 3 months ago (6 children)

    Sure, but you need a way to identify whether an object is a person. That's a lot less simple.

  • source
  • parent
  • hideshow 6 child comments
  • [+] -8 points 3 months ago* (5 children)
  • [–] 4 points 3 months ago (2 children)

    There are very few things we as humans “need”.

    But a ton of things that make stuff easier. Like using “AI” to detect humans in this case

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 3 months ago

    Yes you do, because an object on camera can look a lot of different ways. This is very different from LLMs like ChatGPT. It trains on different images like a Captcha and gets positive reinforcement if it identifies something correctly and negative if it is incorrect.

    Machine Learning like this has been in use since the days of early digital computing. There isn't a more efficient way to achieve something like this.

  • source
  • parent
  • [–] 2 points 3 months ago

    I certainly agree this does not address the root issue, and it does normalize this technology for adresssing social issues and can then be applied to places where its more harmful like crime- And also I think taken on its own merits this is a good intervention to exist for suicide prevention specifically (though I think its valid to not take it purely on its own merits if one is concerned about the adoption of surveillance tech)

    I do want structural solutions though. But that requires rebuilding society in the image of treating humans better, better work and environmental conditions, rethinking healthcare (at least here in the US, no idea how things are in Korea), and about a million other things

    And I do think the normalization of surveillance infrastructure should be taken seriously. Especially with the present global rise of authoritarianism

  • source
  • parent