Established in 2021, the center uses artificial intelligence (AI) for comprehensive emergency response, monitoring 900 CCTV cameras across 17 of Seoul's 21 pedestrian-accessible Han River bridges. Beyond suicide prevention, its most frequent task, the center also handles criminal tracking, traffic accidents and drug enforcement.

...

Much of that credit goes to AI, which triggers an alarm if an object identified as a person remains for more than 300 seconds in a bridge's "loitering zones," sections where people are able to stand for extended periods.

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 10 points 3 months ago* (10 children)

... triggers an alarm if an object identified as a person remains for more than 300 seconds in a bridge’s “loitering zones” ...

I don't know how the AI can hallucinates in such scenario, but it's better to harass some people to prevent some other people from committing suicide on those bridges.

  • source
  • parent
  • hideshow 10 child comments
  • [–] 2 points 3 months ago (1 child)

    Still, the technology has its weaknesses. Kim said the system carries a hallucination rate of about 15 percent, including instances where it misidentifies an object as a person, which is why human judgment remains the final call.

    That is how it hallucinates.

    Besides that, you unfortunately also did not read my comment completely. I specifically pointed out the other instances this AI surveillance system is used on, the article brings up crime as an example. That is where 15 percent hallucination rate means a damn lot of innocent people get harassed by police.

  • source
  • parent
  • hideshow 1 child comment
  • [–] [S] 7 points 3 months ago

    Oops, my bad for didn't read the whole article.

    Still, the technology has its weaknesses. Kim said the system carries a hallucination rate of about 15 percent, including instances where it misidentifies an object as a person, which is why human judgment remains the final call.

    The AI only flagged the people (or the objects it misidentified as people), but the human still decides whether those people are worth checking on. I think it still the human's fault if a lot of innocent people get harrassed by the police.

  • source
  • parent
  • [–] -4 points 3 months ago* (7 children)

    Why is AI necessary for that? I'm not a programmer, but that seems like a simple if/then statement

  • source
  • parent
  • hideshow 7 child comments
  • [–] 12 points 3 months ago (6 children)

    Sure, but you need a way to identify whether an object is a person. That's a lot less simple.

  • source
  • parent
  • hideshow 6 child comments
  • [+] -8 points 3 months ago* (5 children)
  • [–] 4 points 3 months ago (2 children)

    There are very few things we as humans “need”.

    But a ton of things that make stuff easier. Like using “AI” to detect humans in this case

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 3 months ago

    Yes you do, because an object on camera can look a lot of different ways. This is very different from LLMs like ChatGPT. It trains on different images like a Captcha and gets positive reinforcement if it identifies something correctly and negative if it is incorrect.

    Machine Learning like this has been in use since the days of early digital computing. There isn't a more efficient way to achieve something like this.

  • source
  • parent