AI, Wrong Guy: Investigating the use and dangers of artificial intelligence in Jacksonville policing
The Jacksonville Beach Police Department said 51-year-old Robert Dillon allegedly tried luring a 12-year-old child in Jacksonville Beach back in November of 2023. According to a police report, Dillon was linked to a suspect caught on surveillance video in a Jacksonville Beach McDonald's through the use of the Jacksonville Sheriff's Office's AI facial recognition technology.
Jacksonville Beach PD conferred with JSO, according to the report, and the technology found a 93% match between Dillon and the suspect using that technology. The report says police then provided a photo spread of Dillon and other similar-looking individuals to two witnesses. Both identified Dillon as the suspect.
However, the case would later be completely dropped. The state attorney's office told Action News Jax the arrest will be wiped from Mr. Dillon's record.
'Police are not allowed under the Constitution to arrest somebody without probable cause,' Nate Freed-Wessler with the American Civil Liberties Union would later tell Action News Jax. 'And this technology expressly cannot provide probable cause, it is so glitchy, it's so unreliable. At best, it has to be viewed as an extremely unreliability lead because it often, often gets it wrong.'
Freed-Wessler is the deputy director for the ACLU's Speech, Privacy, and Technology Project. He was also part of the legal team that helped sue on behalf of Robert Williams – a Detroit man wrongfully arrested thanks to facial recognition similar to the technology used to identify Dillon. The Detroit Police department settled that case for $300,000 in damages, and implemented safeguards when using AI facial recognition in their investigations.
Freed-Wessler told Action News Jax that wrongful arrests using AI facial recognition are more common than many think, especially among people of color.
'It's partly because of photo quality problems in low light situations, when the cameras are trying to identify darker skin people,' Freed-Wessler explained. 'In fact, in almost all of the wrongful arrest cases around the country that we know of, it's been black people who have been incorrectly, wrongfully picked up by police.'
Action News Jax sat down with Jacksonville Sheriff T.K. Waters to discuss the use of AI facial recognition technology in Jacksonville Sheriff's Office investigations. Sheriff Waters reassured the technology is simply a small piece of the investigative puzzle.
'If you came to me with a facial recognition hit and that was your probable cause, I would probably kick you out of my office because that's not how it works,' Sheriff Waters explained. 'And I can't speak to [the Jacksonville Beach Police Department's] investigation. I can tell you this, there better be a lot more that goes along with that to help make sure that we have the proper individual too.'
[DOWNLOAD: Free Action News Jax app for alerts as news breaks]
However, Freed-Wessler believes this procedure wasn't properly followed by Jacksonville Beach police in their investigation, adding that photo spreads based on a facial recognition match aren't sufficient evidence to make an arrest.
'When this technology gets it wrong, it's going to get it wrong with a face of somebody who looks similar to the suspect,' Freed-Wessler explained. 'It's no surprise that when police juice a lineup procedure with a doppelganger, with a lookalike, a witness is going to choose an innocent person.'
Now, the Jacksonville Beach Police Department tells Action News Jax the investigation is still open after Dillon was cleared of any wrongdoing, adding in part:
'We will not be commenting on this matter beyond stating that all warrant requests are submitted to the state attorney's office. It is solely their decision whether or not to move forward with issuing a warrant.'
Action News Jax reached out to the state attorney's office as well. A spokesman only confirmed Dillon was cleared of any wrongdoing.
Now, Dillon's lawyer tells Action News Jax that he is seeking compensation, although he and Dillon declined interview requests.
Meanwhile Courtney Barclay, an AI policy expert at Jacksonville University, said law enforcement agencies across the nation will continue to use AI and facial recognition. Barclay outlined the need to always second-guess.
'Every industry is just now starting to scratch the surface of the potential of AI, how it can impact our society. Law enforcement is no exception,' Barclay said. 'And so, again, we just want to be cognizant of the risks.'
>>> STREAM ACTION NEWS JAX LIVE <<<
[SIGN UP: Action News Jax Daily Headlines Newsletter]
Hashtags
Try Our AI Features
Explore what Daily8 AI can do for you:
Comments
No comments yet...
Related Articles
CNN
an hour ago
- CNN
Prosecutors clear Florida deputy in arrest of a Black man punched and dragged from his car
Prosecutors will take 'no further action' against a Florida sheriff's deputy in the arrest of a Black college student pulled from his car and beaten by officers during a February traffic stop. The actions of Officer D. Bowers of the Jacksonville Sheriff's Office did not constitute a crime, according to an investigative report released by the State Attorney's Office for the Fourth Judicial Circuit of Florida. A video showing officers punching and dragging William McNeil from his car sparked nationwide outrage, though Jacksonville Sheriff T.K. Waters has said there's more to the story than the cell phone video that went viral online and that McNeil was repeatedly asked to exit his vehicle. In the investigative memo released Wednesday, prosecutors called the cell phone footage 'incomplete in scope' and said Bowers made a lawful traffic stop when he pulled McNeil over and that Bowers' use of force was justified. 'The State Attorney's Office has reviewed this matter to determine whether any of Officer Bowers' actions constitute a crime. We conclude they do not,' the report reads. According to the report, Bowers stopped McNeil for failing to turn on his headlights and buckle his seatbelt, after seeing his SUV parked outside a house the officer was surveilling for 'drug activity.' Based on a review of officer body camera footage, interviews the Jacksonville Sheriff's Office conducted with the officers involved and statements by McNeil, prosecutors said Bowers gave McNeil a dozen 'lawful commands,' which he disobeyed. After Bowers pulled him over, McNeil questioned the stop and declined to provide his license and registration. Though he earlier had his car door open while talking with an officer, he later closed it and appeared to keep it locked for about three minutes before the officers forcibly removed him, the video shows. 'It is the officers' body-worn camera footage that provides the additional needed context of the circumstances preceding, surrounding, and following McNeil's arrest,' the report reads. A statement from McNeil's lawyers, Ben Crump and Harry Daniels, called the report clearing the deputy 'little more than an attempt to justify the actions of Officer Bowers and his fellow officers after the fact.' Crump is a Black civil rights attorney who has gained national prominence representing victims of police brutality and vigilante violence. 'Frankly, we expected nothing less especially after Sheriff Waters announced their conclusions more than three weeks before the report was issued,' the statement said. 'Since they are unwilling to seek justice, we will have to request that the U.S. Department of Justice investigate this incident and the Jacksonville Sheriff's Office.' Previously, Crump has fiercely criticized prosecutors' finding that officers did not commit any criminal wrongdoing, saying his client remained calm while the officers who are trained to deescalate tense situations were the ones escalating violence. Crump said the case harkened back to the Civil Rights movement, when Black people were often attacked when they tried to assert their rights.
Axios
an hour ago
- Axios
Violent crime in border cities fell below national rate in 2024
Several U.S. border communities saw violent crime drop below the national average in 2024, as nationwide rates fell to 20-year lows, according to new FBI data analyzed by Axios. Why it matters: The findings from last year run counter to claims by President Trump and GOP leaders, who painted border towns as crime hotspots because of newly arrived immigrants. The big picture: Eleven border cities examined annually by Axios — Brownsville, McAllen, Laredo, Eagle Pass, Del Rio and El Paso in Texas; Sunland Park in New Mexico; Nogales and Yuma in Arizona; and Calexico and San Diego in California — had an average violent crime rate of 356.5 per 100,000 residents. That was a sizable drop from 2023 and was slightly below the national average of 359.1 violent crimes per 100,000 residents last year, FBI numbers show. Between the lines: The 11 border communities, all of them majority-Latino, had a homicide rate of 2.5 per 100,000 residents — half of the national average of 5 per 100,000. Four of the border cities — Del Rio, Eagle Pass, Sunland Park and Nogales — reported no homicides in 2024, the data show. El Paso and Yuma had the highest homicide rate among the border communities with 2.9 per 100,000, still well below the national average. The intrigue: McAllen — located across the Rio Grande from Reynosa, Mexico, one of the most dangerous places in the Americas — had one of the lowest violent crime rates on the border. Zoom out: The border communities had low crime rates before Trump took office, boosted border security and canceled millions of dollars in federal money for crime prevention programs. Early numbers for 2025 indicate that overall violent crime in the border cities is continuing to drop, as Trump's lockdown of the border has greatly reduced illegal crossings. Yes, but: Local officials fear that could change if the administration pulls back on anti-crime grants amid fights over immigration enforcement. The Trump administration is threatening to withhold millions of dollars in law enforcement grants unless cities agree to work with federal immigration officials on mass deportations. El Paso has been an exception this year, experiencing a 42% jump in homicides in the first half of 2025, according to the Major Cities Chiefs Association (MCCA). The intrigue: Some border cities, such as Laredo and Sunland Park, are dispatching AI-enhanced drones to help fight crime amid officer shortages. Flashback: Throughout the 2024 presidential campaign, Trump repeated false claims that migrants from Latin America, Africa and the Middle East were responsible for jumps in violent crime, despite studies showing violent crime was dropping.
CNN
an hour ago
- CNN
Prosecutors clear Florida deputy in arrest of a Black man punched and dragged from his car
Race & ethnicityFacebookTweetLink Follow Prosecutors will take 'no further action' against a Florida sheriff's deputy in the arrest of a Black college student pulled from his car and beaten by officers during a February traffic stop. The actions of Officer D. Bowers of the Jacksonville Sheriff's Office did not constitute a crime, according to an investigative report released by the State Attorney's Office for the Fourth Judicial Circuit of Florida. A video showing officers punching and dragging William McNeil from his car sparked nationwide outrage, though Jacksonville Sheriff T.K. Waters has said there's more to the story than the cell phone video that went viral online and that McNeil was repeatedly asked to exit his vehicle. In the investigative memo released Wednesday, prosecutors called the cell phone footage 'incomplete in scope' and said Bowers made a lawful traffic stop when he pulled McNeil over and that Bowers' use of force was justified. 'The State Attorney's Office has reviewed this matter to determine whether any of Officer Bowers' actions constitute a crime. We conclude they do not,' the report reads. According to the report, Bowers stopped McNeil for failing to turn on his headlights and buckle his seatbelt, after seeing his SUV parked outside a house the officer was surveilling for 'drug activity.' Based on a review of officer body camera footage, interviews the Jacksonville Sheriff's Office conducted with the officers involved and statements by McNeil, prosecutors said Bowers gave McNeil a dozen 'lawful commands,' which he disobeyed. After Bowers pulled him over, McNeil questioned the stop and declined to provide his license and registration. Though he earlier had his car door open while talking with an officer, he later closed it and appeared to keep it locked for about three minutes before the officers forcibly removed him, the video shows. 'It is the officers' body-worn camera footage that provides the additional needed context of the circumstances preceding, surrounding, and following McNeil's arrest,' the report reads. A statement from McNeil's lawyers, Ben Crump and Harry Daniels, called the report clearing the deputy 'little more than an attempt to justify the actions of Officer Bowers and his fellow officers after the fact.' Crump is a Black civil rights attorney who has gained national prominence representing victims of police brutality and vigilante violence. 'Frankly, we expected nothing less especially after Sheriff Waters announced their conclusions more than three weeks before the report was issued,' the statement said. 'Since they are unwilling to seek justice, we will have to request that the U.S. Department of Justice investigate this incident and the Jacksonville Sheriff's Office.' Previously, Crump has fiercely criticized prosecutors' finding that officers did not commit any criminal wrongdoing, saying his client remained calm while the officers who are trained to deescalate tense situations were the ones escalating violence. Crump said the case harkened back to the Civil Rights movement, when Black people were often attacked when they tried to assert their rights.
