Cellebrite, the company which makes near ubiquitous phone hacking and forensics technology used by police officers around the world, has introduced artificial intelligence capabilities into its products, including summarizing chat logs or audio messages from seized mobile phones, according to an announcement from the company last month.

The introduction of AI into a tool that essentially governs how evidence against criminal defendants is analyzed already has civil liberties experts concerned.

“When you have results from an AI, they are not transparent. Often you cannot trace back where a conclusion came from, or what information it is based on. AIs hallucinate. If you always train it on data from cases where there are convictions, it will never understand cases where indictments should not be brought,” Jennifer Granick, surveillance and cybersecurity counsel at the American Civil Liberties Union’s (ACLU) Speech, Privacy, and Technology Project, told 404 Media in an email.

According to Cellebrite’s February 6 announcement, the company’s generative AI capabilities can summarize chat threads “to help prioritize which threads may be most relevant,” contextualize someone’s browsing history to show what was searched for, and build “relationship insight.”

The announcement included a quote from Detective Sergeant Aaron Osman with Susquehanna Township, Pennsylvania Police Department, who Cellebrite says piloted the AI capabilities. “It is impossible to calculate the hours it would have taken to link a series of porch package thefts to an international organized crime ring,” he says. “The GenAI capabilities within Guardian helped us translate and summarize the chats between suspects, which gave us immediate insights into the large criminal network we were dealing with.”

Responding specifically to that case, ACLU’s Granick said “The Fourth Amendment does not permit law enforcement to rummage through data, but only to review information for which there is probable cause. To use an example from the press release, if you have some porch robberies, but no reason to suspect that they are part of a criminal ring, you are not allowed to fish through the data on a hunch, in the hopes of finding something, or ‘just in case.’ In a series of cases, we have been advocating for time and data-category limitations on searches, and a number of courts have held that those limits are necessary when searching a cell phone, computer, or social media account.”

Cellebrite’s newly announced capabilities sound somewhat similar to Draft One, a tool from contracting giant Axon. Draft One uses OpenAI’s tech to automatically generate police reports from bodycam audio. In demonstration videos, Axon also stresses the need for officers to proofread any generated result from Draft One.

Subject: 89% of enterprise AI usage is invisible to the organization
Source: Help Net Security
https://www.bespacific.com/89-of-enterprise-ai-usage-is-invisible-to-the-organization/