scheduleThis article is more than 6 years old
TECHNOLOGY

National Convention sets up task force on algorithms in the judiciary

A new body will study the use of predictive algorithms while guarding against bias.

CvL

By the Courant van Lazia editorial staff

Lazia, 23 October 2019 — The National Convention of 2019 has established a task force to examine the use of computer algorithms in the Mahusetan judiciary, wading into a debate over predictive policing that has been playing out across the forces of England and Wales.

For a time the humans appeared to be winning. London’s Metropolitan Police celebrated a squad of “super-recognisers” for their ability to recall faces from footage — spotting offenders in crowds of thousands and catching a thief who had taken more than £100,000 (ƒ260,184) of luxury goods. During the 2011 riots one such officer identified 180 of 4,000 suspects captured on camera, where the software managed a single one. “Computers are no match for the super-recognisers,” the unit’s chief boasted at the time.

The computers are now back with a fighting chance. Many of the 43 forces in England and Wales are experimenting with algorithmic tools, some to predict where and when crimes are likely to occur; Cambridge University helped Durham Constabulary build an algorithm to estimate the likelihood that a suspect would reoffend, informing decisions on bail and on rehabilitation as an alternative to prosecution. At least one force has proposed fitting microphones to “smart lamp-posts” to gather intelligence in crowds.

The prospect of predictive algorithms in the judiciary has not gone uncriticised. Detractors warn that such systems risk re-entrenching unconscious biases, that they may merely predict existing patterns of official behaviour, and that the statistical significance of their predictions can verge on the negligible — all while lending an undeserved air of impartiality to an institution still finding its feet. The underlying data, they note, is limited and skewed, tending to record law enforcement’s response to the reports it receives rather than the full incidence of crime, so that systems built upon it may reinforce bias and sanitise injustice.

To allow for the use of algorithms without deepening such discrepancies, the National Convention has created a dedicated task force, which moved quickly to adopt a set of guiding principles: that the use of algorithms be transparent, since secrecy forecloses informed public debate; that they serve community needs; that they not undermine the constitutional rights of individuals; that they serve human needs rather than intensify biases; and that they be turned, too, towards anticipating official misconduct, and so towards protecting citizens’ civil rights.

Asked for his view, President Van der Huijsen said he hoped the task force would “allow for the proper usage of computer algorithms in such a way that will maintain the rights guaranteed by our Constitution for all the people of Mahuset”.

Edited for the relaunch of the Courant van Lazia.