Better Cities Project
  • Home
  • About Us
    Our Vision
    BCP’s vision is that free-market municipal policy solutions are broadly available, widely acceptable, and regularly employed, enabling American cities to achieve their full potential as engines of economic prosperity. We reject the idea that cities are lost to free-market principles or policies.
    Our Mission
    BCP uncovers ideas that work, promotes realistic solutions, and forges partnerships that help people in America’s largest cities live free and happy lives.
    Learn More
    • About Better Cities Project
    • Our Focus Areas
    • Our Team
    • Collaboration and Careers -- Work With BCP
  • Research and Projects
  • Latest Insights
  • Videos
  • Contact

    Address

    304 S. Jones Blvd #2826
    Las Vegas NV 89107

    Phone

    (702) 608-2046‬

    Hours

    Monday through Friday, 8 a.m. - 5 p.m.

    Email

    info@better-cities.org

No Result
View All Result
Better Cities Project
  • Home
  • About Us
    Our Vision
    BCP’s vision is that free-market municipal policy solutions are broadly available, widely acceptable, and regularly employed, enabling American cities to achieve their full potential as engines of economic prosperity. We reject the idea that cities are lost to free-market principles or policies.
    Our Mission
    BCP uncovers ideas that work, promotes realistic solutions, and forges partnerships that help people in America’s largest cities live free and happy lives.
    Learn More
    • About Better Cities Project
    • Our Focus Areas
    • Our Team
    • Collaboration and Careers -- Work With BCP
  • Research and Projects
  • Latest Insights
  • Videos
  • Contact

    Address

    304 S. Jones Blvd #2826
    Las Vegas NV 89107

    Phone

    (702) 608-2046‬

    Hours

    Monday through Friday, 8 a.m. - 5 p.m.

    Email

    info@better-cities.org

No Result
View All Result
Better Cities Project
No Result
View All Result
Home Criminal Justice and Public Safety

Policing by algorithm: Does it work? Is it fair?

Out of over 50 agencies surveyed, none indicated they had examined effectiveness of 'data-driven' approach.

Beryl LiptonbyBeryl Lipton
February 16, 2020
in Criminal Justice and Public Safety
Reading Time: 6 mins read
A A
LAPD patrol car

Predictive policing technology developed by the Los Angeles Police Department has been licensed by more than 50 agencies, but questions remain about its effectiveness. Photo courtesy of John Liu

Share on FacebookShare on TwitterLinkedInEmail
Predictive policing software is being used by law enforcement agencies nationwide, yet a review suggests that almost none of its users, past or present, have clear ways to measure the effectiveness or accuracy of the tool, a lack of oversight many researchers consider irresponsible.

“I remember the only heads up I really got about PredPol was from my chief coming to our briefing and telling us, ‘We have this great new tool. We’re going to support it. It’s PredPol, and it’s going to reduce crime,’” said Captain Brian Bubar of the San Pablo Police Department, whose 2.4 square-mile California town has fewer than 40,000 people.

Bubar was a San Pablo patrol officer when the department acquired the program in 2013; the department’s subscription ended on July 31, 2015. PredPol, one of the first predictive systems, was created by Los Angeles Police Department and University of California, Los Angeles, and it has been used in dozens of departments now, employing law enforcement data from the previous days and months to generate recommended areas for patrolling.

RelatedInsights

Cities that want to attract business might want to focus less on financial incentives and more on making people feel safe

Lessons from the Bourbon Street truck attack

Soda taxes can become a sticky mess

Documentary: A Tale of Three Cities

MuckRock has submitted requests to more than 50 agencies known to have used the technology, asking for information on their predictive policing training and use. Of those that have responded, a few have been able to send their contracts, input data, scientific papers written by PredPol’s makers, annual mayoral presentations, and even some training materials, but none have been able to provide validation studies.

“I was never able to explain how it was identifying these boxes, how it was telling us to get to these points, which I think was a huge component [of its failure], because it did not give an opportunity to give the system validity to the officers,” said Bubar. “And that could happen in a department our size. At the time, we didn’t have a dedicated IT infrastructure. We didn’t have a committee to learn how to incorporate our training staff, incorporate the sergeants, to educate them on these new systems, who were able to get the buy-in from the staff to give it a chance. It was just kind of delivered in our laps, and we were told to use it.”

Using data generated by unfair or questionable policing strategies to train a computer system can simply result in automation of that bias.

Though it is sold as “crime prediction” and officer allocation tools for under-resourced agencies, one of the reasons predictive policing tools are so controversial is the contention that they are built on and reinforce racial bias. Using data generated by unfair or questionable policing strategies to train a computer system can simply result in automation of that bias.

“You have to understand that every bias that goes into an instrument’s development is going to be manifest in the tool’s ability. It’s a great concept, but it doesn’t recognize that human behavior is negatively impacted when we use algorithms to predict it. You look at the research: blacks are twice as likely as whites to be targeted for certain behaviors when those behaviors are evenly distributed,” said Howard Henderson, founding director of the Center for Justice Research at Texas Southern University. “You can’t adopt an instrument without validating. That’s unacceptable.”

A report from the AI Now Institute found that some police departments cited by the Department of Justice for unfair policing practices use data from those eras to inform predictive policing systems.

“These tools are not sufficiently well-tested. They’re biased premises that, in some cases, are faulty. They’re based on a process of learning that I think are misapplied. And in the case of person-based predictive policing, they’re based on assumptions and structures that we’ve already seen have huge numbers of problems. I don’t see any reason to keep using them until we know, what is it exactly that they’re trying to do,” said Suresh Venkatasubramanian, professor at the University of Utah.

Many academics argue that, as they’re currently built and used, predictive policing systems shouldn’t be employed by police at all. In early October, more than 400 academics signed onto a letter to the LAPD Commission challenging claims that scholarship supports use of the tool.

“We keep telling ourselves, ‘We’re not stupid. We know correlation does not equal causation.’ But we’re going to use it anyway,” Venkatasubramanian said. “Why are you going to use it anyway?”

In addition to the concerns around encoding biased policies into police equipment, local validation and accuracy checks are important for seeing whether a system can realistically help an agency. Multiple police departments have said they stopped using PredPol because it simply did not work for them, suggesting areas they already knew to be problematic or not offering suggestions that could work with the existing demand created by daily urgent needs for service.

“It became almost offensive to patrol officers when the city commits funding to a new analytical tool that’s supposed to reduce crime. We need to be out in high visibility,” Bubar explained. “These were things that we were already identifying.”

Changes to standard procedure

LAPD, one of the longest users of PredPol, announced only last month that it would begin measuring the effectiveness of its data-driven policing techniques—nearly eight years after it started using them. An April report from the LAPD’s Inspector General found the department needs a lot of improvement around how it captures data and evaluates the fairness of the tool’s application. At a meeting in mid-October of the Los Angeles Police Commission, representatives from the LAPD acknowledged the shortcomings.

To address them, the department will be creating a data-driven policing unit and a reference manual detailing how it is used.

Dozens of other departments still use similar technology, but community pressure is starting to limit deployments.

“I think that’s where the change has occurred. LA and Philly are places where you can see good examples of this, but that’s because of the enterprising nature of the local community that they were able to do this,” said Venkatasubramanian. “To expect or require communities to be the source of pushback is unfair, although, yes, that’s probably the only way it’s going to happen.”

One point at which oversight might be implemented is during the initial procurement or subsequent justification meetings with city councils.

The use of a tool making predictions or decisions about force deployment is akin to implementing a policy stance, says Deirdre K. Mulligan, faculty director of the Berkeley Center for Law and Technology, and as with any policy enacted by law enforcement, there needs to be thought and intention behind its adoption.

“When it comes to predicting crime the underlying data is so fraught that it seems it can’t do anything but play racism forward,” wrote Mulligan. “I’ve been focused on all the policies that are embedded in the ‘tools,’ and the need for agencies to understand that adopting a tool may be akin to adopting a policy and, therefore, requires expertise, reasoned decision making, and public participation. How do we make sure the public is informed and in control of key normative decisions when processes are offloaded to an algorithm?”

This work is licensed under a 

Tags: CaliforniaLos AngelesPredictive PolicingTechnology
Previous Post

New survey of mayors yields strong support for infrastructure, climate action

Next Post

Seeking a more worker-friendly economy, some cities, states push employee ownership

Beryl Lipton

Beryl Lipton

Beryl C.D. Lipton is a senior reporter with The MuckRock Foundation, which manages the day-to-day operations of numerous services in support of a transparent and participatory democracy. She is motivated by the inefficiencies that hinder a progressive democracy, and studied the History and Literature of America at Harvard College.

Explore More

  • Economic Prosperity
  • Criminal Justice and Public Safety
  • Transportation and Infrastructure
  • Education
  • Energy and Environment
  • Community, Growth and Housing
  • Clean, Open and Fair Government

Recent News

Why does American multifamily architecture look so banal?

Why does American multifamily architecture look so banal?

May 27, 2025
Powering progress or draining resources?

How data centers could quietly raise your electric bill

May 20, 2025
Everything is bigger in Texas, except parking mandates

Everything is bigger in Texas, except parking mandates

May 19, 2025
I study local government and Hurricane Helene forced me from my home − here’s how rural towns and counties in North Carolina and beyond cooperate to rebuild

I study local government and Hurricane Helene forced me from my home − here’s how rural towns and counties in North Carolina and beyond cooperate to rebuild

May 13, 2025
Load More
Facebook Twitter RSS
Better Cities Project

Better Cities Project helps people in America’s largest cities live free, happy lives. We uncover what works, promote solutions, and forge partnerships that turn ideas into results.



© 2023 Better Cities Project

Thanks to QuestionPro for providing us over 35 question types to choose from. The advanced question types help up collect deep insights.

Our Focus Areas

  • Economic Prosperity
  • Criminal Justice and Public Safety
  • Transportation and Infrastructure
  • Education
  • Energy and Environment
  • Community, Growth and Housing
  • Clean, Open and Fair Government

The Fine Print

  • Privacy Policy
  • Terms and Conditions
  • Reports and Financials

Recent News

Why does American multifamily architecture look so banal?

Why does American multifamily architecture look so banal?

May 27, 2025
Powering progress or draining resources?

How data centers could quietly raise your electric bill

May 20, 2025
Everything is bigger in Texas, except parking mandates

Everything is bigger in Texas, except parking mandates

May 19, 2025

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In

Add New Playlist

Love Cities? So Do We.

Get ahead of the curve -- learn about innovations, ideas and policies driving change in America's largest cities, with BCP in your inbox.



You have Successfully Subscribed!

No Result
View All Result
  • About Us
  • The Team
  • Work With Better Cities Project
  • Research and Projects
  • Latest Insights
  • Videos

© 2023 Better Cities Project