Question

Should the transparency of decision-making algorithms be extended to the public at large? (NB - this...

Should the transparency of decision-making algorithms be extended to the public at large?

(NB - this is an ETHICS questions and so needs to be discussed and justified in terms of the 4 ethical theories)

Homework Answers

Answer #1

Cities rely on algorithms to help make decisions that affect people’s lives in meaningful ways, from assessing teacher performance to predicting the likelihood of criminal re-offense. And yet, the general public knows almost nothing about how they work.

Take a recent example in New York City: The police department has begun using algorithms to help decide where to deploy officers across the city. In 2015, the New York Police Department performed a 45-day test of software company Azavea's HunchLab platform, which considers a variety of factors—from historic crime to proximity to bars and bus stops—to determine where crime is most likely to happen. In the coming years, the NYPD pursued similar tests with a number of other companies, and while the department did not deploy any one of these tools, it drew insights from these trials in order to into design its own predictive policing platform.

The purpose of data-driven algorithms like this one is to make policing more objective and less subject to individual bias. But many worry that the biases are simply baked into the algorithms themselves. Some opponents have argued that policing algorithms will disproportionately target areas with more people of color and low-income residents because they reinforce old stereotypes: Data on patterns of past arrest rates, for example, might cause an algorithm to target low-income neighborhoods where officers were historically more likely to pick up black kids for possession. Others dispute whether or not the program is effective. A study by the RAND Corporation of a similar predictive policing program in Shreveport, Louisiana, found no measurable effect on crime.

Even if these algorithms do improve policing, mistrust will continue so long as public information is lacking. Despite a recent lawsuit by NYU’s Brennan Center for Justice that required the NYPD to release parts of its correspondence with Azavea and two other companies, the public knows little about how New York’s current predictive policing works, whether it uses tainted data, or is effective at reducing crime. As it stands, residents, advocates, and researchers have little ability to evaluate these tools to determine whether they are accurate or fair. Even City Council members have struggled to understand how their own precincts make staffing decisions.

Granted, some opacity around algorithms is inevitable. Some algorithms are too complex to be communicated in a simple and satisfying way, source code is often the proprietary secret of private companies, and releasing detailed information can pose cybersecurity risks.

These caveats make algorithmic transparency tricky, but it’s worth figuring out. Governments need mechanisms for making sure algorithms are subject to the same scrutiny as other types of public decision-making. This transparency should be proactive, rather than requiring years of legal action as in the Azavea case.

This past summer, New York City Councilman James Vacca proposed a bill that was one of the first attempts to address this issue. The proposal opened a spirited debate in the city over algorithmic transparency, drawing testimony from academics and advocates eager to see radical transparency, local tech companies urging the city to remain conscious of interests in the private sector, and public leaders looking to ensure both accountability and security for algorithms. The city ultimately landed on a compromise proposal, which creates an expert task force to develop transparency recommendations for the mayor.

This bill was a good opening salvo, but now comes the more difficult task: actually developing these mechanisms for transparency. If implemented in the right way, efforts towards transparency can actually benefit cities and vendors by maximizing the value and reach of analytics work. There are a few basic requirements the task force should consider:

  • Share the motivation for using an algorithm. When a city communicates its goal—for example, predicting when and where crime will happen—residents can assess intentions, and government has a benchmark for evaluating results.
  • Explain what data went into the model and why. Revealing sources gives residents the opportunity to identify potential bias from data tainted by historically discriminatory practices.
  • Describe how developers analyzed the data. Different from publishing source code—which is both potentially dangerous and unhelpful to most residents—a description of process includes information that allows the public to understand how developers get from data to an output. For example, the New York Mayor’s Office of Data Analytics (MODA) explained that it used a Monte Carlo technique to optimize funding for a school lunch program, and outlined the steps involved in this process.
  • Publish performance data. Governments should release any performance evaluations provided to them by vendors, and publish their own data on success achieving policy goals initially communicated.

Regulators need to be careful that these requirements do not place so large a burden on cities that they would eschew data-driven strategies in favor of old-fashioned intuitive decision-making. But the creators of algorithms already have these conversations in private, so fulfilling these reporting mandates is really a matter of better documenting processes that are already happening.

Disclosing more information about algorithms is not only valuable from an ethical standpoint, but also benefits cities by expanding the reach and value of data analytics work. By making analytics processes publicly available, cities allow other agencies to find inspiration and insight to pursue similar projects, as well as criticize and improve existing efforts. Increased reliance on data and evidence, and increased transparency, are movements that can and should support each other as cities continue to push towards a tech-driven future.

Know the answer?
Your Answer:

Post as a guest

Your Name:

What's your source?

Earn Coins

Coins can be redeemed for fabulous gifts.

Not the answer you're looking for?
Ask your own homework help question
Similar Questions
Business Ethics: Ethical Decision Making and Cases. Chapter 10 Globalization of Ethical Decision-Making : Table 10-6...
Business Ethics: Ethical Decision Making and Cases. Chapter 10 Globalization of Ethical Decision-Making : Table 10-6 list Global Principles for Ethical Business Conduct! What's missing, redundant, can be added or deleted from this list? Why? TABLE 10–6 Global Principles for Ethical Business Conduct Source: Global principles are integrity statements about foundational beliefs that should remain constant as businesses operate globally. These principles address issues such as accountability, transparency, trust, natural environment, safety, treatment of employees, human rights, importance of property...
Show in writing which components of the Conceptual Framework listed below apply in decision-making of listed...
Show in writing which components of the Conceptual Framework listed below apply in decision-making of listed scenario. Identify the authors, theories, and models that may apply to decision-making. Questions 3 (a & b) • The work climate has proven to be an effective measuring stick to successful performance. 3 A: Tell what effective organizational leaders can do to ensure the work climate is conducive to safety, crisis management, product improvement, professional development, and overall productivity. 3 B: Tell what process...
Scenarios For all scenarios, assume you are employed by Best Computer Systems, a large computer manufacturing...
Scenarios For all scenarios, assume you are employed by Best Computer Systems, a large computer manufacturing company with approximately 1000 employees. The company is located in a large metropolitan area. CASE 1: Lorna is an administrative assistant in the Human Resources Department. Her good friend, Bill, is applying for a job with the company and she has agreed to serve as a reference for him. Bill approaches her for advice on preparing for the interview. Lorna has the actual interview...
Ethical decision Essay Assignment    Susan is a CPA and she works for DEKP, a global...
Ethical decision Essay Assignment    Susan is a CPA and she works for DEKP, a global audit firm. She is a third-year associate on the audit team for Wilks International. Wilks is a U.S. public firm that runs clothing manufacturing facilities in South America and imports and distributes the goods through catalog and retail outlets. Susan has earned some seniority and she oversees two first-years in testing the trade payables from the South American operations. One of her new direct...
1.According to the concept of comparative​ advantage, a good should be produced in that nation in...
1.According to the concept of comparative​ advantage, a good should be produced in that nation in which A. domestic opportunity cost is greatest. B.terms of trade are maximized. C.money is used. D. domestic opportunity cost is the smallest. 2. What is the type of mechanism that answers the basic economic questions through a decentralized decision making​ process? A.market system B.command and control C.dictatorship D.mixed economic system 3. The impact of an increase in the gasoline tax on SUV sales is...
(3)       A Breakeven Analysis is a powerful management tool, and one that is critical in planning, decision-making,...
(3)       A Breakeven Analysis is a powerful management tool, and one that is critical in planning, decision-making, and expense control. It can be invaluable in determining whether to buy or lease, expand into a new area, build a new plant, and many other such considerations.            T                F (4)       According to the segmentation process, a market segment should be: a.Measurable. b.Differentiable. c.Accessible. d.Substantial. e.ALL OF THE ABOVE. f.NONE OF THE ABOVE. (5)       What specifically is a break-even analysis and...
QUESTION 1 A code of ethics ________________________________. should be standardized across companies following the AMA guidelines...
QUESTION 1 A code of ethics ________________________________. should be standardized across companies following the AMA guidelines is only necessary for large corporations needs to be vague so that it could be used to understand any potential situation should specify expected behavior in as many potential situations as possible may be more effective in guiding employee behavior than external governmental regulation 1 points   QUESTION 2 For most foods products that are imported into the US from the European Union, companies have...
Repackaging a Global Brand: A Case Study Analyzing the Capital Expenditure Decision INTRODUCTION It is early...
Repackaging a Global Brand: A Case Study Analyzing the Capital Expenditure Decision INTRODUCTION It is early 2014. A leading global skincare manufacturer, Health & Beauty Co. (HBC), has been losing market share in the hand and body lotion market. While the firm still leads its competitors in market share in this segment of personal care, it seeks to stem further share erosion and, to that end, has recently developed a strategy to recover market share through rebranding, advertising, and repackaging....
Assignment: What are the main arguments in the article? Please answer within 5 hours. It is...
Assignment: What are the main arguments in the article? Please answer within 5 hours. It is extremely urgent!!!!!!!!!!!!!!!!!!!!!!!! --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- BIOETHICS. Bioethics as a field is relatively new, emerging only in the late 1960s, though many of the questions it addresses are as old as medicine itself. When Hippocrates wrote his now famous dictum Primum non nocere (First, do no harm), he was grappling with one of the core issues still facing human medicine, namely, the role and duty of the...
What topics are covered in the following article? Please answer within 5 hours. It is extremely...
What topics are covered in the following article? Please answer within 5 hours. It is extremely urgent!!!!!!!!!!!!!!!!!!!!!!!! --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- BIOETHICS. Bioethics as a field is relatively new, emerging only in the late 1960s, though many of the questions it addresses are as old as medicine itself. When Hippocrates wrote his now famous dictum Primum non nocere (First, do no harm), he was grappling with one of the core issues still facing human medicine, namely, the role and duty of the physician....