├── audits-from-paper.csv └── README.md /audits-from-paper.csv: -------------------------------------------------------------------------------- 1 | Title,Abbreviated Authors,Published Year,Publication,URL,Method,Domain,Organization,Behavior 2 | Detecting price and search discrimination on the internet,Mikians et al.,2012,HotNets,https://doi.org/10.1145/2390231.2390245,Sock puppets,Pricing,"Google 3 | Bing",Discrimination 4 | Crowd-assisted search for price discrimination in E-commerce: First results,Mikians et al.,2013,CoNEXT,https://doi.org/10.1145/2535372.2535415,Crowdsourcing,Pricing,"Amazon 5 | Hotels.com 6 | Other websites",Discrimination 7 | Discrimination in Online Ad Delivery,Sweeney,2013,Queue,https://doi.org/10.1145/2460276.2460278,Direct scrape,Advertising,Google,Discrimination 8 | Google search: Hyper-visibility as a means of rendering black women and girls invisible,Noble,2013,InVisible Culture,https://www.proquest.com/docview/1771536966,Direct scrape,Search,Google,Discrimination 9 | Measuring Price Discrimination and Steering on E-commerce Web Sites,Hannak et al.,2014,IMC,https://doi.org/10.1145/2663716.2663744,"Crowdsourcing 10 | Sock puppets",Pricing,"WalMart 11 | Expedia 12 | Orbitz",Discrimination 13 | Unequal Representation and Gender Stereotypes in Image Search Results for Occupations,Kay et al.,2015,CHI,https://doi.org/10.1145/2702123.2702520,Direct scrape,Search,Google,Discrimination 14 | An Empirical Analysis of Algorithmic Pricing on Amazon Marketplace,Chen et al.,2016,WWW,https://doi.org/10.1145/2872427.2883089,Direct scrape,Pricing,Amazon,Discrimination 15 | Bias in Online freelance marketplaces: Evidence from TaskRabbit and Fiverr,Hannak et al.,2017,CSCW,https://doi.org/10.1145/2998181.2998327,Direct scrape,Search,"TaskRabbit 16 | Fiverr",Discrimination 17 | Tracking gendered streams,Eriksson and Johansson,2017,Culture Unbound,https://doi.org/10.3384/cu.2000.1525.1792163,Sock puppets,Recommendation,Spotify,Discrimination 18 | An Empirical Study on Online Price Differentiation,Hupperich et al.,2018,CODASPY,https://doi.org/10.1145/3176258.3176338,Sock puppets,Pricing,"Booking.com 19 | Hotels.com 20 | Other websites",Discrimination 21 | Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification,Buolamwini and Gebru,2018,FAccT,http://proceedings.mlr.press/v81/buolamwini18a.html,Direct scrape,Vision,"Microsoft 22 | IBM 23 | Face++",Discrimination 24 | Investigating the impact of gender on rank in resume search engines,Chen et al.,2018,CHI,https://doi.org/10.1145/3173574.3174225,Direct scrape,Search,"Indeed 25 | Monster 26 | CareerBuilder",Discrimination 27 | Actionable auditing: Investigating the impact of publicly naming biased performance results of commercial AI products,Raji and Buolamwini,2019,AIES,https://doi.org/10.1145/3306618.3314244,Carrier puppet,Vision,"Amazon 28 | Kairos",Discrimination 29 | Algorithmic bias? An empirical study of apparent gender-based discrimination in the display of stem career ads,Lambrecht and Tucker,2019,Management Science,https://doi.org/10.1287/mnsc.2018.3093,Carrier puppet,Advertising,"Facebook 30 | Google AdWords 31 | Instagram 32 | Twitter",Discrimination 33 | Does Object Recognition Work for Everyone?,DeVries et al.,2019,CVPR,https://arxiv.org/abs/1906.02659,Direct scrape,Vision,"Microsoft 34 | Clarifai 35 | Google 36 | Amazon 37 | IBM",Discrimination 38 | Fairness in proprietary image tagging algorithms: A cross-platform audit on people images,Kyriakou et al.,2019,ICWSM,https://ojs.aaai.org/index.php/ICWSM/article/view/3232,Direct scrape,Vision,"Amazon 39 | Google 40 | IBM 41 | Microsoft 42 | Imagga 43 | Clarifai",Discrimination 44 | Fairness-aware ranking in search & recommendation systems with application to linkedin talent search,"Geyik, Ambler, and Kenthapadi",2019,KDD,https://doi.org/10.1145/3292500.3330691,Code,Search,LinkedIn,Discrimination 45 | Social B(eye)as: Human and machine descriptions of people images,Barlas et al.,2019,ICWSM,https://ojs.aaai.org/index.php/ICWSM/article/view/3255,Direct scrape,Vision,"Amazon 46 | Google 47 | IBM 48 | Microsoft 49 | Clarifai",Discrimination 50 | Why machine learning may lead to unfairness: Evidence from risk assessment for juvenile justice in Catalonia,Tolan et al.,2019,ICAIL,https://doi.org/10.1145/3322640.3326705,Code,Criminal Justice,"Catalonia, Spain",Discrimination 51 | Auditing Race and Gender Discrimination in Online Housing Market,Asplund et al.,2020,ICWSM,https://ojs.aaai.org/index.php/ICWSM/article/view/7276,Sock puppets,Advertising,Google,Discrimination 52 | The Risk of Racial Bias in Hate Speech Detection,Sap et al.,2020,ACL,https://doi.org/10.18653/v1/P19-1163,Direct scrape,Language Processing,Jigsaw (Google),Discrimination 53 | Measuring Personalization of Web Search,Hannak et al.,2013,WWW,https://doi.org/10.1145/2488388.2488435,"Crowdsourcing 54 | Sock puppets",Search,Google,Distortion 55 | "Location, Location, Location: The Impact of Geolocation on Web Search Personalization",Kliman-Silver et al.,2015,IMC,https://doi.org/10.1145/2815675.2815714,Sock puppets,Search,Google,Distortion 56 | MapWatch: Detecting and monitoring international border personalization on online maps,Soeller et al.,2016,WWW,https://doi.org/10.1145/2872427.2883016,Sock puppets,Mapping,Google,Distortion 57 | """Be careful; Things can be worse than they appear"" - Understanding biased algorithms and users' behavior around them in rating platforms",Eslami et al.,2017,ICWSM,https://ojs.aaai.org/index.php/ICWSM/article/view/14898,Direct scrape,Search,Booking.com,Distortion 58 | More of the same - On spotify radio,Snickars,2017,Culture Unbound,https://doi.org/10.3384/cu.2000.1525.1792,Sock puppets,Recommendation,Spotify,Distortion 59 | Quantifying search bias: Investigating sources of bias for political searches in social media,Kulshrestha et al.,2017,CSCW,https://doi.org/10.1145/2998181.2998321,Direct scrape,Search,"Twitter 60 | Google",Distortion 61 | Analyzing the news coverage of personalized newspapers,Chakraborty and Ganguly,2018,ASONAM,https://doi.org/10.1109/ASONAM.2018.8508812,Sock puppets,Recommendation,New York Times,Distortion 62 | Are We Exposed to the Same “News” in the News Feed?: An empirical analysis of filter bubbles as information similarity for Danish Facebook users,Bechmann and Nielbo,2018,Digital Journalism,https://doi.org/10.1080/21670811.2018.1510741,Crowdsourcing,Recommendation,Facebook,Distortion 63 | Auditing partisan audience bias within Google search,Robertson et al.,2018,CHI,https://doi.org/10.1145/3274417,Crowdsourcing,Search,Google,Distortion 64 | Beyond the bubble: Assessing the diversity of political search results,Puschmann,2018,Digital Journalism,https://doi.org/10.1080/21670811.2018.1539626,Crowdsourcing,Search,Google,Distortion 65 | Challenging Google Search filter bubbles in social and political information: Disconforming evidence from a digital methods case study,"Courtois, Slechten, and Coenen",2018,Telematics and Informatics,https://doi.org/10.1016/j.tele.2018.07.004,Crowdsourcing,Search,Google,Distortion 66 | Coding the News: The role of computer code in filtering and distributing news,Weber and Kosterich,2018,Digital Journalism,https://doi.org/10.1080/21670811.2017.1366865,Code,Recommendation,Not specified,Distortion 67 | From ranking algorithms to ‘ranking cultures’: Investigating the modulation of visibility in YouTube search results,"Rieder, Matamoros-Fernández, and Coromina",2018,Convergence,https://doi.org/10.1177/1354856517736982,Direct scrape,Search,YouTube,Distortion 68 | Investigating Ad Transparency Mechanisms in Social Media: A Case Study of Facebook's Explanations,Andreou et al.,2018,NDSS,https://dx.doi.org/10.14722/ndss.2018.23204,Crowdsourcing,Advertising,Facebook,Distortion 69 | Search bias quantification: investigating political bias in social media and web search,Kulshrestha et al.,2018,Information Retrieval Journal,https://doi.org/10.1007/s10791-018-9341-2,Direct scrape,Search,"Google 70 | Twitter",Distortion 71 | Ad Delivery Algorithms: The Hidden Arbiters of Political Messaging,Ali et al.,2019,Preprint,https://arxiv.org/abs/1912.04255,Carrier puppet,Advertising,Facebook,Distortion 72 | Auditing autocomplete: Suggestion networks and recursive algorithm interrogation,Robertson et al.,2019,WebSci,https://doi.org/10.1145/3292522.3326047,Direct scrape,Search,"Google 73 | Bing",Distortion 74 | Auditing the partisanship of Google search snippets,Hu et al.,2019,WWW,https://doi.org/10.1145/3308558.3313654,Direct scrape,Search,Google,Distortion 75 | Bias misperceived: The role of partisanship and misinformation in YouTube comment moderation,"Jiang, Robertson, and Wilson",2019,ICWSM,https://ojs.aaai.org/index.php/ICWSM/article/view/3229,Direct scrape,Language Processing,YouTube,Distortion 76 | Comparing Platform “Ranking Cultures” Across Languages: The Case of Islam on YouTube in Scandinavia,Moe,2019,Social Media and Society,https://doi.org/10.1177/2056305118817038,Direct scrape,Search,YouTube,Distortion 77 | "Dr. Google, what can you tell me about homeopathy? Comparative study of the top10 websites in the United States, United Kingdom, France, Mexico and Spain",Cano-Orón,2019,Information and Communication ,https://doi.org/10.3145/epi.2019.mar.13,Direct scrape,Search,Google,Distortion 78 | Opening Up the Black Box: Auditing Google’s Top Stories Algorithm,Lurie and Mustafaraj,2019,FLAIRS,https://par.nsf.gov/biblio/10101277,Direct scrape,Recommendation,Google,Distortion 79 | Search as news curator: The role of Google in shaping attention to news information,Trielli and Diakopoulos,2019,CHI,https://doi.org/10.1145/3290605.3300683,Direct scrape,Search,Google,Distortion 80 | Search media and elections: A longitudinal investigation of political search results in the 2018 U.S. Elections,Metaxa et al.,2019,CHI,https://doi.org/10.1145/3359231,Direct scrape,Search,Google,Distortion 81 | You Can’t See What You Can’t See: Experimental Evidence for How Much Relevant Information May Be Missed Due to Google’s Web Search Personalisation,Lai and Luczak-Roesch,2019,ICSI,https://doi.org/10.1007/978-3-030-34971-4_17,Crowdsourcing,Search,Google,Distortion 82 | Auditing local news presence on Google News,Fischer et al.,2020,Nature Human Behavior,https://doi.org/10.1038/s41562-020-00954-0,Direct scrape,Search,Google,Distortion 83 | Auditing News Curation Systems: A Case Study Examining Algorithmic and Editorial Logic in Apple News,Bandy and Diakopoulos,2020,ICWSM,https://ojs.aaai.org/index.php/ICWSM/article/view/7277,"Direct scrape 84 | Crowdsourcing",Recommendation,Apple,Distortion 85 | Auditing radicalization pathways on YouTube,Ribeiro et al.,2020,FAccT,https://doi.org/10.1145/3351095.3372879,Direct scrape,Recommendation,YouTube,Distortion 86 | Measuring Misinformation in Video Search Platforms: An Audit Study on YouTube,Hussein et al.,2020,CHI,https://doi.org/10.1145/3392854,Sock puppets,Search,YouTube,Distortion 87 | Automated Experiments on Ad Privacy Settings,Datta et al.,2015,Privacy Enhancing Technologies,https://doi.org/10.1515/popets-2015-0007,Sock puppets,Advertising,Google,Exploitation 88 | Studying ad targeting with digital methods: The case of spotify,Mahler and Vonderau,2017,Culture Unbound,https://doi.org/10.3384/cu.2000.1525.1792212,Direct scrape,Advertising,Spotify,Exploitation 89 | The Substantial Interdependence of Wikipedia and Google: A Case Study on the Relationship Between Peer Production Communities and Information Technologies,"McMahon, Johnson, and Hecht",2017,ICWSM,https://ojs.aaai.org/index.php/ICWSM/article/view/14883,Crowdsourcing,Search,Google,Exploitation 90 | Unveiling and Quantifying Facebook Exploitation of Sensitive Personal Data for Advertising Purposes,"Cabanas, Cuevas, and Cuevas",2018,USENIX Security,https://dl.acm.org/doi/abs/10.5555/3277203.3277240,Crowdsourcing,Advertising,Facebook,Exploitation 91 | Measuring the Importance of User-Generated Content to Search Engines,Vincent et al.,2019,ICWSM,https://ojs.aaai.org/index.php/ICWSM/article/view/3248,Direct scrape,Search,Google,Exploitation 92 | Out With the Old and in With the New? An Empirical Comparison of Supervised Learning Algorithms to Predict Recidivism,Duwe and Kim,2017,Criminal Justice Policy Review,https://doi.org/10.1177%2F0887403415604899,Direct scrape,Criminal Justice,Minnesota,Misjudgement 93 | The Accuracy of the Demographic Inferences Shown on Google's Ad Settings,Tschantz et al.,2018,WPES,https://doi.org/10.1145/3267323.3268962,Crowdsourcing,Advertising,Google,Misjudgement 94 | Auditing Offline Data Brokers via Facebook's Advertising Platform,Venkatadri,2019,WWW,https://doi.org/10.1145/3308558.3313666,Crowdsourcing,Advertising,"Facebook 95 | Acxiom 96 | Epsiolon 97 | Experian 98 | Oracle (Datalogix)",Misjudgement 99 | Better Practices in the Development and Validation of Recidivism Risk Assessments: The Minnesota Sex Offender Screening Tool–4,Duwe,2019,Criminal Justice Policy Review,https://doi.org/10.1177%2F0887403417718608,Direct scrape,Criminal Justice,Minnesota,Misjudgement 100 | Quantity vs. Quality: Evaluating User Interest Profiles Using Ad Preference Managers,Bashir et al.,2019,NDSS,https://doi.org/10.14722/ndss.2019.23392,Crowdsourcing,Advertising,"Google 101 | Facebook 102 | Oracle 103 | Neilsen",Misjudgement 104 | The right to confront your accusers: Opening the black box of forensic DNA software,Matthews et al.,2019,AIES,https://doi.org/10.1145/3306618.3314279,Code,Criminal Justice,New York City,Misjudgement 105 | Facebook Ads Monitor: An Independent Auditing System for Political Ads on Facebook,Silva et al.,2020,WWW,https://doi.org/10.1145/3366423.3380109,Crowdsourcing,Advertising,Facebook,Misjudgement -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # List of Algorithm Audits 2 | A continually-updated list of studies from the CSCW 2021 paper, "[Problematic Machine Behavior: A Systematic Literature Review of Algorithm Audits](https://arxiv.org/abs/2102.04256)" 3 | 4 | Repository is a work-in-progress, open to the community for edits. 5 | 6 | To add a study, simply create an issue or pull request. 7 | 8 | ## Definitions 9 | 10 | **Algorithm Audit:** an empirical study investigating a public algorithmic system for potential problematic behavior. 11 | * **empirical study**: includes an experiment or analysis (quantitative or qualitative) that generates evidence-based claims with well-defined outcome metrics. It must not be purely an opinion/position paper, although position papers with substantial empirical components were included 12 | * **algorithmic system**: is any socio-technical system influenced by at least one algorithm. This includes systems that may rely on human judgement and/or other non-algorithmic components, as long as they include at least one algorithm. 13 | * **public**: algorithmic system is one used in a commercial context or other public setting such as law enforcement, education, criminal punishment, or public transportation 14 | * **problematic behavior**: in this study refers to discrimination, distortion, exploitation, or mis- judgement, as well as various types of behaviors within each of these categories. A behavior is problematic when it causes harm (or potential harm). In the ACM Code of Ethics, examples of harm include "unjustified physical or mental injury, unjustified destruction or disclosure of information, and unjustified damage to property, reputation, and the environment." 15 | 16 | 17 | 18 | ## Studies 19 | 20 | ### Discrimination 21 | The algorithm disparately treats or disparately impacts people on the basis of their race, age, gender, location, socioeconomic status, and/or intersectional identity. For example, an algorithm implicated in discrimination may systematically favor people who identify as males, or reinforce harmful stereotypes about elderly people. 22 | #### Pricing 23 | * [Detecting price and search discrimination on the internet](https://doi.org/10.1145/2390231.2390245) (Mikians et al., 2012) 24 | * [Crowd-assisted search for price discrimination in E-commerce: First results](https://doi.org/10.1145/2535372.2535415) (Mikians et al., 2013) 25 | * [Measuring Price Discrimination and Steering on E-commerce Web Sites](https://doi.org/10.1145/2663716.2663744) (Hannak et al., 2014) 26 | * [An Empirical Analysis of Algorithmic Pricing on Amazon Marketplace](https://doi.org/10.1145/2872427.2883089) (Chen et al., 2016) 27 | * [An Empirical Study on Online Price Differentiation](https://doi.org/10.1145/3176258.3176338) (Hupperich et al., 2018) 28 | #### Advertising 29 | * [Discrimination in Online Ad Delivery](https://doi.org/10.1145/2460276.2460278) (Sweeney, 2013) 30 | * [Algorithmic bias? An empirical study of apparent gender-based discrimination in the display of stem career ads](https://doi.org/10.1287/mnsc.2018.3093) (Lambrecht and Tucker, 2019) 31 | * [Auditing Race and Gender Discrimination in Online Housing Market](https://ojs.aaai.org/index.php/ICWSM/article/view/7276) (Asplund et al., 2020) 32 | * [Auditing for Discrimination in Algorithms Delivering Job Ads](https://ant.isi.edu/datasets/addelivery/Discrimination-Job-Ad-Delivery.pdf) (Imana et al., 2021) 33 | #### Search 34 | * [Google search: Hyper-visibility as a means of rendering black women and girls invisible](https://www.proquest.com/docview/1771536966) (Noble, 2013) 35 | * [Unequal Representation and Gender Stereotypes in Image Search Results for Occupations](https://doi.org/10.1145/2702123.2702520) (Kay et al., 2015) 36 | * [Bias in Online freelance marketplaces: Evidence from TaskRabbit and Fiverr](https://doi.org/10.1145/2998181.2998327) (Hannak et al., 2017) 37 | * [Investigating the impact of gender on rank in resume search engines](https://doi.org/10.1145/3173574.3174225) (Chen et al., 2018) 38 | * [Fairness-aware ranking in search & recommendation systems with application to linkedin talent search](https://doi.org/10.1145/3292500.3330691) (Geyik, Ambler, and Kenthapadi, 2019) 39 | #### Recommendation 40 | * [Tracking gendered streams](https://doi.org/10.3384/cu.2000.1525.1792163) (Eriksson and Johansson, 2017) 41 | * [Building and Auditing Fair Algorithms: A Case Study in Candidate Screening](https://doi.org/10.1145/3442188.3445928) (Wilson et al., 2021) 42 | #### Computer Vision 43 | * [Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification](http://proceedings.mlr.press/v81/buolamwini18a.html) (Buolamwini and Gebru, 2018) 44 | * [Actionable auditing: Investigating the impact of publicly naming biased performance results of commercial AI products](https://doi.org/10.1145/3306618.3314244) (Raji and Buolamwini, 2019) 45 | * [Does Object Recognition Work for Everyone?](https://arxiv.org/abs/1906.02659) (DeVries et al., 2019) 46 | * [Fairness in proprietary image tagging algorithms: A cross-platform audit on people images](https://ojs.aaai.org/index.php/ICWSM/article/view/3232) (Kyriakou et al., 2019) 47 | * [Social B(eye)as: Human and machine descriptions of people images](https://ojs.aaai.org/index.php/ICWSM/article/view/3255) (Barlas et al., 2019) 48 | #### Criminal Punishment 49 | * [Why machine learning may lead to unfairness: Evidence from risk assessment for juvenile justice in Catalonia](https://doi.org/10.1145/3322640.3326705) (Tolan et al., 2019) 50 | #### Language Processing 51 | * [The Risk of Racial Bias in Hate Speech Detection](https://doi.org/10.18653/v1/P19-1163) (Sap et al., 2020) 52 | 53 | 54 | 55 | ### Distortion 56 | The algorithm presents media that distorts or obscures an underlying reality. For example, an algorithm implicated in distortion may favor content from a given political perspective, hyper-personalize output for different users, change its output frequently and without good reason, or provide misleading information to users. 57 | #### Search 58 | * [Measuring Personalization of Web Search](https://doi.org/10.1145/2488388.2488435) (Hannak et al., 2013) 59 | * [Location, Location, Location: The Impact of Geolocation on Web Search Personalization](https://doi.org/10.1145/2815675.2815714) (Kliman-Silver et al., 2015) 60 | * ["Be careful; Things can be worse than they appear" - Understanding biased algorithms and users' behavior around them in rating platforms](https://ojs.aaai.org/index.php/ICWSM/article/view/14898) (Eslami et al., 2017) 61 | * [Quantifying search bias: Investigating sources of bias for political searches in social media](https://doi.org/10.1145/2998181.2998321) (Kulshrestha et al., 2017) 62 | * [From ranking algorithms to ‘ranking cultures’: Investigating the modulation of visibility in YouTube search results](https://doi.org/10.1177/1354856517736982) (Rieder, Matamoros-Fernández, and Coromina, 2018) 63 | * [Challenging Google Search filter bubbles in social and political information: Disconforming evidence from a digital methods case study](https://doi.org/10.1016/j.tele.2018.07.004) (Courtois, Slechten, and Coenen, 2018) 64 | * [Search bias quantification: investigating political bias in social media and web search](https://doi.org/10.1007/s10791-018-9341-2) (Kulshrestha et al., 2018) 65 | * [Auditing partisan audience bias within Google search](https://doi.org/10.1145/3274417) (Robertson et al., 2018) 66 | * [Beyond the bubble: Assessing the diversity of political search results](https://doi.org/10.1080/21670811.2018.1539626) (Puschmann, 2018) 67 | * [You Can’t See What You Can’t See: Experimental Evidence for How Much Relevant Information May Be Missed Due to Google’s Web Search Personalisation](https://doi.org/10.1007/978-3-030-34971-4_17) (Lai and Luczak-Roesch, 2019) 68 | * [Search media and elections: A longitudinal investigation of political search results in the 2018 U.S. Elections](https://doi.org/10.1145/3359231) (Metaxa et al., 2019) 69 | * [Search as news curator: The role of Google in shaping attention to news information](https://doi.org/10.1145/3290605.3300683) (Trielli and Diakopoulos, 2019) 70 | * [Dr. Google, what can you tell me about homeopathy? Comparative study of the top10 websites in the United States, United Kingdom, France, Mexico and Spain](https://doi.org/10.3145/epi.2019.mar.13) (Cano-Orón, 2019) 71 | * [Comparing Platform “Ranking Cultures” Across Languages: The Case of Islam on YouTube in Scandinavia](https://doi.org/10.1177/2056305118817038) (Moe, 2019) 72 | * [Auditing the partisanship of Google search snippets](https://doi.org/10.1145/3308558.3313654) (Hu et al., 2019) 73 | * [Auditing autocomplete: Suggestion networks and recursive algorithm interrogation](https://doi.org/10.1145/3292522.3326047) (Robertson et al., 2019) 74 | * [Auditing local news presence on Google News](https://doi.org/10.1038/s41562-020-00954-0) (Fischer et al., 2020) 75 | * [Measuring Misinformation in Video Search Platforms: An Audit Study on YouTube](https://doi.org/10.1145/3392854) (Hussein et al., 2020) 76 | * [The Media Coverage of the 2020 US Presidential Election Candidates through the Lens of Google’s Top Stories](https://ojs.aaai.org/index.php/ICWSM/article/view/7352) (Kawakami et al., 2020) 77 | * [Auditing Source Diversity Bias in Video Search Results Using Virtual Agents](https://doi.org/10.1145/3442442.3452306) (Urman et al., 2021) 78 | #### Mapping 79 | * [MapWatch: Detecting and monitoring international border personalization on online maps](https://doi.org/10.1145/2872427.2883016) (Soeller et al., 2016) 80 | #### Recommendation 81 | * [More of the same - On spotify radio](https://doi.org/10.3384/cu.2000.1525.1792) (Snickars, 2017) 82 | * [Coding the News: The role of computer code in filtering and distributing news](https://doi.org/10.1080/21670811.2017.1366865) (Weber and Kosterich, 2018) 83 | * [Are We Exposed to the Same “News” in the News Feed?: An empirical analysis of filter bubbles as information similarity for Danish Facebook users](https://doi.org/10.1080/21670811.2018.1510741) (Bechmann and Nielbo, 2018) 84 | * [Analyzing the news coverage of personalized newspapers](https://doi.org/10.1109/ASONAM.2018.8508812) (Chakraborty and Ganguly, 2018) 85 | * [Opening Up the Black Box: Auditing Google’s Top Stories Algorithm](https://par.nsf.gov/biblio/10101277) (Lurie and Mustafaraj, 2019) 86 | * [Auditing radicalization pathways on YouTube](https://doi.org/10.1145/3351095.3372879) (Ribeiro et al., 2020) 87 | * [Auditing News Curation Systems: A Case Study Examining Algorithmic and Editorial Logic in Apple News](https://ojs.aaai.org/index.php/ICWSM/article/view/7277) (Bandy and Diakopoulos, 2020) 88 | * [Measuring Misinformation in Video Search Platforms: An Audit Study on YouTube](https://doi.org/10.1145/3392854) (Hussein and Juneja et al., 2020) 89 | * [When the Umpire is also a Player: Bias in Private Label Product Recommendations on E-commerce Marketplaces](https://doi.org/10.1145/3442188.3445944) (Dash et al., 2021) 90 | * [Auditing E-Commerce Platforms for Algorithmically Curated Vaccine Misinformation](https://doi.org/10.1145/3411764.3445250) (Juneja and Mitra, 2021) 91 | #### Advertising 92 | * [Investigating Ad Transparency Mechanisms in Social Media: A Case Study of Facebook's Explanations](https://dx.doi.org/10.14722/ndss.2018.23204) (Andreou et al., 2018) 93 | * [Ad Delivery Algorithms: The Hidden Arbiters of Political Messaging](https://arxiv.org/abs/1912.04255) (Ali et al., 2019) 94 | #### Language Processing 95 | * [Bias misperceived: The role of partisanship and misinformation in YouTube comment moderation](https://ojs.aaai.org/index.php/ICWSM/article/view/3229) (Jiang, Robertson, and Wilson, 2019) 96 | * [“I Can’t Reply with That”: Characterizing Problematic Email Reply Suggestions](https://doi.org/10.1145/3411764.3445557) (Robertson et al., 2021) 97 | ### Exploitation 98 | The algorithm inappropriately uses content from other sources and/or sensitive personal information from people. For example, an algorithm implicated in exploitation may infer sensitive personal information from users without proper consent, or feature content from an outside source without attribution. 99 | #### Advertising 100 | * [Automated Experiments on Ad Privacy Settings](https://doi.org/10.1515/popets-2015-0007) (Datta et al., 2015) 101 | * [Studying ad targeting with digital methods: The case of spotify](https://doi.org/10.3384/cu.2000.1525.1792212) (Mahler and Vonderau, 2017) 102 | * [Unveiling and Quantifying Facebook Exploitation of Sensitive Personal Data for Advertising Purposes](https://dl.acm.org/doi/abs/10.5555/3277203.3277240) (Cabanas, Cuevas, and Cuevas, 2018) 103 | #### Search 104 | * [The Substantial Interdependence of Wikipedia and Google: A Case Study on the Relationship Between Peer Production Communities and Information Technologies](https://ojs.aaai.org/index.php/ICWSM/article/view/14883) (McMahon, Johnson, and Hecht, 2017) 105 | * [Measuring the Importance of User-Generated Content to Search Engines](https://ojs.aaai.org/index.php/ICWSM/article/view/3248) (Vincent et al., 2019) 106 | 107 | 108 | 109 | ### Misjudgment 110 | The algorithm makes incorrect predictions or classifications. Notably, misjudgment can often lead to discrimination, distortion, and/or exploitation, but some studies in the review focused on this initial error of misjudgment without exploring second-order problematic effects. An algorithm implicated in misjudgment may incorrectly classify a user’s employment status or mislabel a piece of political news as being primarily about sports, for example. 111 | #### Criminal Punishment 112 | * [Out With the Old and in With the New? An Empirical Comparison of Supervised Learning Algorithms to Predict Recidivism](https://doi.org/10.1177%2F0887403415604899) (Duwe and Kim, 2017) 113 | * [Better Practices in the Development and Validation of Recidivism Risk Assessments: The Minnesota Sex Offender Screening Tool–4](https://doi.org/10.1177%2F0887403417718608) (Duwe, 2019) 114 | * [The right to confront your accusers: Opening the black box of forensic DNA software](https://doi.org/10.1145/3306618.3314279) (Matthews et al., 2019) 115 | #### Advertising 116 | * [The Accuracy of the Demographic Inferences Shown on Google's Ad Settings](https://doi.org/10.1145/3267323.3268962) (Tschantz et al., 2018) 117 | * [Auditing Offline Data Brokers via Facebook's Advertising Platform](https://doi.org/10.1145/3308558.3313666) (Venkatadri, 2019) 118 | * [Quantity vs. Quality: Evaluating User Interest Profiles Using Ad Preference Managers](https://doi.org/10.14722/ndss.2019.23392) (Bashir et al., 2019) 119 | * [Facebook Ads Monitor: An Independent Auditing System for Political Ads on Facebook](https://doi.org/10.1145/3366423.3380109) (Silva et al., 2020) 120 | --------------------------------------------------------------------------------