Beyond the Direct: Can Randomized Controlled Trials Decode Systemic Racial Discrimination?

October 2026 | Economic Research Briefing

For decades, the Randomized Controlled Trial (RCT) has stood as the "gold standard" of evidence-based policy. By isolating variables and randomly assigning participants to treatment or control groups, economists and social scientists have successfully unmasked direct, interpersonal racial discrimination in housing, hiring, and lending. However, a new working paper (NBER Working Paper 35882) authored by prominent researchers poses a provocative, foundational question: Can the precision of an RCT effectively capture the sprawling, often invisible architecture of systemic racial discrimination?

The paper, released in October 2026, marks a significant pivot in the methodology of social science, suggesting that while RCTs are potent tools for measuring individual bias, they may require a radical reimagining to tackle the structural inequities that define systemic racism.

The Core Challenge: Defining the Invisible

To understand the utility of an RCT, one must first define the problem it aims to solve. Direct discrimination is often defined as an actor treating individuals differently based on race, regardless of merit. Systemic discrimination, by contrast, refers to the cumulative, institutionalized, and often unintentional processes that produce disparate outcomes across racial groups.

The NBER working paper proposes a conceptual model that bridges the gap between sociological definitions of systemic racism and the rigorous requirements of econometric testing. The authors argue that systemic discrimination is not merely the sum of individual bad actors; it is the environment itself—a complex set of feedback loops, historical precedents, and institutional norms that function independently of any single person’s intent.

The fundamental tension identified in the paper is one of scale and scope. RCTs excel at measuring the "treatment effect" of a specific, localized intervention. Systemic racism, however, is a "background condition"—it is the water in which the subjects swim. Measuring its impact through traditional trials presents an enormous technical hurdle: how do you randomize an entire system?

Chronology: The Evolution of Discrimination Research

The methodology of studying racial disparity has undergone three distinct phases over the last half-century:

• Phase I: Observational Analysis (1970s–1990s): Researchers relied heavily on regression analyses of large-scale datasets, such as census records or credit reporting data, to identify "unexplained" gaps in income and wealth that correlated with race. While informative, these studies struggled to definitively isolate discrimination from other confounding variables.
• Phase II: The RCT Revolution (2000s–2020s): Led by field experiments—most notably resume-audit studies where names typically associated with specific racial groups were swapped on otherwise identical resumes—this era proved that individual-level discrimination was not only prevalent but quantifiable. These studies forced a national conversation on implicit bias.
• Phase III: The Systemic Turn (2026–Present): The current shift, exemplified by Working Paper 35882, acknowledges that while audit studies successfully identified that discrimination occurs, they have done little to dismantle the systems that sustain it. This new research agenda seeks to integrate systemic theory into the experimental framework.

Methodological Pathways: Seven Strategies for Systemic RCTs

The authors of the paper outline seven distinct pathways through which RCTs could be repurposed to investigate systemic forces. Each represents a departure from standard practice:

1. Large-Scale Manipulations

Can we manipulate systemic forces on a massive scale? The authors concede this is the most difficult approach. It would involve altering institutional rules—such as changing hiring algorithms or credit-scoring models—at the level of an entire firm or municipality and measuring the resultant shift in outcomes.

2. Smaller Scale Approaches

Rather than targeting the whole system, researchers could target "nodal" points—specific points of decision-making within a system where systemic bias is likely to aggregate. By isolating these nodes, researchers can perform micro-experiments that reveal how systemic pressure influences local outcomes.

3. Cross-Structural Comparative Studies

By conducting identical RCTs across different structural settings (e.g., comparing banking practices in states with different regulatory histories), researchers can begin to isolate the impact of the structural environment itself as an independent variable.

4. Manipulating the Salience of Systemic Forces

If subjects are made aware of systemic bias within their environment, does their behavior change? By experimentally increasing or decreasing the "salience" of systemic constraints, researchers can observe how institutional pressure alters human decision-making.

5. The Role of Information

Does better data reduce systemic discrimination? The paper explores whether providing institutional actors with "de-biased" information—or data highlighting systemic gaps—can serve as a successful intervention, effectively acting as a counter-weight to entrenched structural tendencies.

6. The Salience of Racial Identity

This strategy investigates whether systemic discrimination relies on the activation of racial identity. By manipulating how, when, and why racial identity becomes a factor in institutional processes, researchers can test whether systemic bias is an automatic byproduct of institutional design or a choice facilitated by identity markers.

7. Strategic Responses

Finally, the paper suggests studying how marginalized groups navigate systemic discrimination. By observing the strategic responses of individuals living within these systems, researchers can uncover the "hidden costs" of systemic racism that are often overlooked in standard outcome-based metrics.

Supporting Data and Technical Limitations

While the proposed pathways are theoretically sound, the authors are candid about the "gaps" that RCTs inevitably leave behind. RCTs are inherently reductive. They operate best when variables are discrete and manageable. Systemic racism, however, is characterized by path dependence, multi-generational impacts, and "wicked" feedback loops that are not easily contained within a single study.

The authors note that in instances where an RCT cannot be conducted—due to ethical, financial, or logistical constraints—researchers must pivot to alternative methodologies. These include:

• Agent-Based Modeling (ABM): Using computational simulations to model how individual interactions lead to macro-level systemic patterns.
• Natural Experiments: Leveraging policy shifts or "shocks" (such as a sudden change in local legislation) that act as an accidental, large-scale experiment.
• Ethnographic Integration: Combining quantitative experimental data with qualitative insights to provide context for why specific systemic patterns persist.

Official Responses and Implications

The release of this paper has ignited a quiet firestorm within the economics community. Critics argue that the RCT is fundamentally unsuited for studying systemic issues because it is built on the philosophy of individual agency, whereas systemic racism is, by definition, the constraint of that agency.

"The danger," noted one senior economist at an NBER roundtable, "is that we try to force a systemic problem into a methodological box that wasn’t built for it. We might end up with very precise, very narrow results that miss the forest for the trees."

Conversely, supporters argue that the "Systemic Turn" is the necessary maturation of the field. Without the rigor of the RCT, systemic discussions often devolve into abstract philosophy. If the NBER’s proposed model can provide even a modest, empirically backed understanding of how systemic forces operate, it could provide policymakers with the "surgical" tools needed to dismantle institutional bias effectively.

The Policy Outlook

The implications for public policy are profound. If systemic discrimination can be measured with any degree of accuracy, it shifts the legal and social burden from proving "intent" to proving "disparate impact." This has direct consequences for the enforcement of the Civil Rights Act, fair housing laws, and equal opportunity employment standards.

For corporate and government institutions, the paper suggests that the future of diversity, equity, and inclusion (DEI) initiatives will likely move away from general awareness training toward evidence-based structural interventions—such as algorithmic auditing and institutional rule-design—that have been validated by rigorous, albeit complex, experimental testing.

Conclusion: A New Frontier for Social Science

As we move into the latter half of the 2020s, the marriage of experimental economics and sociological theory is becoming increasingly essential. Working Paper 35882 does not claim to have solved the puzzle of systemic racism; rather, it provides a map for the next generation of researchers.

The challenge ahead is twofold: maintaining the necessary scientific rigor while embracing the messiness of structural reality. Whether RCTs can ultimately decode the systemic nature of racial discrimination remains to be seen, but the attempt alone represents a vital evolution in how we use the tools of modern science to build a more equitable society. The search for evidence-based solutions to systemic issues is no longer a peripheral concern; it is the central frontier of modern social research.