Full text
Citation: J. Gil-Hernández, Carlos, Irene Pa ˜ n eda-Fernández, Leire Salazar, Jonatan Casta ˜ n o Mu ˜ n oz, 2024. “Teacher Bias in Assessments by Student Ascribed Status: A Factorial Experiment on Discrimination in Education” Sociological Science 11: 743-776. Received: January 6, 2024 Accepted: July 9, 2024 Published: August 27, 2024 Editor(s): Ari Adut, Stephen Vaisey DOI: 10.15195/v11.a27 Copyright: ©2024 The Author(s). This open-access article has been published under a Creative Commons Attribution License, which allows unrestricted use, distribution and reproduction, in any form, as long as the original author and source have been credited. cb Teacher Bias in Assessments by Student Ascribed Status: A Factorial Experiment on Discrimination in Education Carlos J. Gil-Hernández,aIrene Pa˜ neda-Fernández,bLeire Salazar,c Jonatan Casta˜ no Mu˜ nozd a) University of Florence; b) WZB Berlin Social Science Center; c) Consejo Superior de Investigaciones Científicas; d) Universidad de Sevilla Abstract: Teachers are the evaluators of academic merit. Identifying if their assessments are fair or biased by student-ascribed status is critical for equal opportunity but empirically challenging, with mixed previous findings. We test status characteristics beliefs,statistical discrimination, and cultural capital theories with a pre-registered factorial experiment on a large sample of Spanish pre-service teachers (n = 1,717). This design causally identifies, net of ability, the impact of student-ascribed characteristics on teacher short- and long-term assessments, improving prior studies’ theory testing, confounding, and power. Findings unveil teacher bias in an essay grading task favoring girls and highbrow cultural capital, aligning with status characteristics and cultural capital theories. Results on teachers’ long-term expectations indicate statistical discrimination against boys, migrant origin, and working-class students under uncertain information. Unexpectedly, ethnic discrimination changes from teachers favoring native origin in long-term expectations to migrant origin in short-term evaluations, suggesting compensatory grading. We discuss the complex roots of discrimination in teacher assessments as an educational (in)equality mechanism. Keywords: Discrimination; Teacher bias; Assessments; Educational inequality; Factorial experiment; Cultural Capital Replication Package: Data and replication code are publicly accessible at the GitHub repository: https://zenodo.org/doi/10.5281/zenodo.12666534 . The hypotheses and research design were publicly pre-registered with a pre-analysis plan (PAP) before data collection and analysis at the Open Science Foundation repository: https://doi.org/10.17605/OSF. IO/DZB3S. STUDENTS ’ ascribed characteristics persistently shape educational inequalities. Pupils from high socioeconomic status (SES) (Chmielewski 2019), non-migrant backgrounds (Heath and Brinbaum 2007), and girls (DiPrete and Buchmann 2013) systematically excel at school. The role of families and school context (Downey and Condron 2016) has been extensively scrutinized to explain achievement gaps by student-ascribed status (Skopek and Passaretta 2021). Teachers’ attitudes and characteristics (Jennings and DiPrete 2010), however, received less attention despite documented disparities between their assessments and students’ scores in blind standardized tests (Südkamp, Kaiser, and Möller 2012)—a residual approach assumed as evidence of teacher bias. 743
Gil-Hernández et al. Teacher Bias in Assessments Teachers are the primary evaluators of academic merit in the educational system (Bourdieu and Passeron 1990). However, identifying their role in reproducing or mitigating educational inequalities via assessments is empirically challenging (Jæger 2022). Like any human being, teachers are susceptible to implicit and explicit biases in their cognition, attitudes and stereotypes about students, potentially leading to discriminatory evaluations (Fazio et al. 2023). Such biased assumptions may breed self-fulfilling prophecies impeding student progress (Carlana 2019) because teachers’ inputs are the main signals for families to navigate the educational system (Holm, Hjorth-Trolle, and Jæger 2019). Therefore, understanding if teachers’ assessment practices are fair is crucial to ensuring equal educational opportunity. Net of performance in test scores, observational research identified a residual association, interpreted as teacher bias, between students’ ascribed characteristics, grading (Schuessler and Sønderskov 2023), expectations (Timmermans, Kuyper, and van der Werf 2015), and recommendations (Batruch et al. 2023; Salza 2022; Timmermans et al. 2018). On average, students who are girls (Marcenaro-Gutiérrez and Vignoles 2015), from native origin (Kisfalusi, Janky and Takács 2021), high-SES families (Gortázar, Martínez de Lafuente, and Vega-Bayo 2022), or display high cultural capital (Jæger and Møllegaard 2017) tend to be more positively evaluated at school. 1 Likewise, emerging behavioral (Carlana, La Ferrera, and Pinotti 2022) and experimental studies (Zanga and De Gioannis 2023) document that teacher assessments are influenced by student-ascribed features, like gender and ethnicity (Lorenz et al. 2024). Despite accumulating evidence, the role of discrimination in education has been underexplored compared to the labour market, with few studies applying experimental designs (Batruch et al. 2023; Zanga and De Gioannis 2023). Teacher bias in assessments remains insufficiently understood due to critical methodological flaws: omitted variable bias and measurement error in observational studies (van Huizen, Jacobs, and Oosterveen 2024), weak reliability in cognitive measures of implicit bias (Miles, Charron-Chénier, and Schleifer 2019), as well as underpowered (Schuessler and Freitag 2020) and low-externally valid experiments (Petzold 2022). Furthermore, most previous studies focused on ethnic or gender discrimination, particularly for grading outcomes (Zanga and De Gioannis 2023), leaving SES- and cultural capital-based biases under-researched. Importantly, no previous study has experimentally disentangled the causal effect of all these students’ ascribed characteristics on teacher assessments (Wenz and Hoenig 2020). In this article, we contribute by testing if teachers show assessment biases by several students’ ascribed factors, framing our pre-registered hypotheses in an interdisciplinary discrimination framework spanning sociology, psychology, and economics. 2 Although most previous research only tested single discrimination theories (Correll and Benard 2006), we draw on complementary theories of status characteristics beliefs (Ridgeway 2014), implicit bias (Greenwald and Banaji 1995), statistical discrimination (Arrow 1973), and cultural capital (Jæger and Breen 2016). All of them hypothesize negative teacher bias against boys, ethnic minorities, low-SES, and low-brow cultural capital. We test the explanatory power of these theories by comparing three educational outcomes that, given fixed student information, convey different degrees of uncertainty for teacher evaluations in the sociological science | www.sociologicalscience.com 744 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments short- and long-term—essay grading, grade retention recommendations, and track enrollment expectations. Our pre-registered experimental and sampling design further contributes to four main methodological fronts. First, individual biases by students’ backgrounds are hard to capture with observational data due to social desirability and the impossibility of measuring all (un)observable student characteristics—true ability and behavior (Ferman and Fontes 2022). These are generally proxied with lowstakes competence tests subject to measurement error (Südkamp et al. 2012), which, once corrected, might decrease SES and cultural capital discrimination estimates substantially (van Huizen, Jacobs, and Oosterveen 2024; Jæger 2022) or even change the bias direction favouring ethnic minorities (Zhu 2024). To address these issues, we designed a 2 7 -factorial experiment with 128 profiles to isolate the causal effect of students’ ascribed characteristics on three teacher’s assessments. To identify students’ ascribed status—SES, migrant background, gender, and cultural capital— we experimentally manipulate three ability dimensions to rule out confounding: language skills, subjects passed/failed, and socio-emotional skills. Second, laboratory and factorial experiments are often criticized for their lower validity (Krolak-Schwerdt et al. 2017) relative to field experiments or automatic cognition measures like the Implicit Association Test (IAT) (Melamed et al. 2019)— even though IATs are not without issues (Mitchell and Tetlock 2017). Thus, to increase our design validity, we randomly assigned different versions of a real task, an essay written by a sixth grader, experimentally manipulating its objective quality and cultural capital (Farkas 2003). We also untangle parental SES from ethnic origin. Students’ SES is usually signaled with names and surnames (Wenz and Hoenig 2020), yet participants might not correctly identify SES variation within foreign origin names (Crabtree et al. 2022). Although we signal gender and migrant origin with name and surname, we subtly embed the students’ SES (father’s occupation) within the essay and a fictitious but realistic student file (contact email). Thus, this study contributes substantially by experimentally disentangling students’ ascribed and ability factors using realistic and externally validated instruments. Third, instead of in-service teachers, we sampled pre-service teachers—students of the Bachelor of Arts (BA) in Primary Education—to identify if they already show assessment biases well before interacting with students or being exposed to schools. Teachers might sort into schools with socio-demographic characteristics and organizational processes aligned with their previous biases and ascribed traits (Lievore and Triventi 2023). At the same time, school-level institutional factors and classroom composition might reinforce or mitigate pre-existing teacher biases (Pitten Cate and Glock 2019). Thus, focusing on pre-service teachers might establish a benchmark for inter-group relations studies (Elwert, Keller, and Kotsadam 2023) while informing the debate on early interventions to promote fairness in teacher training programmes (Lehmann-Grube, Tobisch, and Dresel 2023). Fourth, experimental surveys usually have lower statistical power and representativeness than large-scale surveys. Thus, we went beyond a small convenience sample, implementing a systematic random sampling with probability proportional to size. We recruited a sample of 19 public and private Spanish universities by contacting all Primary Education BA students to reach 1,717 valid respondents. This sociological science | www.sociologicalscience.com 745 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments large sample allowed us to identify powered main effects using a pre-registered power plan. Findings unveil teacher discrimination in essay grading, showing a preference for girls and highbrow cultural capital, aligning with status characteristics beliefs, implicit bias, and cultural capital theories. Regarding teachers’ future educational expectations, findings suggest statistical discrimination against boys, migrant origin, and low-SES students. Surprisingly, the ethnic bias shifts from favoring native origin students in teachers’ long-term expectations to compensatory grading favoring those with a migrant background. Theoretical Background, Previous Findings, and Hypotheses This section outlines theories explaining how teachers might generate observed achievement gaps by student-ascribed status. We expand on each theory and how to differentiate between them by focusing on their observable, testable implications while reviewing previous relevant findings. Implicit Bias and Status Characteristics Beliefs Psychological theories of implicit bias explain how micro-processes subtly generate social inequality (Fazio et al. 2023; Greenwald and Banaji 1995). Implicit cognition (Greenwald and Krieger 2006) is an unconscious process that might lead to discrimination via two interrelated processes: (1) a tendency to like or dislike group members (implicit attitudes) and (2) the association of a group with a positive or negative trait (implicit stereotypes). Studies deploying implicit bias tests in educational contexts identified teachers’ negative reactions against immigrants and low-SES students (Carlana et al. 2022; Pit-ten Cate and Glock 2019; Alesina et al. 2018). Results on gender are mixed, with girls perceived as less proficient in science or math, according to the Gender-Science IAT (Carlana 2019), while more skillful in language tasks than boys (Glock and Klapproth 2017). Implicit associations do not necessarily align with explicit behavior (Glock and Krolak-Schwerdt 2014) and might remain unconscious until triggered. Under a sociological lens, implicit biases emerge during early socialization. They are stored in implicit memory as cultural schemata (DiMaggio 1997) because people process information consistent with pre-existing mental structures. Status Characteristics Theory (SCT) focuses on beliefs about which social groups are more competent or deserving (Berger et al. 1977). Such beliefs naturally emerge in small-group interactions, falling along ascribed groups—ethnicity, gender, and class (Foley 2023)—as long as these convey distinctive status and are salient to the task (Ridgeway 2014). In sum, SCT is a status generalization theory attributing abilities to individuals based on group characteristics (Correll and Ridgeway 2006:33). Yet individuals may not realize they hold differential competence expectations, linking sociological SCT to psychological implicit bias theories (Melamed et al. 2019). sociological science | www.sociologicalscience.com 746 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments SCTs have rarely been applied to the educational context. Still, similar status generalization processes might arise when teachers evaluate performance (Kisfalusi, Janky, and Takács 2018). The Double Standards Theory (DST) (Foschi 2000) posits that standards tied to status characteristics might result in differential performance expectations and biased assessments among equally competent students. Due to entrenched status beliefs, lower-status individuals must outperform higherstatus peers for equal task competence recognition because high performance would be inconsistent with their bottom status. DST reveals harsher scrutiny for lower-status individuals, favoring lenient judgment for equally competent higher-status counterparts. Accordingly, teachers’ implicit beliefs and expectations about competence and deservingness might contribute to reproducing the observed educational gaps by student-ascribed characteristics, net of their objective ability. These expectations alone might generate gaps via self-fulfilling prophecies (Merton 1968). Gender is a powerful status characteristic conveying “cultural expectations for competence”, where men are typically assumed to be better than women at most tasks (Correll and Ridgeway 2006). However, in the school context, teachers might form implicit biases and status characteristics beliefs by internalizing stereotypes about girls doing better than boys because, currently, it is the case (DiPrete and Buchmann 2013). Accordingly, teachers generally report girls as more academically competent than boys (Homuth, Thielemann, and Wenz 2023), particularly in language—the task evaluated in this article—compared to scientific or math proficiency (Krkovic et al. 2014). We similarly argue that teachers may internalize negative stereotypes about low-SES and migrant origin individuals, given that these abound in Western countries, including Spain (Cea D’Ancona 2016). Besides, these groups objectively underperform native origin and high-SES students (Skopek and Passaretta 2021) and are perceived accordingly by teachers (Homuth et al. 2023). This internalization process may begin before teachers enter service during their schooling and pre-service training through exposure to ascribed groups as classmates. In sum, teachers’ evaluations are tainted by their tendency to like or dislike particular groups, or their differing expectations, beliefs, and standards about the competence of individuals belonging to an ascribed group. In contrast with statistical discrimination perspectives discussed below, teacher bias is fairly stable because, with new individual input, teachers will stick to pre-existing status beliefs. Still, although a single individual interaction is unlikely to change behavior, teachers consistently exposed to counter-stereotypical exchanges might decrease bias (Elwert et al. 2023). Hypothesis 1 (H1). Implicit bias, beliefs and standards about student status characteristics drive teacher evaluations by over-grading (H1a), recommending less grade retention (H1b) and expressing higher expectations (H1c) for girls (vs boys), natives (vs migrants), and high-SES pupils (vs low-SES). sociological science | www.sociologicalscience.com 747 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments Statistical Discrimination Statistical discrimination theories, mainly by economists (Arrow 1998, 1973; Borjas and Goldberg 1978; Phelps 1972), have a crucial distinction with implicit bias or SCT. Rather than resulting from deep-rooted beliefs and expectations, discrimination happens due to a lack of perfect information and diminishes once obtained. According to the original formulation applied to labor markets, under imperfect information about true employees’ productivity, the employer’s rational action is proxying unknown individual productivity using the employee’s observable characteristics, such as gender or ethnicity. The information employers use from ascribed characteristics is the average performance of employees belonging to a given ascribed group, known from previous experience or historical knowledge. When given additional information to make an assessment, the prediction is that discrimination diminishes or even disappears. Although initially developed to explain hiring discrimination, this theory has recently been applied to the educational context. Hanna and Linden (2012) find experimental evidence of statistical discrimination in grading: When asked to evaluate a series of exams with randomly assigned ascribed characteristics (gender, age, and caste), teachers rely less on them, reducing bias against low-caste students, as information about the testing instrument and grade distribution is obtained. Likewise, Botelho et al. (2015) compare teacher assessments of 8 th graders across 10.6 thousand classrooms in Brazil to standardized scores (blindly marked) to study racial discrimination. Using the length of classroom interaction time between the teacher and a student as a proxy for individual-level information, they show no racial discrimination for students graded by a teacher who had already taught them, with discrimination only being present for those attending classes with a new teacher. Studies on the impact of rubrics on assessment also uncover compatible patterns with statistical discrimination: teachers’ racial bias in grading is present with vague rubrics but disappears when using a rubric with clearly defined evaluation criteria (Quinn 2020). Thus, teachers might rely less on students’ ascribed characteristics as proxies for average performance under clear guidance on absolute evaluation (Hjorth-Trolle, Rosenqvist, and Hed 2022). A key implication differentiating the statistical discrimination theory from those discussed above is the expectation that the more (less) information provided, the less (more) discrimination exists. Applied to the educational context, we argue that statistical discrimination is unlikely in short-term outcomes, like specific grading tasks and retention recommendations, where teachers count on concurrent comprehensive information for accurate assessments (Wenz and Hoenig 2020). By contrast, we predict statistical discrimination to be in place when teachers express individual long-term educational expectations, as they lack crucial information about timevarying factors (e.g., performance) conditioning students’ future trajectories. In such an ambiguous case, teachers might rely on time-constant student-ascribed characteristics as a proxy to make informed predictions (Geven et al. 2021). Teachers do not necessarily need in-service experience to infer the actual average success probability of different ascribed groups because this common-ground knowledge might already be acquired during their schooling and pre-service training. sociological science | www.sociologicalscience.com 748 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments In sum, the expectation we derive from statistical discrimination theory is that ascribed characteristics are more likely to be relevant in evaluations when the performance information is more unreliable (Aigner and Cain 1977) or conveys less diagnostic clarity (Fiske et al. 2018). Thus, we expect that teachers are more likely to rely on ascribed characteristics when the information is unreliable and uncertain— which is the case in long-term assessments—than when the information is reliable and certain—the case in short-term evaluations (Wenz and Hoenig 2020). Then, when information is ambiguous, group ascriptive factors (stereotypes) should gain weight as proxies of mean potential success vis-à-vis individual ability factors signaling current performance, eventually leading to higher (statistical) discrimination in future than short-term outcomes. Hypothesis 2 (H2). Under imperfect individual-level information, teachers express higher educational expectations for girls (vs boys), natives (vs migrant origin), and high- SES students (vs low-SES). Discrimination is generally larger and consistent with statistical discrimination when teachers express long-term expectations rather than grade a concrete task or recommend a short-term outcome (grade retention) under concurrent, detailed student information. Cultural Capital Cultural capital theories (CCT) define cultural capital as high-status cultural signals that enhance social inequality (Bourdieu and Passeron 1990; Bourdieu 1984). Despite its early influence, cultural and stratification sociologists agree on its unclear formalization and causal basis (Jæger and Breen 2016; van de Werfhorst 2010; Goldthorpe 2007; Lamont and Lareau 1988). Despite its shortcomings, cultural capital can be a powerful educational inequality mechanism if precisely formalized and tested (Jæger 2022). Thus, this article seeks to test whether CCT can explain teacher discrimination in addition to the theories reviewed above. Two different approaches link cultural capital to social stratification. The first argues that cultural capital shapes educational inequality via teachers’ bias (Bourdieu 1984). Teachers positively evaluate those children socialized in the dominant culture to which teachers belong, and the school system legitimizes via canonical curricula (Bourdieu and Passeron 1990). Through embedded cultural scripts as ‘frames’ or ‘narratives’ (Lamont et al. 2014; Lamont and Small 2008), teachers interpret cultural capital as signals of student academic brilliance independently of their actual ability (Jæger et al. 2023). Thus, teachers use and recognize such signals to gatekeep school progress, resulting in cultural discrimination (Jæger and Breen 2016; DiMaggio 1982). The second approach departs from the classic Bourdieusian proposition to conceive cultural capital as a set of socio-emotional or non-cognitive skills (Farkas 2003)—“patterns of thought, feeling and behavior” (Borghans et al. 2008:974). In turn, these skills directly improve educational performance (Breinholt and Jæger 2019) or the capacity to command attention and negotiate advantages in the classroom (Calarco 2014; Lareau 2011). Thus, those children (and parents) who display high cultural capital also tend to have high ability and motivation, potentially overestimating the effect of cultural capital (Jæger 2022). sociological science | www.sociologicalscience.com 749 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments Distinguishing between these two approaches to cultural capital is empirically challenging, questioning the causal relationship between cultural capital and educational outcomes (Jæger 2022). This article aims to disentangle these two perspectives linking cultural capital to student academic success by testing for direct evidence of teacher bias as framed in the first perspective. We test whether teachers use performance-irrelevant cultural capital markers in their assessments, reinforcing categorical inequality over and above objective students’ academic abilities and socio-emotional skills. A key distinction with the other discrimination theories discussed above is that cultural capital signals, not ascribed characteristics per se, drive teacher discrimination. Even if high-SES or non-migrant background students are more likely to show such signals in the real world, a portrayal of cultural capital signals drives teachers’ discrimination. Hypothesis 3 (H3). Teachers misconceive academic brilliance with highbrow cultural capital by over-grading (H3a), recommending less grade retention (H3b) and expressing higher expectations (H3c) for students signaling high cultural capital (vs low cultural capital). Data, Variables, and Methods Sampling Design and Data Experimental studies generally collect convenience samples that are not representative of the reference population and have low power and external validity. To address these issues, we implemented an explicitly stratified systematic random sampling by public and private institutions with probability proportional to size (see online supplement Part B for details). We randomly drew 20 institutions—15 public and five private—from the population frame to represent all education faculties across non-bilingual Spanish regions ( N= 85). 3 We replaced four out of the five initially selected faculties with the next closest unit in the sampling frame according to the measure of size (enrolled students) due to non-response or refusal to participate. In total, 15 public and four private institutions participated in the study, inviting 27,015 students enrolled in the BA Degree in Primary Education in 2022/2023 (see online supplement B and Table S.2.) via faculty’s email (see online supplement A). 1,028 students in 15 public and 720 in 4 private faculties completed the online survey between April and June 2023. We collected 1,748 observations (7 percent response rate), reduced to 1,717 after excluding fraudulent or underage (age < 18) cases (Gil-Hernández et al. 2023). 4 The pre-registered power analysis shows the analytical sample and most estimated coefficients lie above powered thresholds (see online supplement Part C) (Freitag and Schuessler 2020; Dziak, Collins, and Wagner 2013). As seen in Table 1, the share of students in public and private institutions is virtually the same in the experimental sample (40 percent) relative to administrative data on the whole reference population (Ministerio de Universidades 2023). 5 Sociodemographic characteristics of our experimental sample are generally balanced when compared to the population, even though there is a slight overrepresentation of females (+9.9 percent), foreign-born (+3.4 percent) and older students sociological science | www.sociologicalscience.com 750 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments Table 1: Sample and population characteristics. Population DataaExperiment Sample 2022/2023 2023 Students (Institutions) N=59,084 (94)n=1,717 (19) Total Students in Private Institutions 39.4% 40.0% Female 68.8% 78.7% Graded2.8 Age 18–25 73.3% 63.4% ≥26 26.7% 36.6% Foreign-Born Students 1.3%b4.7% Foreign-Born Parents 9.4% Parental College Education 50.9%c40.2% Public Universities Students (Institutions) N=35,785 (49)n=1,030 (15) Female 65.9% 77.2% Graded2.7 Age 18–25 90.3% 87.4% ≥26 9.7% 12.6% Foreign-Born Students 1.4%b3.3% Foreign-Born Parents 9.0% Parental College Education 50.2%c41.4% Private Universities Students (Institutions) N=23,299 (45)n=687 (4) Female 73.1% 81.1% Graded2.9 Age 18–25 47.3% 27.4% ≥26 52.7% 72.6% Foreign-Born Students 1.3%b6.8% Foreign-Born Parents 9.8% Parental College Education 52.4%c38.4% Notes: (a) Administrative data (provisional) from the academic year 2022/2023, excluding non-bilingual regions. (b) Non-Spanish nationality. (c) Data from 2019/2020. (d) The average course of enrollment in the BA Degree in Primary Education, with SD=1.2 and ranging from 1 to 4 for the standard BA and from 1 to 5 for Double Degrees. (+9.8 percent), and an underrepresentation of highly-educated backgrounds ( − 10.7 percent). As shown in the online supplement (Part I), we successfully replicate the main models adjusted for calibration weights using raking estimators to adjust the population shares of the main individual-level socio-demographic variables (see Table S.7.). sociological science | www.sociologicalscience.com 751 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments Estimation and models In the baseline set of models (M1) (only shown in online supplement Table S.5B), we run Ordinal Least Squares (OLS) models, including a dummy for each of the seven experimental factors, to estimate their Average Marginal Component Effect (AMCE) on the three metric outcomes ( yi1essay grade ; yi2retention ; yi3expectations ). The AMCE, the causal estimand of interest, expresses a factor’s average individual-level effects (Hainmueller, Hopkins, and Yamamoto 2014). It can be interpreted as the causal effect of a specific factor level (treatment) in comparison with another level of this same factor (baseline or control category) while keeping equal the joint distribution of the remaining factors (Bansak et al. 2021). The remaining factors operate as randomized pre-treatment covariates. Standard errors are clustered at the faculty/university level to account for the non-independence of observations within these sampling groups. In the second set of models (M2), formalized in Equation 1 and fully displayed in online supplement Tables S.5A-S.5B, pre-treatment respondent-level controls (ethnic origin, gender, parental SES, grade retention, institution fixed effects, BA enrollment grade and birth year) are a covariate vector (Zj) to increase the precision of the main effects because individual-level variables are independent of the experimental factors by design (Baguley, Dunham, and Steer 2022). yi123 =α+βi1gender +βi2migrant background +βi3parental SES +βi4cultural capital +βi5essay quality +βi6subjects f ailed +βi7socioemotional skills +Zj+εi(1) According to the pre-registered power analysis and final analytical sample we reached in the study, we do not test the moderation hypotheses outlined in the PAP. We only run interaction models in two specific cases relevant to the main hypotheses outlined above, where large and powered heterogeneous effects can be identified by essay quality ( yi1essay grade ) and failed subjects ( yi2retention ). We provide two additional non-pre-registered analyses in the PAP to better disentangle our research hypotheses. First, at the bottom of online supplement Table S.5A, we include the ratio between ability and ascriptive factors, dividing the average absolute effect size of the three ability factors by the average absolute effect size of the four ascriptive factors by each outcome. An ability/ascriptive ratio considerably smaller for long-term expectations than the remaining short-term outcomes would align with H2 on statistical discrimination. Second, instead of experimentally assigning information treatments, we hold individual student information constant within respondents to exploit variation in its reliability and uncertainty across short- and long-term outcomes. The same student information assigned to each teacher should convey less reliability the more the outcome is projected into the future. In Figure 3(full output in online supplement Table S.11.), we formally test differences in the discrimination coefficients across outcomes with a two-tailed Z-test from seemingly unrelated regressions that account for covariance between estimators within the same sample (Clogg, Petkova, and Haritou 1995). In this way, we assess whether student’s ascribed characteristics more strongly impact long-term educational expectations (yi3expectations ) when compared to the sociological science | www.sociologicalscience.com 758 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments models predicting short-term outcomes ( yi1essay grade;yi2retention ). If so, H2 would gain additional support. Findings Figure 2portrays the main OLS models (M2) output by outcome and experimental factor, controlling for sampling institution fixed effects and respondent characteristics (full output in online supplement Tables S.5A-S.5B). In Figure 2, in the upper panel, we split the independent variables by ascribed and ability factors. These factors represent multiple randomized categorical treatments concerning its control or reference group. Figure 2(upper panel) shows that those factors accounting for students’ objective ability are the most predictive vis-à-vis ascriptive factors across outcomes. Unsurprisingly, students’ cognitive and non-cognitive skills are the leading performance indicators for teachers’ assessments. Essay Grading Focusing on grading, an objectively good essay implies 2.8 points (pvalue < 0.001) higher teacher grading than an objectively bad essay. The remaining ability factors, number of failed subjects and socio-emotional skills, have similar predictive power, with AMCEs at 0.28 (pvalue < 0.01) and 0.27 (pvalue < 0.01), respectively. In grading an essay, a student’s number of failed subjects or behavior is arguably outside the scope of what should be graded according to official Spanish rubrics for language tasks. This finding mirrors previous research showing that teachers assess students according to their classroom behavior beyond their objective competence (Ferman and Fontes 2022) and the importance of controlling for it to identify teacher bias. Figure 2(bottom panel) zooms in on the particular role of ascriptive factors. Net of students’ objective observed ability, teachers tend to assign higher grades in the essay, on average, to students profiles who are girls ( βAMCE = 0.12 [pvalue < 0.1]), come from a (Moroccan) ethnic minority origin ( βAMCE = 0.2 [pvalue < 0.01]), or signal high cultural capital ( βAMCE = 0.2 [pvalue < 0.001]). This latter finding on cultural capital discrimination validates H3a: direct exposure to a written highbrow cultural capital signal in a real student’s essay task elicits higher teacher evaluations. In line with H3a, teachers might misconceive students’ high cultural capital with academic brilliance, as these factors are orthogonal by design, independently of a student’s SES and objective ability. The effect is nevertheless limited as it does not show on the remaining outcomes, rejecting H3b-c. Moving on to student parental SES, this factor is irrelevant in predicting teacher grades, partially rejecting H1a on implicit bias or SCT. In the discussion, we elaborate on this null finding compared to previous experimental and observational studies. For the case of student gender, the magnitude and direction of the coefficient point to slight positive grade discrimination for girls, as expected by H1a and broadly in line with previous findings. Yet the estimation is highly uncertain with a p value < 0.1. Online supplement Figure S.7. reveals that girls are particularly over-graded in comparison with boys when the essay is good ( βAMCE = 0.27; p value < 0.05; n= 871), backing sociological science | www.sociologicalscience.com 759 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments Figure 2: AMCEs of ascriptive and ability factors on educational outcomes (95% CI). Notes: * p value < 0.05 (Bottom panel); Controls: institution-FE; respondents’ characteristics. The bottom panel displays the same model as the upper, zooming in on ascriptive factors. The full output is in online supplement Tables S.5A- S.5B. The grade retention scale is reversed in this figure to display the same coefficients’ direction across outcomes and facilitate interpretation. Recom. =Recommendation; Exp. =Expectations. sociological science | www.sociologicalscience.com 760 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments the generalized belief that girls are more competent than boys in language tasks (Homuth et al. 2023). In turn, the finding on positive ethnic discrimination in essay grading, contrary to H1a and most previous findings, is surprising. We did not expect this coefficient’s direction favoring ethnic origin pupils under any of the above-discussed discrimination theories. It seems that teachers tend to compensate for a student’s overall disadvantaged ethnic minority origin by over-grading them in comparison to the equally skilled and socioeconomically (dis)advantaged ethnic majority. We discuss this unexpected finding in the concluding section 5 in line with compensatory discrimination. Grade Retention Recommendations We now turn to the second outcome, teacher recommendations for student grade retention in elementary 6 th final grade. As expected, all ability-related factors are statistically significant and highly predictive. Again, similarly to the essay grading outcome, the objective quality of the essay, as a proxy for the student’s true (language-related) ability, is the most predictive factor ( βAMCE = 2.16 [pvalue < 0.001]) of (no) grade retention recommendation. Following in effect size, having passed all subjects ( βAMCE = 1.73 [pvalue < 0.001]) and students’ good behavior and effort ( βAMCE = 1.03 [pvalue < 0.001]) in the current term evaluation are considerably more predictive than they were for essay grading. The larger effect size of the student’s socio-emotional skills and, notably, the number of subjects passed aligns with the outcome’s nature. Legal thresholds for granting repetition are set at three core failed subjects, and teachers are particularly prone to recommend a student to repeat if he/she does not strive or misbehave as a punishment policy. Focusing on the student’s ascribed characteristics, although the coefficients’ direction and effect sizes generally align with our findings for essay grading, none is statistically significant under the standard 5 percent threshold. When interpreting these a priori null findings, one should consider the outcome’s high variation and skewness to the right (see online supplement Figure S.8.), seemingly indicating that most teachers are highly averse to grade retention. Thus, we run a heterogeneous model (M2) by the number of failed subjects to test for a more realistic setting. As illustrated by online supplement Figure S.9., we find strong positive gender ( βAMCE = 0.36 [pvalue < 0.05]) and ethnic minority ( βAMCE = 0.53 [pvalue < 0.01])—compensatory—discrimination in (no) grade retention recommendations, in line with and contrary to H1b, respectively. In turn, for parental SES and cultural capital, H1b does not find support. Upper-Secondary Track Expectations The third outcome is teacher expectations about a student’s enrollment in the uppersecondary academic track. In this long-term outcome, teachers evaluate students’ profiles by considering the last grade of elementary education, lacking information about future performance. After that, lower-secondary education comprises four grades before the end of compulsory schooling (16 years old) and the transition into upper-secondary education. sociological science | www.sociologicalscience.com 761 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments As evident from its smallest adjusted coefficient of determination (R 2 ) across outcomes (see online supplement Table S.5A), educational expectations seem more uncertain for respondents, signaling a noisier model. On average, ability factors have smaller effect sizes for long-term expectations, with the smallest average ratio over ascriptive factors (5.6), halving the remaining outcomes (12.7). Still, student behavior and effort ( βAMCE = 1.21 [pvalue < 0.001]) seem to gain weight compared to the previous outcomes as a powerful indicator of future success. Hence, students’ current performance is not fully informative for teachers to predict future attainment accurately, leaving room for ascribed group-level stereotypes. Focusing on ascribed factors in Figure 2(bottom panel) reveals that, in line with H2 and previous findings (Geven et al. 2021; Timmermans et al. 2015), teachers express higher long-term expectations for those groups with historically higher educational attainment across secondary education (Gil-Hernández and Gracia 2018), such as girls ( βAMCE = 0.24 [pvalue < 0.01]), native origin ( βAMCE = 0.19 [pvalue < 0.05]) and high-SES ( βAMCE = 0.2 [pvalue < 0.05]) students, displaying similar effect sizes at about 10 percent of an SD-unit. As predicted by H2 and formally tested in Figure 3with coefficient difference tests by outcomes (see online supplement Table S.11.), the effect sizes of ascriptive factors like gender ( ∆βExpectations-Grading = 0.05; ∆βExpectations-Retention = 0.07), parental SES ( ∆βExpectations-Grading = 0.08; ∆βExpectations-Retention = 0.08), and ethnic origin ( ∆βExpectations-Grading = 0.19; ∆βExpectations-Retention = 0.13) are substantially larger, from 5 percent to 20 percent an SD-unit—even changing sign for ethnic origin, for long-term educational expectations than for short-term outcomes. Nevertheless, the z-tests yield statistically significant differences (pvalue < 0.05) only for ethnic backgrounds. Although potentially underpowered, these findings align with statistical discrimination as student-ascribed characteristics gain weight in teacher long-term evaluations, increasing discrimination as information on student ability becomes less reliable. At the same time, these findings on bias in educational expectations against boys, low-SES and ethnic minority students are compatible with H1c on implicit bias and status characteristics beliefs. These theories predict teacher bias to remain relatively independent of the level of individual information dispensed, as teachers will stick to pre-existing status beliefs to form their competence expectations by ascribed groups. Discussion and Conclusions Fair evaluations are critical for equal educational opportunity. Teachers are the principal evaluators of academic merit in the educational system. Nevertheless, their direct role in reproducing or compensating educational inequalities remains elusive as previous observational work and the few experimental studies available have yielded inconclusive. Thus, this article tested if (pre-service) teachers show discrimination in their assessments and expectations as a function of studentascribed characteristics with a causal experimental design. We framed our research hypotheses from multidisciplinary theories of status characteristics beliefs, implicit bias, statistical discrimination, and cultural capital. sociological science | www.sociologicalscience.com 762 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments Figure 3: Standardized coefficient differences across outcome models (95% CI). Notes: Coefficients difference by outcome models ( ∆βy 3 −y 1 [ Z -Academic Track Expectations – Z -Essay Grade]; ∆βy 3 −y 2 [ Z -Academic Track Expectations – Z -No Grade Retention]) with a two-tailed Z -test using seemingly unrelated regressions. Reversed scale for grade retention recommendation outcome to accurately estimate coefficient differences. Outcomes in z -scores for scale comparability. Clustered standard errors. Full output in online supplement Table S.11. We analyzed different outcomes over the students’ educational careers, conveying diverse uncertainty for teacher evaluations to disentangle these theories’ predictive power. We conducted a pre-registered full factorial survey experiment with realistic and externally validated instruments, drawing a large sample of Spanish pre-service teachers before exposure to the school context. For the first time, this research design causally identifies the net effect of different student-ascribed characteristics—gender, SES, ethnic origin, and cultural capital—beyond ability on teachers’ assessments. Online supplement Table S.12. summarizes the article’s main findings. Overall, we found teacher biases in (essay) grading favoring girls (supporting H1a on status characteristics beliefs and implicit bias theories), ethnic minority origin (partially rejecting H1a), and students signaling high cultural capital (partially supporting H3a on cultural capital theory). Regarding teachers’ recommendations about grade retention, findings mirror the direction of the former biases for grading by gender and ethnic origin, except for cultural capital, among low-performing students falling within the legal threshold for repeating a grade. Finally, concerning teachers’ educational sociological science | www.sociologicalscience.com 763 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments expectations, we found evidence of statistical discrimination (validating H2) in favor of girls, native origin students, and high-SES background students. For essay grading, a short-term outcome where we allegedly provided teachers with the minimum necessary information for fair assessments, results align with theories of implicit bias or status characteristics beliefs (gender), cultural capital (signals), and previous findings. The finding on gender supports the generalized belief that girls are more competent at school (Homuth et al. 2023), as they objectively overperform boys, especially in language competencies like the ones evaluated in this experiment essay task. The finding on the effect of cultural capital on essay grading, not holding for grade retention recommendations or long-term expectations, suggests that immediate exposure to a highbrow culture signal boosts teacher perceptions of academic brilliance beyond the student’s true ability (Jæger and Møllegaard 2017). Cultural capital is orthogonal to student SES by design in this experiment. Still, given that they positively associate in reality, the former might be a causal mechanism driving SES-based inequality in assessments. Contrary to our expectations in H1a-b, we find no evidence of SES bias in short-term assessments. This null finding aligns with a similar previous factorial experiment in Germany (Wenz and Hoenig 2020) and observational research in Spain (Marcenaro-Gutiérrez and Vignoles 2015). At the same time, it suggests (1) potential overestimation in those studies detecting bias against low-SES students (Gortázar et al. 2022) for not fully controlling for socio-emotional skills (Ferman and Fontes 2022) and/or measurement error in test scores (van Huizen et al. 2024); (2) underestimation in our essay grading task due to low ecological validity because, in the school context, teacher biases might accumulate over several assessments during the whole academic year; or (3) the cultural capital mechanism fully accounting for observed assessment bias by SES. In turn, contrary to most previous studies (Zanga and De Gioannis 2023; Gortázar et al. 2022) and H1a-b, we found evidence of over-grading and under-expectations of grade retention for ethnic minority students, suggesting explicit compensatory discrimination. In the egalitarian context of Denmark, Schuessler and Sønderskov (2023) found that teachers tend to overgrade ethnic minority origin students if they underperform relative to their national-origin classmates due to teachers’ equalizing preferences. In our investigation, absolute grading practices should prevail (Hjorth- Trolle et al. 2022) because each respondent only evaluated one student profile. Still, despite student performance and SES being orthogonal to ethnic origin by design, teachers might generally perceive that Moroccans underperform compared to the Spanish origin majority, as the former group is one of the worst-performing minorities. Furthermore, about 80 percent of second-generation Moroccan origin students do not regularly speak Spanish at home, being one of the most socioeconomically deprived minorities (Gil-Hernández and Gracia 2018:594). Thus, teachers might generally perceive that they are a disadvantaged minority experiencing language difficulties and, hence, explicitly compensate for that disadvantage by over-grading. Relatedly, Alesina et al. (2018) found that teachers’ negative stereotypes towards migrant origin students, captured with the IAT test, do not impact their average Italian grades, whereas they do affect math, arguing that literature teachers might sociological science | www.sociologicalscience.com 764 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments internalize the need to help immigrants less acquainted with the Italian language, regardless of their biases (Alesina et al. 2018:3). Supporting this pattern, in Spain, Marcenaro-Gutiérrez and Vignoles (2015) found higher teachers’ grades for migrant origin students than their performance in a blind standardized reading test, relative to the Spanish origin majority, but not in math. The observed biases in educational expectations of upper-secondary pathways— a long-term outcome lacking information on students’ future performance—favoring girls, native origin students, and high-SES students support statistical discrimination theories, validating H2, and in line with previous experimental findings on in-service teachers (Geven et al. 2021 for SES; Wenz and Hoenig 2020 for SES and migrant origin). Generally, we found effect sizes at least double those identified for essay grading and grade retention recommendations, concurrent outcomes to the student’s information provided. Simultaneously, these findings on educational expectations also validate H1c on implicit bias and status characteristics beliefs, predicting teacher bias to be cognitive in origin and relatively independent of the degree of individual information disclosed (Correll and Benard 2006). The finding on (negative) statistical discrimination by ethnic minority origin, which dramatically changes its effect size and direction from positive to negative compared to the remaining outcomes, is particularly striking given the general optimism of migrant origin families and students when expressing their educational expectations (Gil-Hernández and Gracia 2018) and their actual more ambitious enrollment choices (Ferrara 2023), compared to equally-performing peers from national majority origin. Thus, beyond being educated guesses, statistical discrimination practices might lead to self-fulfilling prophecies if teachers expect less academic success from those historically disadvantaged or discriminated groups, such as migrant origin and low-SES students, risking to rationalize stereotypes and legitimize ascribed status inequalities in the name of efficiency (Tilcsik 2020).8 On average, as the benchmarking analysis in online supplement Part L shows (see Table S.12.), we reported average effect sizes (Cohen’s D ≈ 0.1) in line with previous studies (Schuessler and Sønderskov 2023; Alesina et al. 2018) representing more than 50 percent of learning gains over a school year (Evans and Yuan 2019), large-scale educational interventions, or gender gaps in test scores. These benchmarks indicate teacher bias effects are not trivial and might entail real consequences for educational pathways, especially when accumulating (dis)advantages over several assessments (DiPrete and Eirich 2006). Students from disadvantaged backgrounds are generally less risk-averse to downward mobility and have less perceived chances of success in education than advantaged peers (Breen and Goldthorpe 1997). Hence, they may be sensitive to distorting biases in the signaling information teachers’ evaluations provide (Holm et al. 2019), potentially pushing their educational expectations downwards. Limitations and Conclusion This study has four limitations that pave the way for future research. First, a complex trade-off exists between avoiding social desirability and ensuring respondents internalize the experimental manipulations in ecologically valid factorial designs. sociological science | www.sociologicalscience.com 765 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments We implemented externally validated survey instruments that were as realistic as possible to emulate real world evaluation settings. However, fictitious student profiles might trigger statistical discrimination, as in-service teachers know their students, which reduces the lack of individual-level information. Still, as shown by Krolak-Schwerdt et al. (2017), vignettes of fictitious students yield ecologically valid results of teachers’ assessments in real classrooms. Besides, in the actual school context, teachers tend to weigh several assessments over the academic year, grading on a curve or relative classroom-level scales, whereas our vignette experiment induced absolute grading in a single task. Absolute and relative grading scales might have different implications for students’ ascribed status inequalities depending on school composition (Hjorth-Trolle et al. 2022), whereas teachers’ biases might accumulate over several evaluations to assign the final grade. Finally, given implicit biases against girls’ scientific competence (Carlana 2019), implementing a math task might go more in line with classic SCT predictions of men being expected to outperform women (Correll and Ridgeway 2006) and not replicate our findings on teacher’s over-grading of girls in essays. Field school experiments combining administrative data on fully comparable internal and external grades (Bygren 2020) in language and scientific subjects and automated cognition tests might overcome these challenges (Alesina et al. 2018). Second, our sample of pre-service teachers raises external validity issues, as most have not yet had direct contact with students or schools. Pre-service teachers are a more homogenous group than in-service teachers in terms of age and experience, and, as younger cohorts, they might be more idealistic and unaffected by real-school practice. Then, one might wonder to what extent the findings reported here represent a lower- or upper-bound of what we would find with actual teachers. Because pre-service teachers lack real experience, their evaluation practices might not be accurate. Still, in a pre-test to validate the instrument, we have shown that, in grading an essay, the grade distribution between pre- and in-service teachers largely overlaps. For retention recommendations, one could expect pre-service teachers to be more idealistic and averse than older in-service teachers, especially when this practice is currently discouraged by national and international educational institutions. Regarding long-term educational expectations, fictitious student profiles might boost statistical discrimination, especially among pre-service teachers who lack experience teaching individual students, as they might fill in the blanks by assigning the corresponding ascribed group stereotype. Yet the factorial design with fictitious student profiles might mitigate this experience gap between pre-and in-service teachers, being similarly affected by variation in student information uncertainty. Inter-group relations theories predict less (contact theory) or more (conflict theory) discrimination as a function of inter-group exposure, yielding mixed and scarce findings in the educational context (Elwert, Keller, and Kotsadam 2023). Thus, one can expect pre-service teachers to be either less or more biased by student-ascribed factors than in-service teachers with field experience. Prior research suggests that pre-and in-service teachers exhibit similar bias towards minority students, with no significant differences based on school context or inter-group exposure (Pit-ten Cate and Glock 2019). Our study also identified comparable effects to observational sociological science | www.sociologicalscience.com 766 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments and experimental studies with in-service teachers (Schuessler and Sønderskov 2023; Geven et al. 2021; Wenz and Hoenig 2020; Alesina et al. 2018; Marcenaro-Gutiérrez and Vignoles 2015). Contrary to contact and conflict theories, a field experiment on ethnic discrimination among Hungarian students (Elwert et al. 2023) indicated that randomly manipulating inter-ethnic exposure or ethnic composition within classrooms did not affect peer discrimination. Accordingly, large-scale observational studies using administrative data in Denmark (Schuessler and Sønderskov 2023) and Italy (Lievore and Triventi 2023) showed that teacher exposure to migrants and teacher’s characteristics like gender and migration background do not moderate biases. Starck et al. (2020) have demonstrated that American teachers are not different in terms of implicit and explicit racial and pro-White biases in comparison with the general non-teacher population, putting into question the role of schools embracing racial equity and the need for further teacher training to prevent discrimination. Future studies can test whether our findings generalize to other national contexts or replicate with in-service teachers, testing inter-group relations theories. Our motivation to focus on pre-service teachers was that in-service teachers might sort into schools with practices and student compositions aligned with their previous biases, which school-level factors might reinforce or mitigate (Pit-ten Cate and Glock 2019). Thus, an open empirical question is whether estimations on pre-service teachers are externally valid or can establish a benchmark for inter-group relations studies. Third, we applied a random sampling design to cover our frame population, reaching a larger and more representative sample than most previous experimental studies on educational discrimination run on convenience samples. Furthermore, we pre-registered a power plan to identify powered effects and bypass most previous underpowered studies. Still, given the small magnitude of the effect sizes identified and the substantial variation of the outcomes, we could not reliably estimate interactions between our analyzed ascribed characteristics to explore intersectionality. Hence, given the benchmark effect sizes and power we reported in this study, we recommend that future studies collect larger samples to more reliably identify potential false negatives and interaction effects. Fourth, with our factorial design, we cannot causally identify the relative explanatory power of different theories and mechanisms, as we did not randomly assign various degrees of student information to teachers or deploy tests of automatic cognition to disentangle implicit bias and SCT from statistical discrimination (Melamed et al. 2019). Nevertheless, we formalized a statistical discrimination test by comparing the relative impact of ascribed and ability student information by educational outcomes with different degrees of uncertainty. Future studies might apply more fine-grained experimental designs to better untangle these mechanisms. That is not an easy task because implicit bias, SCT, cultural capital, and statistical discrimination are not competing theories and might operate simultaneously (Correll and Benard 2006). Having acknowledged these limitations, we showed for the first time the causal effect of several ascribed characteristics—gender, SES background, ethnic origin, and cultural capital—among equally competent students on (pre-service) teacher assessments. We uncovered complex bias dynamics, expanding our knowledge of discrimination as a relevant educational inequality mechanism. Consciously or not, sociological science | www.sociologicalscience.com 767 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments Lizardo, Omar, and Sara Skiles. 2009. “Highbrow Omnivorousness on the Small Screen? Cultural Industry Systems and Patterns of Cultural Choice in Europe.” Poetics 37(1):1–23. https://doi.org/10.1016/j.poetic.2008.10.001 Lorenz, Georg, Irena Kogan, Sarah Gentrup, and Cornelia Kristen. 2024. “Non– Native Accents Among School Beginners and Teacher Expectations for Future Student Achievements.” Sociology of Education 97(1):76-96. https://doi.org/10.1177/ 00380407231202978 Marcenaro–Gutiérrez, Oscar D., and Anna Vignoles. 2015. “A Comparison of Teacher and Test–Based Assessment for Spanish Primary and Secondary Students.” Educational Research 57(1):1–21. https://doi.org/10.1080/00131881.2014.983720 Martínez de Lafuente, David. 2021. “Cultural Assimilation and Ethnic Discrimination: An Audit Study with Schools.” Labour Economics 72:102058. https://doi.org/10.1016/j. labeco.2021.102058 Melamed, David, Christopher W. Munn, Leanne Barry, Bradley Montgomery, and Oneya F. Okuwobi. 2019. “Status Characteristics, Implicit Bias, and the Production of Racial Inequality.” American Sociological Review 84(6):1013–1036. https://doi.org/10.1177/ 0003122419879101 Merton, Robert K. 1968. “The Self–Fulfilling Prophecy.” Pp. 475–91 in Social Theory and Social Structure, edited by R. K. Merton. New York: Simon and Schuster. Miles, Andrew, Raphaël Charron–Chénier, and Cyrus Schleifer. 2019. “Measuring Automatic Cognition: Advancing Dual–Process Research in Sociology.” American Sociological Review 84(2):308–33. https://doi.org/10.1177/0003122419832497 Ministerio de Universidades, Gobierno de Espa ˜ n a. 2023. Datos y Cifras del Sistema Universitario Espa ˜ n ol, Publicación 2022–2023. Madrid: Secretaría General Técnica del Ministerio de Universidades. Mitchell, Gregory, and Philip E. Tetlock. 2017. “Popularity as a Poor Proxy for Utility: The Case of Implicit Prejudice.” In Psychological Science Under Scrutiny: Recent Challenges and Proposed Solutions, edited by S. O. Lilienfeld and I. D. Waldman, pp. 164–195. Wiley Blackwell https://doi.org/10.1002/9781119095910.ch10 Owens, Jayanti. 2022. “Double Jeopardy: Teacher Biases, Racialized Organizations, and the Production of Racial/Ethnic Disparities in School Discipline.” American Sociological Review 87(6):1007–1048. https://doi.org/10.1177/00031224221135810 Petzold, Knut. 2022. “Factorial Survey Experiments in the Sociology of Education: Potentials, Pitfalls, Evaluation.” Swiss Journal of Sociology 48(1):47–76. https://doi.org/10.2478/ sjs-2022-0001 Phelps, Edmund S. 1972. “The Statistical Theory of Racism and Sexism.” American Economic Review 62(4):659–661. Pit–ten Cate, Ineke M., and Sabine Glock. 2019. “Teachers’ Implicit Attitudes Toward Students from Different Social Groups: A Meta–Analysis.” Frontiers in Psychology 10:491099. https://doi.org/10.3389/fpsyg.2019.02832 Quinn, David M. 2020. “Experimental Evidence on Teachers’ Racial Bias in Student Evaluation: The Role of Grading Scales.” Educational Evaluation and Policy Analysis 42(3):375–392. https://doi.org/10.3102/0162373720932188 Ridgeway, Cecilia L. 2014. “Why Status Matters for Inequality.” American Sociological Review 79(1):1–16. https://doi.org/10.1177/0003122413515997 Salza, Guido. 2022. “Equally Performing, Unfairly Evaluated: The Social Determinants of Grade Repetition in Italian High Schools.” Research in Social Stratification and Mobility 77:100676. https://doi.org/10.1016/j.rssm.2022.100676 sociological science | www.sociologicalscience.com 774 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments Schuessler, Julian, and Markus Freitag. 2020. “Power Analysis for Conjoint Experiments.” SocArXiv. December 16. doi:10.31235/osf.io/9yuhp. Schuessler, Julian, and Kim M. Sønderskov. 2023. “Compensating Discrimination: Behavioral Evidence from Danish School Registers.” SocArXiv. July 20. doi:10.31235/osf.io/ 5zm87. Skopek, Jan, and Giampiero Passaretta. 2021. “Socioeconomic Inequality in Children’s Achievement from Infancy to Adolescence: The Case of Germany.” Social Forces 100(1):86– 112. https://doi.org/10.1093/sf/soaa093 Starck, Justin G., Travis Riddle, Stacey Sinclair, and Natasha Warikoo. 2020. “Teachers Are People Too: Examining the Racial Bias of Teachers Compared to Other American Adults.” Educational Researcher 49(4):273–284. https://doi.org/10.3102/0013189X20912758 Stefanelli, Alberto, and Martin Lukac. 2020. “Subjects, Trials, and Levels: Statistical Power in Conjoint Experiments.” SocArXiv. November 18. doi:10.31235/osf.io/spkcy. Südkamp, Anna, Johanna Kaiser, and Jens Möller. 2012. “Accuracy of Teachers’ Judgments of Students’ Academic Achievement: A Meta–Analysis.” Journal of Educational Psychology 104(3):743–762. https://doi.org/10.1037/a0027627 Sullivan, Alice. 2002. “Bourdieu and Education: How Useful is Bourdieu’s Theory for Researchers?” Netherlands Journal of Social Sciences 38(2):144–166. Tilcsik, András. 2020. “Statistical Discrimination and the Rationalization of Stereotypes.” American Sociological Review 86(1):93–122. https://doi.org/10.1177/0003122420 969399 Timmermans, Anneke C., Hans Kuyper, and Geertje van der Werf. 2015. “Accurate, Inaccurate, or Biased Teacher Expectations: Do Dutch Teachers Differ in Their Expectations at the End of Primary Education?” British Journal of Educational Psychology 85(4):459–478. https://doi.org/10.1111/bjep.12087 Timmermans, Anneke C., Hester de Boer, Hilda T. A. Amsing, and Marieke P. C. van der Werf. 2018. “Track Recommendation Bias: Gender, Migration Background, and SES Bias Over a 20–Year Period in the Dutch Context.” British Educational Research Journal 44(5):847–874. https://doi.org/10.1002/berj.3470 Van de Werfhorst, Herman G. 2010. “Cultural Capital: Strengths, Weaknesses, and Two Advancements.” British Journal of Sociology of Education 31(2):157–169. https://doi.org/ 10.1080/01425690903539065 van Huizen, Thomas, Madelon Jacobs, and Matthijs Oosterveen. 2024. “Teacher Bias or Measurement Error?” arXiv:2401.04200 [econ.EM]. DOI: 10.48550/arXiv.2401.04200. Wenz, Sebastian E., and Kerstin Hoenig. 2020. “Ethnic and Social Class Discrimination in Education: Experimental Evidence from Germany.” Research in Social Stratification and Mobility 65:100461. https://doi.org/10.1016/j.rssm.2019.100461 Zanga, Giulietta, and Elena De Gioannis. 2023. “Discrimination in Grading: A Scoping Review of Studies on Teachers’ Discrimination in School.” Studies in Educational Evaluation 78:101284. https://doi.org/10.1016/j.stueduc.2023.101284 Zhu, Maria. 2024. “New Findings on Racial Bias in Teachers’ Evaluations of Student Achievement.” IZA Discussion Paper No. 16815. Available at SSRN: https://ssrn.com/ abstract=4736400 or http://dx.doi.org/10.2139/ssrn.4736400 sociological science | www.sociologicalscience.com 775 August 2024 | Volume 11
Gil-Hernández et al. Teacher Bias in Assessments Acknowledgements: This project has been funded through the JRC Centre for Advanced Studies and the project Social Classes in the Digital Age (DIGCLASS). Jonatan Casta ˜ n o Mu ˜ n oz acknowledges the support of a) the ‘Ramón y Cajal’ grant RYC2020-030157 funded by MCIN/AEI/10.13039/501100011033 and by “ESF Investing in your future”; and b) University of Seville “VI University research plan” (VI plan propio de investigación). We thank Lilian Weikert, William Foley, Zbigniew Karpi ˜ n ski, David Martínez de Lafuente, Alberto López, and Mario Spiezio for their valuable feedback and support. We also thank the participants at the following venues where we presented earlier versions of the article: the ‘Experiments on Social Inequality’ Workshop at Sciences Po- LIEPP, the ‘Colloquium of the Migration and Diversity Department’ at the WZB Berlin Social Science Centre, the ECSR Thematic Conference ‘Effort and Social Inequality’ and ‘2024 IC3JM Conference’ at Carlos III-Juan March Institute of Social Sciences, the FES ‘Inequality and Social Stratification Committee Workshop’ in Oviedo, the ‘Education and Social Inequalities Seminar’ at University of Sevilla, the ‘CLIC Seminar Series’ at the European University Institute, the SISEC conference in Cagliari, and the FES National Congress in Sevilla. Carlos J. Gil-Hernández ∗ :Department of Statistics, Computer Science, Applications, University of Florence. ∗Corresponding author, E-mail: [email protected] Irene Pa ˜ n eda-Fernández: WZB Berlin Social Science Center. E-mail: [email protected] Leire Salazar: Institute for Public Goods and Policies, Consejo Superior de Investigaciones Científicas. E-mail: [email protected] Jonatan Casta ˜ n o Mu ˜ n oz: Departamento de Didática y Organización Educativa, Universidad de Sevilla. E-mail: [email protected] sociological science | www.sociologicalscience.com 776 August 2024 | Volume 11