Original title: Measuring School-Wide Grading Heterogeneity Without a Universal External Test: A Student-Course-Teacher Network with Advanced Placement Validation
Yi Yang · September 2026
Schools compare student grades across different classes, but teachers grade differently and courses rarely share a common test. To see if grades alone can reveal grading differences, researchers built a network connecting students and the courses they took at one high school. Because students take multiple classes, the model can separate a student's typical performance from how strictly a course is graded. They found that raw grades were higher in advanced classes, but adjusting for student performance flipped this pattern: advanced and college-level courses graded more strictly than lower tiers. Rigor explained a large share of grading variation, though the exact patterns varied across course subjects. Furthermore, external exam data confirmed these grading differences, and differences between courses mattered much more than differences between teachers of the same course. However, the researchers emphasize that these patterns reflect the overall grading environment rather than direct proof of teacher bias.
Say you want to know which hiking trails are genuinely harder. You only have each hiker's finish times, and every hiker has different fitness. A tough trail might have fast times simply because strong hikers chose it. That's the problem: raw times mix trail difficulty with hiker fitness. In this paper, the school is the trail system, grades are finish times, students are hikers, and courses are trails. By connecting which students take which courses, the researchers statistically separate student ability from course grading, revealing which courses grade generously or harshly.
Schools constantly compare grades across courses, but without a common test it's hard to know if a grade reflects learning or just how hard the class is. This study shows that internal grade networks can reveal systematic patterns—like harder courses actually grading more leniently after adjusting for students—and can even predict AP exam outcomes. That gives schools a tool to spot grading inconsistencies without adding any tests.
The study uses one U.S. high school, so generalizability is unknown. The estimated effects are descriptive, not causal—they show patterns but don't explain why courses grade differently. AP validation covers only the 29 exams that matched, and the teacher-within-course layer accounts for 8.6% of variance without measuring teacher quality directly.
Ask anything about this paper. Answers come from its abstract, and say so when the abstract doesn't cover your question.
Measuring School-Wide Grading Heterogeneity Without a Universal External Test: A Student-Course-Teacher Network with Advanced Placement Validation — Yi Yang — EdArXiv — doi:10.35542/osf.io/9wqnv_v1
Abstract licence: CC BY
Explanation generated by Synthesis from the abstract — it is not the original paper. This is a preprint, so it hasn't necessarily been peer reviewed.