Original title: Ancestree: unified likelihood inference of ancestral alleles under supplied or inferred genealogies
Janek Sendrowski, Thomas Bataillon · September 2026
When scientists look at DNA differences across individuals, they want to figure out which letter is original, called ancestral, and which is a newer mutation, called derived. Knowing this is key for studying evolution, natural selection, and population history. However, existing tools cannot handle all data types, especially when sites have multiple mutations or lack related species for comparison, known as outgroups. To solve this, researchers built Ancestree, a software engine that calculates probabilities for all four DNA letters at every position. It works by tracing how DNA sequences relate through family trees. It can use a single fixed tree, take changing local trees from an ancestral recombination graph, or estimate those trees directly from raw genetic data using a hidden Markov model. In tests on simulated data, the tree-based methods were more accurate and scaled better. Having outgroups still proved vital, especially for detecting mutations shared by the entire study group.
Imagine you have a box of old family photos and want to know who first wore a particular hat. You have some photos with dates, some without, and some showing different branches of the family. Normally you need a complete family tree, but here the method works with whatever family records you have—even if they are messy or incomplete. In this paper, the tool uses any type of genealogy to calculate the probability that each person was the original hat-wearer, giving you a best guess with a measure of uncertainty.
Population geneticists studying selection, adaptation, and demography rely on knowing which DNA variant came first. Until now, they had to use different tools for different types of data—plain variants, family trees, with or without outgroups—and none gave full uncertainty. Ancestree unifies all these inputs in one framework, returning probabilities for each possible ancestor, which improves accuracy and enables more robust downstream analyses.
Accuracy depends heavily on outgroups, especially for sites where all ingroup individuals carry the derived allele—these require multiple deep outgroups to recover. Without outgroups, per-site inference on ingroup-polymorphic sites is markedly limited. The tool has only been tested on simulated data, so real-world performance may differ.
Ask anything about this paper. Answers come from its abstract, and say so when the abstract doesn't cover your question.
Ancestree: unified likelihood inference of ancestral alleles under supplied or inferred genealogies — Janek Sendrowski, Thomas Bataillon — bioRxiv — doi:10.64898/2026.09.11.750934
Abstract licence: CC BY
Explanation generated by Synthesis from the abstract — it is not the original paper. This is a preprint, so it hasn't necessarily been peer reviewed.