Original title: A Unified Theory of H-Duality in First-Order Methods
Kevin Shu, Alex L. Wang · September 2026
Computer algorithms solve optimization problems by taking step-by-step measurements to reach the lowest point of a curve. Researchers noticed a strange pattern called H-duality: running certain fixed-step algorithms forward gives the exact same worst-case performance as running a time-reversed version on a paired setup. This matters because it automatically turns algorithms that minimize total error into algorithms that shrink error measurements called gradients. However, nobody fully understood why this happens. The researchers solved this by giving two explanations. First, on specific extreme curves, the algorithm's final step is just the starting point multiplied by a single number. This number stays exactly the same even if you reverse the algorithm's steps in time. Second, they built a mathematical tool that directly transforms performance certificates of an algorithm into certificates for its time-reversed partner. Using this, they proved a matching conjectured optimal guarantee for the reversed version of an algorithm named ITEM.
When you follow a recipe to bake a cake, the steps are in a specific order. If you reversed the order, the cake might not turn out the same because some steps depend on others. In this paper, the researchers find that for some calculation methods, doing the steps backwards results in the same worst-case performance, and they prove this using properties of the problems and how the methods work.
This helps people who build algorithms for things like AI or simulations understand why some methods work interchangeably. It turns an observed pattern into a solid rule, so they can trust and use these methods more reliably.
The theory applies only to smooth strongly convex optimization and contractive fixed-point problems, not necessarily to other types of optimization. It is based on theoretical explanations and may not cover all algorithms or real-world scenarios.
Ask anything about this paper. Answers come from its abstract, and say so when the abstract doesn't cover your question.
A Unified Theory of H-Duality in First-Order Methods — Kevin Shu, Alex L. Wang
Abstract licence: CC0
Explanation generated by Synthesis from the abstract — it is not the original paper. This is a preprint, so it hasn't necessarily been peer reviewed.