Original title: LEAP: Likelihood Elicitation and Aggregation for LLM-based Probabilistic Forecasting
Yufei Chen, Yiran Zhao, Xiaogang Xu, Qipeng Xie +2 · September 2026
Forecasting systems that use large language models often gather evidence to predict events like sports or financial markets. Most systems feed all gathered evidence into an AI at once to get a final guess. The authors call this Monolithic PredictionA method where all evidence is processed together, obscuring individual impacts.. It hides how single clues change the answer and flattens out real uncertainty. To fix this, researchers created LEAP. Instead of processing everything together, LEAP looks at each piece of evidence alone. It measures how likely each clue makes an outcome. Then, a set math model blends those scores with a starting guess to find the final odds. When given the same evidence, LEAP improved most forecast accuracy and calibration scores across models compared to the standard all-at-once approach.
Imagine packing for a trip by quickly glancing at a weather app, a traffic report, and a hotel confirmation, then deciding. If you miss that rain is forecasted, you might leave your umbrella behind. Here, each piece of information is checked separately to see how it affects the trip, then combined carefully. In this paper, LEAP does this for forecasting, ensuring each clue is fully considered before forming a final prediction.
People in finance and sports make decisions based on forecasts. Current methods can hide how evidence affects predictions, leading to unreliable results. LEAP makes forecasts more accurate and transparent, helping users trust and act on them better.
The abstract does not discuss specific limitations, such as failure cases, computational costs, or performance outside the benchmark. It focuses on controlled comparisons without detailing real-world deployment challenges.
Ask anything about this paper. Answers come from its abstract, and say so when the abstract doesn't cover your question.
LEAP: Likelihood Elicitation and Aggregation for LLM-based Probabilistic Forecasting — Yufei Chen, Yiran Zhao, Xiaogang Xu et al.
Abstract licence: CC0
Explanation generated by Synthesis from the abstract — it is not the original paper. This is a preprint, so it hasn't necessarily been peer reviewed.