EPISODE · Apr 28, 2026 · 17 MIN
“Recursive forecasting: Eliciting long-term forecasts from myopic fitness-seekers” by Jozdien, Alex Mallen
We’d like to use powerful AIs to answer questions that may take a long time to resolve. But if a model only cares about performing well in ways that are verifiable shortly after answering (e.g., a myopic fitness seeker), it may be difficult to get useful work from it on questions that resolve much later. In this post, I’ll describe a proposal for eliciting good long-horizon forecasts from these models. Instead of asking a model to directly predict a far-future outcome, we can recursively: Ask it to predict what it will predict at the next time step,Use its prediction at the next time step to provide intermediate rewards,Finally reward using ground truth at the last step. This lets us replace a single distant forecast with a chain of short-horizon forecasts, each verifiable shortly after answering. I call this proposal recursive forecasting. It does have limitations: for example, it requires that developers maintain control over the reward signal at least until the final step, which makes it most useful for forecasting events that resolve well before developers are disempowered (if they are). This post was primarily written by Arun, with most of the ideas in this post [...] ---Outline:(01:36) The default long-term forecasting behavior(04:05) Recursive forecasting(07:06) When is recursive forecasting helpful?(07:10) When we have access to (somewhat) robust ground truth rewards(09:42) When the AIs forecast doesnt substantially affect the resolution(11:50) When forecasts arent used as optimization targets(12:50) When we credibly inform the AI of the setup(13:52) Appendix A: Comparison to temporal difference learning(15:57) Appendix B: Error tolerance The original text contained 9 footnotes which were omitted from this narration. --- First published: April 28th, 2026 Source: https://www.lesswrong.com/posts/q2zYtNsh62SCphitt/recursive-forecasting-eliciting-long-term-forecasts-from --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
NOW PLAYING
“Recursive forecasting: Eliciting long-term forecasts from myopic fitness-seekers” by Jozdien, Alex Mallen
No transcript for this episode yet
Similar Episodes
Dec 20, 2021 ·0m