Jacob Steinhardt

Jacob Steinhardt

AI Forecasting: Two Years In

Two years ago, I commissioned forecasts for state-of-the-art performance on several popular ML benchmarks. Forecasters were asked to predict state-of-the-art performance on June 30th of 2022, 2023, 2024, and 2025. While there were