Jacob Steinhardt

Jacob Steinhardt

AI Forecasting: One Year In

Last August, my research group created a forecasting contest to predict AI progress on four benchmarks. Forecasts were asked to predict state-of-the-art performance (SOTA) on each benchmark for June 30th 2022, 2023, 2024,