# HERBench

Source: [HERBench](<https://www.sota2.com/research/dataset/herbench>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Benchmarks

Page 1 of 2. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/dataset/herbench.md?page=2>): Follow this link to discover more pages.

- [Weather Forecasting on WeatherBench ERA5 (test)](<https://www.sota2.com/research/sota/weather-forecasting-on-weatherbench-era5-test.md>): Weather Forecasting; WeatherBench ERA5 (test).

- [Precipitation Nowcasting on WeatherBench (test)](<https://www.sota2.com/research/sota/precipitation-nowcasting-on-weatherbench-test.md>): Precipitation Nowcasting; WeatherBench (test).

- [Desnowing on WeatherBench](<https://www.sota2.com/research/sota/desnowing-on-weatherbench.md>): Desnowing; WeatherBench.

- [Weather Forecasting (V1000) on WeatherBench](<https://www.sota2.com/research/sota/weather-forecasting-v1000-on-weatherbench.md>): Weather Forecasting (V1000); WeatherBench.

- [Weather Forecasting (U1000) on WeatherBench](<https://www.sota2.com/research/sota/weather-forecasting-u1000-on-weatherbench.md>): Weather Forecasting (U1000); WeatherBench.

- [Weather Forecasting (V500) on WeatherBench](<https://www.sota2.com/research/sota/weather-forecasting-v500-on-weatherbench.md>): Weather Forecasting (V500); WeatherBench.

- [Weather Forecasting (U500) on WeatherBench](<https://www.sota2.com/research/sota/weather-forecasting-u500-on-weatherbench.md>): Weather Forecasting (U500); WeatherBench.

- [Weather Forecasting (Z850) on WeatherBench](<https://www.sota2.com/research/sota/weather-forecasting-z850-on-weatherbench.md>): Weather Forecasting (Z850); WeatherBench.

- [Weather Forecasting (T500) on WeatherBench](<https://www.sota2.com/research/sota/weather-forecasting-t500-on-weatherbench.md>): Weather Forecasting (T500); WeatherBench.

- [Downscaling on WeatherBench ERA5 5.625° to 1.40625°](<https://www.sota2.com/research/sota/downscaling-on-weatherbench-era5-5-625-to-1-40625.md>): Downscaling; WeatherBench ERA5 5.625° to 1.40625°.

- [Image Restoration (Average) on WeatherBench](<https://www.sota2.com/research/sota/image-restoration-average-on-weatherbench.md>): Image Restoration (Average); WeatherBench.

- [Video Prediction on WeatherBench T2m (test)](<https://www.sota2.com/research/sota/video-prediction-on-weatherbench-t2m-test.md>): Video Prediction; WeatherBench T2m (test).

- [Video Understanding on HERBench Lite](<https://www.sota2.com/research/sota/video-understanding-on-herbench-lite.md>): Video Understanding; HERBench Lite.

- [Global Temperature Prediction on WeatherBench 12 → 12 frames (test)](<https://www.sota2.com/research/sota/global-temperature-prediction-on-weatherbench-12-12-frames-test.md>): Global Temperature Prediction; WeatherBench 12 → 12 frames (test).

- [Video Prediction on WeatherBench T2m (12 -\> 12 frames, test)](<https://www.sota2.com/research/sota/video-prediction-on-weatherbench-t2m-12-12-frames-test.md>): Video Prediction; WeatherBench T2m 12 -\> 12 frames (test).

- [Multi-variable Weather Forecasting on WeatherBench multi-variable forecasting R, T, U, and V](<https://www.sota2.com/research/sota/multi-variable-weather-forecasting-on-weatherbench-multi-variable-forecasting-r-t-u-and-v.md>): Multi-variable Weather Forecasting; WeatherBench multi-variable forecasting R, T, U, and V.

- [Temperature Prediction (T850) on WeatherBench ERA5 2017-2018 5.625° (test)](<https://www.sota2.com/research/sota/temperature-prediction-t850-on-weatherbench-era5-2017-2018-5-625-test.md>): Temperature Prediction (T850); WeatherBench ERA5 2017-2018 5.625° (test).

- [Geopotential Prediction (Z500) on WeatherBench ERA5 2017-2018 5.625° (test)](<https://www.sota2.com/research/sota/geopotential-prediction-z500-on-weatherbench-era5-2017-2018-5-625-test.md>): Geopotential Prediction (Z500); WeatherBench ERA5 2017-2018 5.625° (test).

- [Image Restoration on WeatherBench Haze 56](<https://www.sota2.com/research/sota/image-restoration-on-weatherbench-haze-56.md>): Image Restoration; WeatherBench Haze 56.

- [Image Restoration on WeatherBench Snow 56](<https://www.sota2.com/research/sota/image-restoration-on-weatherbench-snow-56.md>): Image Restoration; WeatherBench Snow 56.

- [Image Restoration on WeatherBench Rain 56](<https://www.sota2.com/research/sota/image-restoration-on-weatherbench-rain-56.md>): Image Restoration; WeatherBench Rain 56.

- [Spatio-temporal forecasting on WeatherBench-S 2017-2018 (test)](<https://www.sota2.com/research/sota/spatio-temporal-forecasting-on-weatherbench-s-2017-2018-test.md>): Spatio-temporal forecasting; WeatherBench-S 2017-2018 (test).

- [Text-to-Cypher on CypherBench (test)](<https://www.sota2.com/research/sota/text-to-cypher-on-cypherbench-test.md>): Text-to-Cypher; CypherBench (test).

- [Single-variable Weather Forecasting on WeatherBench R](<https://www.sota2.com/research/sota/single-variable-weather-forecasting-on-weatherbench-r.md>): Single-variable Weather Forecasting; WeatherBench R.

- [Single-variable Weather Forecasting on WeatherBench TCC](<https://www.sota2.com/research/sota/single-variable-weather-forecasting-on-weatherbench-tcc.md>): Single-variable Weather Forecasting; WeatherBench TCC.

- [Single-variable Weather Forecasting on WeatherBench T2M](<https://www.sota2.com/research/sota/single-variable-weather-forecasting-on-weatherbench-t2m.md>): Single-variable Weather Forecasting; WeatherBench T2M.

- [Precipitation intensity nowcasting on WeatherBench 2018 1 (test)](<https://www.sota2.com/research/sota/precipitation-intensity-nowcasting-on-weatherbench-2018-1-test.md>): Precipitation intensity nowcasting; WeatherBench 2018 1 (test).

- [Spatio-temporal forecasting on WeatherBench-M 2017-2018 (test)](<https://www.sota2.com/research/sota/spatio-temporal-forecasting-on-weatherbench-m-2017-2018-test.md>): Spatio-temporal forecasting; WeatherBench-M 2017-2018 (test).

- [Video Prediction on WeatherBench](<https://www.sota2.com/research/sota/video-prediction-on-weatherbench.md>): Video Prediction; WeatherBench.

- [Single-variable Weather Forecasting on WeatherBench UV10](<https://www.sota2.com/research/sota/single-variable-weather-forecasting-on-weatherbench-uv10.md>): Single-variable Weather Forecasting; WeatherBench UV10.

- [Video Deraining on WeatherBench real-world](<https://www.sota2.com/research/sota/video-deraining-on-weatherbench-real-world.md>): Video Deraining; WeatherBench real-world.

- [Weather Forecasting on WeatherBench 3 Day Forecast (ACC Metrics)](<https://www.sota2.com/research/sota/weather-forecasting-on-weatherbench-3-day-forecast-acc-metrics.md>): Weather Forecasting; WeatherBench 3 Day Forecast.

- [Weather Forecasting on WeatherBench South Pacific 3h horizon](<https://www.sota2.com/research/sota/weather-forecasting-on-weatherbench-south-pacific-3h-horizon.md>): Weather forecasting; WeatherBench South Pacific 3h horizon.

- [Weather Forecasting on WeatherBench South Pacific 1h horizon](<https://www.sota2.com/research/sota/weather-forecasting-on-weatherbench-south-pacific-1h-horizon.md>): Weather forecasting; WeatherBench South Pacific 1h horizon.

- [Weather Forecasting on WeatherBench South Pacific 12h horizon (test)](<https://www.sota2.com/research/sota/weather-forecasting-on-weatherbench-south-pacific-12h-horizon-test.md>): Weather Forecasting; WeatherBench South Pacific 12h horizon (test).

- [Weather Forecasting on WeatherBench South Pacific 6h horizon (test)](<https://www.sota2.com/research/sota/weather-forecasting-on-weatherbench-south-pacific-6h-horizon-test.md>): Weather Forecasting; WeatherBench South Pacific 6h horizon (test).

- [Weather Forecasting on WeatherBench South Pacific 60-hour horizon (test)](<https://www.sota2.com/research/sota/weather-forecasting-on-weatherbench-south-pacific-60-hour-horizon-test.md>): Weather Forecasting; WeatherBench South Pacific 60-hour horizon (test).

- [Weather Forecasting on WeatherBench South Pacific 24-hour horizon (test)](<https://www.sota2.com/research/sota/weather-forecasting-on-weatherbench-south-pacific-24-hour-horizon-test.md>): Weather Forecasting; WeatherBench South Pacific 24-hour horizon (test).

- [Temperature 850 hPa Prediction on WeatherBench 5-day lead time](<https://www.sota2.com/research/sota/temperature-850-hpa-prediction-on-weatherbench-5-day-lead-time.md>): Temperature 850 hPa Prediction; WeatherBench 5-day lead time.

- [Geopotential 500 hPa Prediction on WeatherBench 5-day lead time](<https://www.sota2.com/research/sota/geopotential-500-hpa-prediction-on-weatherbench-5-day-lead-time.md>): Geopotential 500 hPa Prediction; WeatherBench 5-day lead time.

- [10m V-wind Prediction on WeatherBench 5-day lead time](<https://www.sota2.com/research/sota/10m-v-wind-prediction-on-weatherbench-5-day-lead-time.md>): 10m V-wind Prediction; WeatherBench 5-day lead time.

- [10m U-wind Prediction on WeatherBench 5-day lead time](<https://www.sota2.com/research/sota/10m-u-wind-prediction-on-weatherbench-5-day-lead-time.md>): 10m U-wind Prediction; WeatherBench 5-day lead time.

- [2m Temperature Prediction on WeatherBench 5-day lead time](<https://www.sota2.com/research/sota/2m-temperature-prediction-on-weatherbench-5-day-lead-time.md>): 2m Temperature Prediction; WeatherBench 5-day lead time.

- [Global Weather Forecasting on WeatherBench 2](<https://www.sota2.com/research/sota/global-weather-forecasting-on-weatherbench-2.md>): Global Weather Forecasting; WeatherBench 2.

- [Image Deraining on WeatherBench](<https://www.sota2.com/research/sota/image-deraining-on-weatherbench.md>): Image Deraining; WeatherBench.

- [Image Dehazing on WeatherBench](<https://www.sota2.com/research/sota/image-dehazing-on-weatherbench.md>): Image Dehazing; WeatherBench.

- [Text-to-Cypher on CypherBench](<https://www.sota2.com/research/sota/text-to-cypher-on-cypherbench.md>): Text-to-Cypher; CypherBench.

- [Time Series Reasoning on WeatherBench 2](<https://www.sota2.com/research/sota/time-series-reasoning-on-weatherbench-2.md>): Time Series Reasoning; WeatherBench 2.

- [Temperature 850 hPa Prediction on WeatherBench 9-day lead time](<https://www.sota2.com/research/sota/temperature-850-hpa-prediction-on-weatherbench-9-day-lead-time.md>): Temperature 850 hPa Prediction; WeatherBench 9-day lead time.

- [Temperature 850 hPa Prediction on WeatherBench 7-day lead time](<https://www.sota2.com/research/sota/temperature-850-hpa-prediction-on-weatherbench-7-day-lead-time.md>): Temperature 850 hPa Prediction; WeatherBench 7-day lead time.

- [Geopotential 500 hPa Prediction on WeatherBench 9-day lead time](<https://www.sota2.com/research/sota/geopotential-500-hpa-prediction-on-weatherbench-9-day-lead-time.md>): Geopotential 500 hPa Prediction; WeatherBench 9-day lead time.

- [Geopotential 500 hPa Prediction on WeatherBench 7-day lead time](<https://www.sota2.com/research/sota/geopotential-500-hpa-prediction-on-weatherbench-7-day-lead-time.md>): Geopotential 500 hPa Prediction; WeatherBench 7-day lead time.

- [Total Cloud Cover Prediction on WeatherBench 5-day lead time](<https://www.sota2.com/research/sota/total-cloud-cover-prediction-on-weatherbench-5-day-lead-time.md>): Total Cloud Cover Prediction; WeatherBench 5-day lead time.

- [10m V-wind Prediction on WeatherBench 9-day lead time](<https://www.sota2.com/research/sota/10m-v-wind-prediction-on-weatherbench-9-day-lead-time.md>): 10m V-wind Prediction; WeatherBench 9-day lead time.

- [10m V-wind Prediction on WeatherBench 7-day lead time](<https://www.sota2.com/research/sota/10m-v-wind-prediction-on-weatherbench-7-day-lead-time.md>): 10m V-wind Prediction; WeatherBench 7-day lead time.

- [10m U-wind Prediction on WeatherBench 9-day lead time](<https://www.sota2.com/research/sota/10m-u-wind-prediction-on-weatherbench-9-day-lead-time.md>): 10m U-wind Prediction; WeatherBench 9-day lead time.

- [10m U-wind Prediction on WeatherBench 7-day lead time](<https://www.sota2.com/research/sota/10m-u-wind-prediction-on-weatherbench-7-day-lead-time.md>): 10m U-wind Prediction; WeatherBench 7-day lead time.

- [2m Temperature Prediction on WeatherBench 9-day lead time](<https://www.sota2.com/research/sota/2m-temperature-prediction-on-weatherbench-9-day-lead-time.md>): 2m Temperature Prediction; WeatherBench 9-day lead time.

- [2m Temperature Prediction on WeatherBench 7-day lead time](<https://www.sota2.com/research/sota/2m-temperature-prediction-on-weatherbench-7-day-lead-time.md>): 2m Temperature Prediction; WeatherBench 7-day lead time.

- [Weather Perturbation Control on WeatherBench2](<https://www.sota2.com/research/sota/weather-perturbation-control-on-weatherbench2.md>): Weather perturbation control; WeatherBench2.

- [Geopotential at 500hPa forecasting on WeatherBench 2 1.5° resolution 2020 (test)](<https://www.sota2.com/research/sota/geopotential-at-500hpa-forecasting-on-weatherbench-2-1-5-resolution-2020-test.md>): Geopotential at 500hPa forecasting; WeatherBench 2 1.5° resolution 2020 (test).

- [Temperature 850 hPa Prediction on WeatherBench 14-day lead time](<https://www.sota2.com/research/sota/temperature-850-hpa-prediction-on-weatherbench-14-day-lead-time.md>): Temperature 850 hPa Prediction; WeatherBench 14-day lead time.

- [Geopotential 500 hPa Prediction on WeatherBench 14-day lead time](<https://www.sota2.com/research/sota/geopotential-500-hpa-prediction-on-weatherbench-14-day-lead-time.md>): Geopotential 500 hPa Prediction; WeatherBench 14-day lead time.

- [Total Cloud Cover Prediction on WeatherBench 14-day lead time](<https://www.sota2.com/research/sota/total-cloud-cover-prediction-on-weatherbench-14-day-lead-time.md>): Total Cloud Cover Prediction; WeatherBench 14-day lead time.

- [Total Cloud Cover Prediction on WeatherBench 9-day lead time](<https://www.sota2.com/research/sota/total-cloud-cover-prediction-on-weatherbench-9-day-lead-time.md>): Total Cloud Cover Prediction; WeatherBench 9-day lead time.

- [Total Cloud Cover Prediction on WeatherBench 7-day lead time](<https://www.sota2.com/research/sota/total-cloud-cover-prediction-on-weatherbench-7-day-lead-time.md>): Total Cloud Cover Prediction; WeatherBench 7-day lead time.

- [10m V-wind Prediction on WeatherBench 14-day lead time](<https://www.sota2.com/research/sota/10m-v-wind-prediction-on-weatherbench-14-day-lead-time.md>): 10m V-wind Prediction; WeatherBench 14-day lead time.

- [10m U-wind Prediction on WeatherBench 14-day lead time](<https://www.sota2.com/research/sota/10m-u-wind-prediction-on-weatherbench-14-day-lead-time.md>): 10m U-wind Prediction; WeatherBench 14-day lead time.

- [2m Temperature Prediction on WeatherBench 14-day lead time](<https://www.sota2.com/research/sota/2m-temperature-prediction-on-weatherbench-14-day-lead-time.md>): 2m Temperature Prediction; WeatherBench 14-day lead time.

- [Weather Forecasting on WeatherBench 5 Day Forecast horizon](<https://www.sota2.com/research/sota/weather-forecasting-on-weatherbench-5-day-forecast-horizon.md>): Weather Forecasting; WeatherBench 5 Day Forecast horizon.

- [Weather Forecasting on WeatherBench 1 Day Forecast horizon](<https://www.sota2.com/research/sota/weather-forecasting-on-weatherbench-1-day-forecast-horizon.md>): Weather Forecasting; WeatherBench 1 Day Forecast horizon.

- [Weather Forecasting on WeatherBench 5 Day Forecast](<https://www.sota2.com/research/sota/weather-forecasting-on-weatherbench-5-day-forecast.md>): Weather Forecasting; WeatherBench 5 Day Forecast.

- [Weather Forecasting on WeatherBench 3 Day Forecast](<https://www.sota2.com/research/sota/weather-forecasting-on-weatherbench-3-day-forecast.md>): Weather Forecasting; WeatherBench 3 Day Forecast.

- [Weather Forecasting on WeatherBench 1 Day Forecast](<https://www.sota2.com/research/sota/weather-forecasting-on-weatherbench-1-day-forecast.md>): Weather Forecasting; WeatherBench 1 Day Forecast.

- [10m u-component of wind forecasting on WeatherBench 1.5° resolution 2 2020 (test)](<https://www.sota2.com/research/sota/10m-u-component-of-wind-forecasting-on-weatherbench-1-5-resolution-2-2020-test.md>): 10m u-component of wind forecasting; WeatherBench 1.5° resolution 2 2020 (test).

- [Weather Forecasting on WeatherBench 32x64 5 Day Forecast](<https://www.sota2.com/research/sota/weather-forecasting-on-weatherbench-32x64-5-day-forecast.md>): Weather Forecasting; WeatherBench 32x64 5 Day Forecast.

- [Weather Forecasting on WeatherBench 32x64 3 Day Forecast](<https://www.sota2.com/research/sota/weather-forecasting-on-weatherbench-32x64-3-day-forecast.md>): Weather Forecasting; WeatherBench 32x64 3 Day Forecast.

- [Weather Forecasting on WeatherBench 32x64 1 Day Forecast](<https://www.sota2.com/research/sota/weather-forecasting-on-weatherbench-32x64-1-day-forecast.md>): Weather Forecasting; WeatherBench 32x64 1 Day Forecast.

- [Weather Forecasting (5 Day Forecast) on WeatherBench 64x128 (test)](<https://www.sota2.com/research/sota/weather-forecasting-5-day-forecast-on-weatherbench-64x128-test.md>): Weather Forecasting (5 Day Forecast); WeatherBench 64x128 (test).

- [Weather Forecasting (3 Day Forecast) on WeatherBench 64x128 (test)](<https://www.sota2.com/research/sota/weather-forecasting-3-day-forecast-on-weatherbench-64x128-test.md>): Weather Forecasting (3 Day Forecast); WeatherBench 64x128 (test).