Atmospheric reanalyses are a popular source of wind speed data for energy modelling but are known to exhibit biases. Such biases can have a significant impact on the validity of techno-economic energy assessments that include simulated wind power. This study assesses the Australian BARRA-R2 (Bureau of Meteorology Atmospheric Regional Reanalysis for Australia, version 2) atmospheric reanalysis, and compares it with MERRA-2 (Modern-Era Retrospective analysis for Research and Applications, V2) and ERA5 (European Centre for Medium-Range Weather Forecasts Reanalysis, fifth generation). Simulated wind power is compared with observed power from 54 wind farms across Australia using site-specific wind turbine specifications. We find that all of the reanalyses replicate wind speed patterns associated with the passage of weather systems. However, modelled power can diverge significantly from observed power at times. Assessed by bias, correlation and error, BARRA-R2 gave the best results, followed by MERRA-2, then ERA5. Annual bias can be readily corrected by wind speed scaling; however, linear scaling will not narrow the error distribution, or reduce the associated error in the frequency distribution of wind power. At the level of a wind farm, site-specific factors and microscale wind behaviour are contributing to differences between simulated and observed power. Although the performance of all the reanalyses is good at times, variability is high and site-dependent. We recommend the use of confidence intervals that reflect the degree of uncertainty in wind power simulation, and the degree of confidence required in the energy system model.