Validity and usefulness of COVID-19 models

Abstract Mathematical models have become central to the public and policy debate about the recent COVID-19 pandemic. On the one hand, they provide guidance to policy-makers about the development of the epidemic and healthcare demand overtime; on the other hand, they are heavily criticized for their lack of credibility. This commentary reflects on three such models from a validity and usefulness perspective. Specifically, it discusses the complexity, validation, and communication of models informing the government decisions in the UK, US and Austria, and concludes that, although these models are useful in many ways, they currently lack a thorough validation and a clear communication of their uncertainties. Therefore, prediction claims of these models should be taken cautiously, and their merits on scenario analysis should be the basis for decision-making. The lessons that can be learned from the COVID models in terms of the communication of uncertainties and assumptions can guide the use of quantitative models in other policy-making areas.