{"id":162593,"date":"2020-06-08T14:48:40","date_gmt":"2020-06-08T12:48:40","guid":{"rendered":"https:\/\/www.myza.co.za\/south-africas-use-of-covid-19-modelling-has-been-deeply-flawed-heres-why-the-conversation\/"},"modified":"2020-06-08T14:48:40","modified_gmt":"2020-06-08T12:48:40","slug":"south-africas-use-of-covid-19-modelling-has-been-deeply-flawed-heres-why-the-conversation","status":"publish","type":"post","link":"https:\/\/www.myza.co.za\/press\/south-africas-use-of-covid-19-modelling-has-been-deeply-flawed-heres-why-the-conversation\/","title":{"rendered":"South Africa’s use of COVID-19 modelling has been deeply flawed. Here’s why | The Conversation"},"content":{"rendered":"

South Africa’s use of COVID-19 modelling has been deeply flawed. Here’s why<\/a>: <\/p>\n

President Ramaphosa's government is easing the lockdown because of unsustainable economic costs<\/span> Getty Images<\/span><\/span><\/figcaption><\/figure>\n

When President Cyril Ramaphosa announced the decision to implement an initial 21-day national lockdown in response to the threat posed by the COVID-19 pandemic, he referred to \u201cmodelling\u201d on which the decision was based. A media report a few days later based on leaked information claimed that the government had been told that \u201ca slow and inadequate response by government to the outbreak could result in anywhere between 87,900 and 351,000 deaths\u201d. These estimates, the report said, were based on, respectively, population infection rates of 10% to 40%.<\/p>\n

In late April, the chair of the health minister\u2019s advisory committee sub-committee on public health referred to the early models used by the government as \u201cback-of-the-envelope calculations\u201d, saying they were \u201cflawed and illogical and made wild assumptions\u201d. <\/p>\n

These assertions have been impossible to fully assess. This is because no official information on the modelling has ever been released \u2013 despite its apparently critical role.<\/p>\n

A briefing by the chair of the health minister\u2019s advisory committee in mid-April sketched some basic details of what the government\u2019s health advisors believed about the likely peak and timing of the epidemic. But no details were given on expected infections, hospital admissions or deaths. <\/p>\n

A spokesperson for the presidency said that government was withholding such numbers \u201cto avoid panic\u201d. <\/p>\n

Finally, towards the end of May the health minister hosted an engagement between journalists and some of the modellers government was relying on. It then started releasing details of the models and projections. <\/p>\n

The predictions of these models for an \u201coptimistic scenario\u201d are that the vast majority of the population will be infected, there will be a peak of 8 million infections in mid-August and in total there will be 40,000 deaths.<\/p>\n

To understand the significance of these \u2013 and the previous numbers \u2013 it is useful to consider more broadly what models are and how they are being used in the current context. <\/p>\n

What models are and how they are used<\/h2>\n

A theoretical model \u2013 whether in epidemiology, economics or even physics \u2013 is a simplified representation of how the modeller thinks the world works. <\/p>\n

To produce estimates or forecasts of how things might play out in the real world, such models need to make assumptions about the strength of relationships between different variables. Those assumptions reflect some combination of the modeller\u2019s beliefs, knowledge and available evidence.<\/p>\n

To put it differently: modelling is sophisticated guesswork. Where models have been successfully used across different contexts and time periods we can have more confidence in their accuracy and reliability. <\/p>\n

But models, especially outside sciences like physics, are almost always wrong to some degree. What matters for decision-making is that they are \u201cright enough\u201d. In the current situation, the difference between predicting 35,000 and 40,000 deaths probably won\u2019t change policy decisions, but 5,000 or 500,000 instead of 40,000 might.<\/p>\n

In the case of South Africa\u2019s COVID-19 response, available information indicates that epidemiological models have played two main roles. <\/p>\n

First, they have provided predictions of the possible scale of death and illness relative to health system capacity, as well as how this is expected to play out over time. <\/p>\n

Second, they have been used to assess the success and effects of the government\u2019s intervention strategies. <\/p>\n

There are reasons to believe that there have been significant failures in both cases, in the modelling itself and especially in the way that it has been used.<\/p>\n

In recent weeks, the government and its advisors have been keen to emphasise the uncertainty of the modelling predictions. From a methodological point of view, that is the responsible stance. But it\u2019s too little too late.<\/p>\n

Modelling COVID-19 is challenging in general, but there are at least four additional reasons to be cautious about our COVID-19 models. <\/p>\n

Reasons for caution<\/h2>\n

First, certain key characteristics of SARS-CoV-2 remain unknown and the subject of debate among medical experts. <\/p>\n

Second, unlike some countries, South Africa does not have detailed data on the dynamics of social interactions and the models presented so far do not use household survey data as a proxy. Nuanced questions therefore aren\u2019t addressed. For example, most cases early on in the epidemic appeared to have been relatively wealthy travellers. But there was no way to model the consequences of domestic workers being exposed by their employers and thereby infecting others in their (poorer) communities. So the structure of South Africa\u2019s models is high level and does not account for country-specific factors. <\/p>\n

Third, the values for the parameters of the models (representing the strength of relationships between different factors) are being taken from evidence in other countries. They may not actually be the same in South Africa. <\/p>\n

Finally, the unsystematic nature of aspects of the government\u2019s approach to testing, such as through its community screening programme, makes it much harder to infer the effects of its interventions.<\/p>\n

Unclear objectives<\/h2>\n

There is little reason to believe that government had anything other than good intentions. Nevertheless, the consequences of its lack of sophistication in using evidence and expertise may burden an entire generation of South Africans. <\/p>\n

A major problem linked to the combination of excessive confidence and secrecy is that the government\u2019s strategy was never clear: although it referred to \u201cflattening the curve\u201d it never stated what its specific objectives were. In the terms of the most influential modelling-based advice during the pandemic, was its strategy \u201csuppression\u201d or \u201cmitigation\u201d?<\/p>\n

The government and its advisors have made much of the fact that the lockdown probably delayed the peak of the epidemic. But there is no evidence so far that this was worth the cost \u2013 since most of the population is expected to be infected anyway. <\/p>\n

One key claim is that the lockdown bought the country time to prepare the health system. <\/p>\n

The Imperial model defined the primary objective of \u201cflattening the curve\u201d as reducing ICU admissions below the number of critical care beds. On that dimension, the government\u2019s own modellers predict a peak of 20,000 critical cases in the optimistic scenario and only about 4,000 ICU beds with little increase from the pre-lockdown numbers. By this definition, it has failed dismally. <\/p>\n

There appears to have been more success with securing supplies of personal protective equipment, quarantine locations, overflow beds and some ventilators. But there is also little evidence that many of those small gains could not have been achieved without such a costly lockdown.<\/p>\n

Given this, it is concerning that many academics and commentators have praised the success of government\u2019s strategy. This has included the Academy of Sciences, which has asserted that \u201cstrong, science-based governmental leadership has saved many lives, for which South Africa can be thankful\u201d. <\/p>\n

This is entirely unsubstantiated.<\/p>\n

First, the full toll of the epidemic will be experienced over time and so it is possible to have fewer deaths at the outset due to a policy intervention being exceeded by a larger number of deaths later because of the limitations of that same policy intervention. <\/p>\n

Second, the only way to substantiate such claims would be to use models of different scenarios. But we\u2019ve seen that the early models were not credible and the subsequent ones are subject to a great deal of uncertainty. It seems that the government and some of its advisors want to have the best of both worlds: they want to use dramatically incorrect predictions by early models to claim success of their interventions. This is misleading and does not meet the most basic standards by which academics in quantitative disciplines establish causal effects of policy interventions.<\/p>\n

In an earlier article, I noted that \u201cif the current lockdown fails to drastically curb transmission, which is possible, it would layer one disaster on another \u2026 the country may exhaust various resources by the time the potentially more dangerous winter period arrives\u201d. <\/p>\n

This appears to be the situation in which South Africa finds itself.<\/p>\n

\"The <\/p>\n

Se\u00e1n Mfundza Muller receives funding from a European Union-funded project, "Putting People back in Parliament", led by the Dullah Omar Institute (University of the Western Cape), in collaboration with the Parliamentary Monitoring Group, Public Service Accountability Monitor (Rhodes) and Heinrich Boell Foundation (South Africa). He also receives funding from the Council on Higher Education for research into the effects of recent higher education policy decisions. He is affiliated to the Johannesburg Institute for Advanced Study and the Public and Environmental Economics Research Centre (University of Johannesburg), regularly making inputs to Parliament oversight of the national budget, advising civil society groups on public finance matters and consulting for private sector organisations on an ad hoc basis. He is managing editor for a special issue of Scientific African on Covid-19 in African countries. The views expressed are his own.<\/span><\/em><\/p>\n

Source:<\/strong> The Conversation \u2013 Articles (AFRICA)<\/a><\/small>
\n<\/p>\n

Read more on The Conversation<\/a>.<\/p>\n

Join the fun:<\/strong> Add Your event<\/a> | Submit a Press Release<\/a> | Add your listing<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

South Africa’s use of COVID-19 modelling has been deeply flawed. Here’s why: President Ramaphosa's government is easing the lockdown because of unsustainable economic costs Getty Images When President Cyril Ramaphosa announced the decision to implement an initial 21-day national lockdown in response to the threat posed by the COVID-19 pandemic, he referred to \u201cmodelling\u201d on […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","ngg_post_thumbnail":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[4584],"tags":[4635,2389,8890,37606,10823,10824,7423,8666,3576],"class_list":{"0":"post-162593","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-africa-news-2","7":"tag-africas","8":"tag-been","9":"tag-conversation","10":"tag-covid19","11":"tag-deeply","12":"tag-flawed","13":"tag-heres","14":"tag-modelling","15":"tag-south","16":"entry"},"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.myza.co.za\/press\/wp-json\/wp\/v2\/posts\/162593","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.myza.co.za\/press\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.myza.co.za\/press\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.myza.co.za\/press\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.myza.co.za\/press\/wp-json\/wp\/v2\/comments?post=162593"}],"version-history":[{"count":0,"href":"https:\/\/www.myza.co.za\/press\/wp-json\/wp\/v2\/posts\/162593\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.myza.co.za\/press\/wp-json\/wp\/v2\/media?parent=162593"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.myza.co.za\/press\/wp-json\/wp\/v2\/categories?post=162593"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.myza.co.za\/press\/wp-json\/wp\/v2\/tags?post=162593"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}