Communicating Statistics: Crossing the minefields of misinformation.

10/05/23 • 49 min

1 Listener

In this episode we talk about the growth of data use in the media and the potential impact of misinformation on the public’s trust in official statistics.

Navigating podcast host Miles Fletcher through this minefield is Prof Sir David Spiegelhalter, from the University of Cambridge; Ed Humpherson, Head of the Office for Statistics Regulation; and award-winning data journalist Simon Rogers.

Transcript

MILES FLETCHER

Welcome again to Statistically Speaking, the official podcast of the UK’s Office for National Statistics, I'm Miles Fletcher. Now we've talked many times before in these podcasts about the rise of data and its impact on our everyday lives. It's all around us of course, and not least in the media we consume every day. But ‘what’ or ‘who’ to trust: mainstream media, public figures and national institutions like the ONS, or those random strangers bearing gifts of facts and figures in our social media feeds?

To help us step carefully through the minefields of misinformation and on, we hope, to the terra firma of reliable statistical communication, we have three interesting and distinguished voices, each with a different perspective. Professor Sir David Spiegelhalter is a well-known voice to UK listeners. He's chair of the Winton Centre for Risk Evidence Communication at the University of Cambridge and was a very prominent voice on the interpretation of public health data here during the COVID pandemic. Also, we have Ed Humpherson, Director General of regulation and head of the Office for Statistics Regulation (OSR), the official stats watchdog if you like, and later in this podcast, I'll be joined by award winning data journalist and writer Simon Rogers, who now works as data editor at Google.

Professor, you've been one of the most prominent voices these last few years – a fascinating few years, obviously, for statistics in which we were told quite frankly, this was a golden age for statistics and data. I mean, reflecting on your personal experience as a prominent public voice in that debate, when it comes to statistics and data, to be very general, how well informed are we now as a public, or indeed, how ill-informed on statistics?

DAVID SPIEGELHALTER

I think things have improved after COVID. You know, for a couple of years we saw nothing but numbers and graphs on the news and in the newspapers and everywhere, and that went down very well. People didn't object to that. In fact, they wanted more. And I think that has led to an increased profile for data journalism, and there's some brilliant ones out there. I'm just thinking of John Burn-Murdoch on the FT but lots of others as well, who do really good work. Of course, in the mainstream media there is still the problem of non-specialists getting hold of data and getting it wrong, and dreadful clickbait headlines. It is the sub editors that wreck it all just by sticking some headline on what might be a decent story to get the attention and which is quite often misleading. So that's a standard problem. In social media, yeah, during COVID and afterwards, there are people I follow who you might consider as - I wouldn't say amateurs at all, but they're not professional pundits or media people - who just do brilliant stuff, and who I've learned so much from. There are also some terrible people out there, widespread misinformation claims which are based on data and sound convincing because they have got numbers in them. And that, I mean, it's not a new problem, but now it is widespread, and it's really tricky to counter and deal with, but very important indeed.

So the issue aside from - those of us who deal with the media have heard this a hundred times - “I don't write the headlines”, reporters will tell you when you challenge that misleading kind of headline. But would you say it’s the mainstream media then, because they can be called out on what they report, who broadly get things right? And that the challenge is everything else - it's out there in the Wild West of social media?

Yeah, mainstream media is not too bad, partly because, you know, we've got the BBC in this country, we’ve got regulations, and so it's not too bad. And social media, it's the Wild West. You know, there are people who really revel in using numbers and data to make inappropriate and misleading claims.

Is there anything that can be done? Is it the government, or even those of us like the ONS who produce statistics, who should we be wading in more than we do? Should we be getting out there onto the social media platforms and putting people right?

It's difficult I mean, I don't believe in sort of censorship. I don't think you can stop this at source at all. But just because people can say this, it doesn't give them a right for it to be broadcast wide, in a way and to be dumped into people's feeds. And so my main problem is with the recomme...

In this episode we talk about the growth of data use in the media and the potential impact of misinformation on the public’s trust in official statistics.

Transcript

MILES FLETCHER

DAVID SPIEGELHALTER

Previous Episode

International Development: Growing a Global Statistical System

In this episode, we explore ONS’s work with other countries to raise the world's statistical capabilities.

Transcript

MILES FLETCHER

Hello and welcome again to ‘Statistically Speaking’, the Office for National Statistics’ Podcast. I'm Miles Fletcher, and in this episode we're going international.

Now it hardly needs saying that global issues, climate change, population growth, inflation, to name a few are best understood and addressed with the benefit of good global statistics. So, to that end, the ONS works in partnership with a number of countries worldwide with the ultimate aim of raising the world's statistical capabilities. At the one end of Africa, for example, a continent where it’s deeply involved, that includes embedding state of the art inflation indices and other economic data in Ghana. On the other side of the continent, it's meant using AI and machine learning to track the movement of displaced populations in Somalia. How do you run a census in places where nobody has a permanent address?

It's all fascinating work and here to tell us about it, Emily Poskett, Head of International Development at the ONS; Tim Harris of the ONS Data Science Campus’s international development team; and joining us from Accra, our special guest, Government Statistician of the Republic of Ghana and head of the Ghanaian Statistical Service Professor Samuel Annim.

Emily then, to start give us the big overview if you would, set out for us the scale and the purpose of this international development work that the ONS is doing.

EMILY POSKETT

We work with countries around the developing world to support strong modern statistical systems wherever we see a suitable opportunity to do so.

What form does that work take? Does it mean statisticians going out to these countries?

Yes, it does, when that's the right way to go about things. So our work is usually through the form of medium-term partnerships with a small group of national statistical offices, or NSOs, from the developing world, and those partnerships are medium term over a number of years in order to build up a real understanding of the context in that country, that national statistical office’s vision for modernization and how the ONS can be of most help to achieve their own goals under their own strategy.

That relationship will normally be led by a particular individual who spends time getting to know the context and getting to know the people, getting to know what ONS can do to help. A partnership might cover a range of topic areas from census to data science to leadership training to economic statistics, and the lead point of contact, the strategic advisor in many cases, will bring in the relevant experts from across ONS, and they'll work through virtual collaboration but also through on-site visits, and they will work out the best timing for those and the best delivery modality in order to ensure that the gains are sustained. Our primary focus really is to make sure that changes that we support in the partner organisation are sustainable, and the work that ONS does using the UK’s aid budget is really impactful and leads to long term change.

We don't always work through direct partnerships, for example where we see opportunities to work alongside other organisations, so international institutions like the World Bank or other national statistics offices like Statistics Canada or Statistics Sweden, they might choose to bring us in to deliver small pieces of focussed technical assistance alongside their own programmes. One of our medium-term partnerships is with the United Nations Economic Commission For Africa (UNECA), and they work with all 54 countries of Africa, and they can choose to bring in our expertise alongside their own to target particular needs in particular countries. But I would say that 70% of our effort is through these medium-term partnerships.

So the ONS is providing one part of a large patchwork of work, going on right across the developing world, but what is the ultimate purpose of that? What are all these countries trying to achieve together?

Well, strong statistical systems are essential in all countries to aid effective planning and informed decision making. And this is even more important in developing countries where resources are often scarce and you're trying to use scarce resources to target a wide range of needs across the population. And that resource might include UK aid for example, and aid from other countries. The UK has been statistical capacity building for many, many years through different modalities, working with partners, and the ONS is just one implementing partner who can be called upon to provide that technical expertise. We're really proud to be a partner of choice for a number of developing countries and the ONS is seen worldwide as being a leader. We're really ...

Next Episode

Health: Preparing for the next global pandemic

The ONS led the way informing the UK response to the Coronavirus pandemic. But what lessons can be learned and how can we best prepare not only ourselves, but the rest of the world, for the next pandemic?

Transcript

MILES FLETCHER

This is Statistically Speaking, the Office for National Statistics (ONS) Podcast. I'm Miles Fletcher, and as we approach the darkest months of winter, we're revisiting COVID-19.

Now the ONS doesn't do predictions, and we're certainly not forecasting a resurgence of the virus, either here in the UK or anywhere else. But pandemic preparedness has been the driving force behind two important pieces of work that we're going to be talking about this time. Looking beyond our shores, how well equipped now is the world in general to spot and monitor emerging infections? We'll hear from Josie Golding of the Wellcome Trust on that, including how even weather events like El Nino could affect the spread of viruses. We'll also talk to my ONS colleague, Joy Preece about the pandemic preparedness toolkit, a five-year project backed by Wellcome to create and develop resources that will help countries with health surveillance in the event of future pandemics.

But first, and closer to home, a new UK winter surveillance study to gather vital data on COVID-19 is now well underway. Jo Evans is its head of operations. Jo, this is a brand new COVID-19 survey the ONS is running in partnership with the UK Health Security Agency (UKHSA). What is the new survey and what's it going to be monitoring over the winter?

JO EVANS

So this is now the winter COVID infection study. And we're going to be going out to, I think we've got 145,000 people signed up, and we're going to ask them to take a lateral flow test to see if they are testing positive for COVID-19. Then we'll ask them to tell us a little bit about how they're feeling, what symptoms they have and some other household information - what work do they do? Do they have caring responsibilities? And so on.

So we're gonna be getting people to take a test and everyone's familiar of course now with administering their own lateral flow test, that wasn't the case back in the early days of the pandemic, when it was a new thing for the vast majority of us. So they'll take a test that'll tell us whether they are positive or negative for COVID-19. And on top of that, we're going to be gathering data in the form of a questionnaire.

That's right. And then this is a collaboration this time, so we'll be working with the UKHSA. I mean, we've worked with them on the COVID infection study before, but this time what we'll be doing is looking at those responses of how many people are telling us that they have COVID-19 And we'll be trying to understand that by where people live or their age group and so on, but we'll be sharing that information with UKHSA and they will then be looking at what the impact is on hospitals. So what they call the infection hospitalisation rate, how many people are going into hospital because they have COVID, so it'll really help us understand what pressures there are on the NHS over this winter period.

And that will give us some inkling, once again, about how many people are infected but not actually displaying any symptoms?

Absolutely. And we do ask people about their symptoms and if they tell us they test positive, we'll then be sending them a second questionnaire, a follow up, asking them to keep testing until they get two consecutive negative tests so that we can see how long they are testing positive, but we'll also ask them how long did their symptoms last and did they need to go and see a doctor, did they take any medication, so really trying to understand how they're experiencing that period of illness.

So during those critical winter months, that'll give us some insight into what's really going on on-the- ground and in communities.

That's right and we're running this study from November right through to March so that we can understand that, because COVID, unlike flu, it's not a seasonal virus, but we know that the NHS really suffers through the winter with those increased pressures, with more people needing their services. And this is about understanding what's happening out there. In the community, and what impact that is having on our healthcare services.

Another very important aspect of that is we're going to be monitoring for people who say they're suffering the symptoms of what is popularly known as long-COVID, ongoing impacts of the virus, and that will fill a very important evidence gap won’t it.

Absolutely. We will in a follow up questionnaire be asking people how long they've had COVID for and whether they have long-COVID. And interestingly, in some research we did when we were designing the questionnaire, long-COVID ...