Missing Data Is A Known Unknown

March 16, 2021
Procurement

There is a famous quote about the fragility of knowledge by Donald Rumsfeld, the hawkish US Secretary of Defence during the Iraq war:

“as we know, there are known knowns; there are things we know we know. We also know there are known unknowns; that is to say we know there are some things we do not know. But there are also unknown unknowns—the ones we don’t know we don’t know.”

Following the legal judgement against the UK Government for delaying publication of their contract notices, the question of how many contracting records are yet to be published is effectively a known unknown for the UK.

In relative terms, the UK publishes more data on procurement than almost any other country, but our inability to know how much contracting data is missing indicates how far the UK and other countries have to travel if we’re to achieve true transparency.

In an attempt to answer this question we’ve taken the last four years of contracting data for central government in the UK and compared it to the spending data for the same period. If we count how many suppliers have been awarded contracts each year between 2017 and 2020 we find an average of 6,401 suppliers have been listed each year. However, when we look at the spend data, the average number of suppliers being paid by central government entities during that period is over 31,852.

So an 80% difference.

When we reconcile this data to supplier records, something that takes significant amounts of work, including manual and automatic matching, we still end up with a 78% difference.

Does this mean that around 80% of award notices are missing? Not quite. This analysis can only indicate that there’s an awful lot of data missing, but it can’t say precisely how much data is missing.

The sheer scale of the differential indicates that there is a problem here. For instance a search on Contracts Finder, England’s procurement transparency database, for a prominent London Borough returns just two contract award notices. It simply isn’t credible that a council in London has let only two contracts in four years. The only reasonable explanation is that they have failed to publish the data required.

We know that the team at the Cabinet Office has been working hard to improve this data, but the responsibility for compliance lies with the publishers. It is not unreasonable to suggest that the Cabinet Office has better things to do, the publishers knows what they should be doing, they have the tools to do so, why can’t they publish this information?

Rumsfeld was roundly ridiculed for his quote, somewhat unfairly to my mind, trying find new ways to describe our collective ignorance seems like a useful endeavour, despite what else you might be getting up to.

Covid-19 has put a spotlight on all of our governments, their integrity is very much at stake and transparency is a chance to turn known unknowns into known knowns. Governments should think earnestly about the benefit of choosing collective enlightenment over collective ignorance.

If you’d like to discuss our government data or research capabilities, please get in touch.

April 14, 2021

UK Government Procurement Under Pressure

Yesterday the FT published an article, £19bn of UK Covid-related contracts awarded without seeking rival bids. The report reviewed the value of...
April 14, 2021

Selling to procurement: No One Cares About Your Product

Selling to procurement professionals is something that most people find frustrating, mainly because they are highly resistant to direct sales. Why? Well,...
April 7, 2021

8 Reasons Why Procurement Doesn’t Need Blockchain.

Blockchain is fundamentally a database, but rather than a database where one item is allowed to replace another, each change to the...
March 25, 2021

Procurement Transparency Suffers Under Covid-19

Government publishing of procurement notices has fallen significantly following the global spread of Covid-19. The total number of tender notices published globally...
March 20, 2021

South Africa, Kenya lead the way on African transparency.

Both South Africa and Kenya lead the way in procurement transparency according to our data, South Africa and Kenya publish more tender...
March 4, 2021

NZ Government Pharmaceutical Procurement Review

The New Zealand Government is taking steps to improve its procurement of national medicine supply through a review process. The Pharmaceutical Management...
February 28, 2021

The Problem With Frameworks

-Ian Makgill In my last post, I covered off framework agreements, and the advantages of using them for both government and suppliers.In this...
February 28, 2021

Do Framework Agreements Have Value?

-Ian Makgill Framework agreements are like umbrella agreements, and are usually made with a group of providers to supply a set of...
February 28, 2021

NSW Aims To Reserve Procurement Budgets For SMEs

We're always pleased to see governments around the world improving their procurement processes, by broadening opportunities for all types of business to...
February 28, 2021

Creating Synergy Between Politics & Procurement.

The need for administrations to act at pace is often at odds with the processes and procedures needed for good procurement. If...
February 28, 2021

Canada Launches Green Procurement

We are always pleased to see governments taking steps towards better procurement practices. Recently, the Canadian Government took a step forward for...
February 28, 2021

Not All Data Is The Same: Rules For Data Integrity.

-Ian Mackill Not all data is the same. It might have come from the same source, but how it gets treated is...
February 4, 2021

Post Brexit Procurement – What Will Change?

With the Brexit transition period officially behind us, it's worth considering the potential impacts of Brexit on Government procurement into the future....
February 28, 2021

Where Next For Data Led Procurement in Europe? A Discussion.

The They Buy For You  Project (TBFY) concluded on 31 December 2020. To mark the occasion, we look back at three years...
February 28, 2021

Spending $400bn – A Demanding Task For Biden.

-Fiona Hunt As my colleague Ian wrote this week, governments are increasingly looking to procurement to deliver better social outcomes. President Biden...

Newsletter

Compelling research, insights and data directly into your inbox.

Recent media stories

Search