Data Works: Ensuring Quality Through Validation

March 4, 2021
Data

Ian Makgill, Founder, Spend Network

When is something right?

We process over 150,000 records a month. Our database now has more than 150m rows in it. We can’t view every record when we enter it.

Instead, we validate it. We check that each record has what our users need; a deadline date, a description and a buyer.

We also check that our key sources produce data every day, so we’ll always know if Contracts Finder stops publishing.

But sometimes knowing that something is there, or that it is valid, isn’t enough.

So we’re doing more. We’re starting to monitor not just whether something is there, but whether it is truly valid. We want to know if a field that was full is now empty. We want to know if a source that published about four records a week is now publishing just four records a month?

It might be that the source has changed.

But better to make sure.

Details matter.

To find out more about our data products and services, get in touch.

April 14, 2021

UK Government Procurement Under Pressure

Yesterday the FT published an article, £19bn of UK Covid-related contracts awarded without seeking rival bids. The report reviewed the value of...
April 14, 2021

Selling to procurement: No One Cares About Your Product

Selling to procurement professionals is something that most people find frustrating, mainly because they are highly resistant to direct sales. Why? Well,...
April 7, 2021

8 Reasons Why Procurement Doesn’t Need Blockchain.

Blockchain is fundamentally a database, but rather than a database where one item is allowed to replace another, each change to the...
March 25, 2021

Procurement Transparency Suffers Under Covid-19

Government publishing of procurement notices has fallen significantly following the global spread of Covid-19. The total number of tender notices published globally...
March 20, 2021

South Africa, Kenya lead the way on African transparency.

Both South Africa and Kenya lead the way in procurement transparency according to our data, South Africa and Kenya publish more tender...
March 16, 2021

Missing Data Is A Known Unknown

There is a famous quote about the fragility of knowledge by Donald Rumsfeld, the hawkish US Secretary of Defence during the Iraq...
March 4, 2021

NZ Government Pharmaceutical Procurement Review

The New Zealand Government is taking steps to improve its procurement of national medicine supply through a review process. The Pharmaceutical Management...
February 28, 2021

The Problem With Frameworks

-Ian Makgill In my last post, I covered off framework agreements, and the advantages of using them for both government and suppliers.In this...
February 28, 2021

Do Framework Agreements Have Value?

-Ian Makgill Framework agreements are like umbrella agreements, and are usually made with a group of providers to supply a set of...
February 28, 2021

NSW Aims To Reserve Procurement Budgets For SMEs

We're always pleased to see governments around the world improving their procurement processes, by broadening opportunities for all types of business to...
February 28, 2021

Creating Synergy Between Politics & Procurement.

The need for administrations to act at pace is often at odds with the processes and procedures needed for good procurement. If...
February 28, 2021

Canada Launches Green Procurement

We are always pleased to see governments taking steps towards better procurement practices. Recently, the Canadian Government took a step forward for...
February 28, 2021

Not All Data Is The Same: Rules For Data Integrity.

-Ian Mackill Not all data is the same. It might have come from the same source, but how it gets treated is...
February 4, 2021

Post Brexit Procurement – What Will Change?

With the Brexit transition period officially behind us, it's worth considering the potential impacts of Brexit on Government procurement into the future....
February 28, 2021

Where Next For Data Led Procurement in Europe? A Discussion.

The They Buy For You  Project (TBFY) concluded on 31 December 2020. To mark the occasion, we look back at three years...

Newsletter

Compelling research, insights and data directly into your inbox.

Recent media stories

Search