Data, Procurement / By /

Public procurement data needs work.

December 17, 2020
Data, Procurement

Government data is much like infrastructure, valuable when it is cared for, troublesome when it is left unloved.

Government spends nearly £400bn a year with suppliers, but most of this data is only available to the buyers and their suppliers. This is fine for managing individual contracts, but it is no good if you want to manage public procurement as a whole. When Carillion collapsed, just 28 of their 405 public sector contracts had been published, it took weeks to identify all of these contracts, making the task of handling the fallout that much harder.

If we need this data to manage procurement, we certainly need it to reform it. Consider what could be achieved with good analysis; what if you could know that a given supplier routinely exceeded budgets by 10%? What if you could predict demand for services? What if you could spot fraud and collusion more easily? What if you could identify the best sub-contractors for a contract, or predict that a tender will get just one bid? All of this is already possible today, but only if we have good data.

What data do we have?

We gather data on tender notices (adverts detailing government requirements), contract notices (follow up notices detailing which supplier won) and spend data (the bank statements of Government), however, coverage of this data is patchy and only very small amounts of this data links together. That means we don’t know who won a specific contract, or whether spending on a contract exceeds the budget for that contract.

We know, for instance, that UK tender data alone is published on over 160 different sites and that over 70% of public sector tenders in England never make it onto Contracts Finder. Once tenders are in Contracts Finder, the chance of finding out who won the contract is not much better than fifty-fifty. If a tender document never made it onto Contracts Finder, then the chance of knowing who won the contract are much less.

How good is it?

There’s also a raft of quality problems with the data, just 4.5% of tenders are published with an estimated price or budget, and more than 86% of the contracts we’ve gathered don’t feature an end date. So even when the data is available, you can’t see whether the price has reduced, and we’re denying suppliers the information they need to plan future bids.

Actually, let’s take a step back, it is still too hard to know precisely who is involved in contracts. Publishers frequently use different names and acronyms for their organisation, so it isn’t always clear who the buyer is and we still haven’t come up with a comprehensive list of public bodies, so we can’t link contracts and spending to budgets or even group activity into sectors, without lots of manual work. The same is true of suppliers, who are often given incorrect names, brand names or even project names.

This isn’t a conspiracy to hide information, it’s just poor data hygiene and a failure to recognise the value of good data. Although the cause of this is minor, the impact is significant: we don’t gather all the data, when we do gather the data, it is incomplete and we can’t always make sense of the data when we do get it.

Is the data used well?

There is also the question about whether the data is being used to its full potential. From what we can tell, the data is mostly being used to identify potential framework contracts and to aggregate spend. This work is a normal feature of strategic procurement, but far too little effort is going on monitoring the health of our markets or whether or not a contract delivered good outcomes.

Competition is a critical feature of value for money, and more bids has been proven to deliver cost savings, but more than one in five public (22%) tenders in the UK receives just one bid. Fewer bids means less competition and more cost, but trying to reduce single bid tenders isn’t featured in any policies or procurement performance indicators.

The potential

With good data we could predict poor performance, bad tendering and new savings opportunities. We could monitor market efficiency and look for new suppliers to increase competition.

We could do more to understand the actual risks associated with contracting and use appropriate risk measures, rather than over-protective measures that stifle innovation or lackadaisical ones that underestimate the impact of failure.

With nearly £400bn at stake, small margins can have big impacts, the primary focus of procurement has been to squeeze costs, but too little effort as gone into monitoring the outcomes from contracts. Because we don’t yet measure whether our contracts have been successful or not, we’re not always sure that we’re buying the right thing in the first place. This is where real savings can come from: using data to show what works and then buying to succeed.

Modern statistical analysis techniques have transformed finance, sport and agriculture; it is time for Government to look again at procurement, to gather better data and use it to deliver better services and better value for its citizens.

Spend Network are a data analysis firm specialising in public procurement, they maintain a global database of public procurement documents, including all published spending and contracts in the UK.

June 6, 2023

Net Zero Needs Further Action, Says NAO

A new National Audit Office (NAO) report highlights that further action is needed by the UK Government to strengthen governance and delivery...
Read more...
June 1, 2023

Critical Audit on Australia’s Frigate Procurement

The Australian National Audit Office (ANAO) has recently released its findings into a review of the Department of Defence (Defence) 2018 procurement...
Read more...
May 30, 2023

Space To Innovate- New UK Gov Opportunity

The UK Government's, Defence Science and Technology Laboratory (Dstl) Space Systems Programme has announced it is seeking proposals to aid UK Defence...
Read more...
May 25, 2023

EU Commission Move To Electronic Procurement

The European Commissions Directorate Generate for Informatics (DIGIT), has launched a new dynamic purchasing system for software licences and associated services (SIDE...
Read more...
May 22, 2023

Biosecure Procurement Trial

The UK Government yesterday announced new measures for domestic tree seed production and biosecurity procurement requirements. The next round of the Domestic...
Read more...
May 18, 2023

New Industry Body White Paper Review of Covid Procurement

Since early on in the pandemic, there has been significant focus on the procurement of Covid related PPE, due to unprecedented nature...
Read more...
May 11, 2023

EU Council Joint Procurement Under European Peace Facility

The European Union Council has adopted an assistance measure worth €1 billion under the European Peace Facility (EPF) that will further contribute...
Read more...
May 10, 2023

Measuring Sustainable Public Procurement

One of the projects we are most proud of is working with The Open Contracting Partnership to create a Sustainable Public Procurement...
Read more...
May 3, 2023

From Hero to Zero – UK Digital Marketplace Shuttered

Within living memory, the UK’s Crown Commercial Service (CCS) had planned to reshape a large swathe of public procurement in the image...
Read more...
May 2, 2023

We Sell Data, Not Seats.

Why we sell data not seats? We're data analysts. We really understand the data we gather. We've been doing it for 15...
Read more...
May 2, 2023

New Tech Disrupts Traditional Government Procurement

A Silicon Valley startup, GLASS, has created a revolutionary new tech, Glass Commerce, an e-commerce marketplace enabling compliant transactions between government buyers...
Read more...
April 25, 2023

Green Public Procurement: New Report

At Spend Network, we are always on the look out for governments, think tanks, research bodies, and other organisations who are working...
Read more...
April 25, 2023

EU Agrees on Anti-Coercion Instrument

The European Commission and European Parliament’s Committee on International Trade have agreed on an anti-coercion instrument (ACI) which will enable public procurement...
Read more...
April 13, 2023

£256 Million Contract for Cyprus Awarded by UK Government

The UK Ministry of Defence  has awarded a £256 million contract, for work, repairs, servicing, and facilities management for the UK defence...
Read more...
April 5, 2023

Endorsements For Export Agencies

Endorsements are a win-win for export agencies. Exporters face new challenges, both in terms of increased barriers to trade following the pandemic,...
Read more...

Newsletter

Compelling research, insights and data directly into your inbox.

Recent media stories

Search

Recent articles