The ONS said 1.85 million people were unemployed in the March-to-May period, an increase of 15,000 from the previous quarter, with the jobless rate at 5.6 per cent.
However, the pace of pay rises continued to increase, and average weekly earnings including bonuses rose at an annual pace of 3.2 per cent in the latest three-month period, the fastest rate in five years.
Pay excluding bonuses rose by 2.8 per cent, which was at the highest pace since February 2009, according to The BBC.
The number of people claiming unemployment-related benefits in June has seen a rise from 7,000 to 804,200.
The ONS figures showed there were 30.98 million people in work in the March-to-May quarter. That was down 67,000 from the previous three-month period and the first quarterly fall since April 2013.
The employment rate was highest in the South West of the country, at 77.4 per cent, and lowest in Northern Ireland, at 67.9 per cent, according to the ONS.
Compared with the same period a year earlier, there were 265,000 more people in work, with 272,000 more people working full-time and 7,000 fewer people working part-time.
“It’s possible that the rate of improvement in the labour market that we have seen over the last three years may have eased off, though it is too early to be certain,” said ONS statistician Nick Palmer.
Martin Beck, senior economic adviser at Ernst and Young, said: “Having become accustomed to persistent declines in the unemployment rate, the labour market data for the three months to May came as something of a shock.”
David Kern, chief economist at the British Chambers of Commerce, said the jobs figures suggested the economic recovery was not as strong as many hoped.
“This setback is a reminder that our recovery is still fragile and that further measures are needed to nurture economic growth, in particular by encouraging businesses to invest and export,” he said.
Despite the rise in the jobless total, the UK’s Work and Pensions Minister, Priti Patel, said there were jobs out there.
“When you look at the strength of the UK labour market – through the reforms we brought in in the last parliament and now as well we’re continuing to implement – we are seeing a lot of growth in the economy, and at the same time, wages are increasing, but vacancies are still at over 700,000, so there are jobs out there in the labour market and vacancies are there,” Ms Patel told the BBC.
But a Labour party official called the rise in the unemployment figures “extremely concerning”.
“It’s time for the government to boost the number of apprenticeships to give everyone the chance to earn, learn and contribute,” said Stephen Timms, Labour’s acting shadow work and pensions secretary.
The latest figures have added to the debate about when the Bank of England will raise interest rates from their record low of 0.5 per cent.
On Tuesday, the Bank’s governor, Mark Carney, said the point at which rates might rise was “moving closer”.
Rising unemployment is usually seen as making the prospect of a rate rise less likely, but the Bank will also be keeping an eye on the acceleration in pay rises.
“Private sector pay growth is approaching rates that would normally start to worry policymakers into tightening policy to avoid wage-price spirals developing,” said Chris Williamson, chief economist at Markit.
“However, a fall in employment in the three months to May is a concern which could lead to further hesitation in starting the policy normalisation process.
“Survey data suggest that this drop in hiring is temporary, and that the economy has picked up speed again since the election. If the data continue to strengthen in coming months in line with the surveys, a November rate hike remains very much in the picture.”
The unemployment figures are based on the Labour Force Survey, in which the ONS speaks to 60,000 households once a quarter, making it the country’s biggest household survey.
