British premier says 'Brexit has done more harm than good'