UK premier says he takes responsibility for 'not walking away' following election defeat