Imran Khan leaves Pakistani premier's office with a mixed record