Boris Johnson's Brexit move not 'careerist' says father