Malaysian ruling party sees less votes in by-election