The pendulum is swinging hard away from the Conservative Party