If I cancel, will the new followers disappear?

No. The followers we have gained to your account are all real genuine followers. They chose to follow you on their own and only they can make the decision to unfollow you, not us.