If you remove a method through the MFA page you will also need to remove it from your phone.
To do so open the authenticator and select the account you would like to remove.
After selecting the account click on the settings cogwheel in the top right corner and then select “Remove account”