How to detect the reason of the problem?

I have done and copied bin folder to the SSMS22 install folder. Run SSMS22. it shows me the extension button, clicked = it works fine.

Then I exited SSMS22, deleted extension files, run SSMS22 again, I still see the extension button, clicked it and see the error: dll cannot be found etc. Why SSMS22 shows me the extension button and how to remove it?