Swap instance bug in figma

Im experiencing bugs on swap instance component. If I drop a button it looks fine, however anytime i swap it with another button variant it messes up the styles. This has been frustrating for my team and not sure how to fix it.

This is happening on both the desktop app and the Figma web app.