I found 2 similar issues that have been closed, they were both related to the beta for interactive components, my issue is with the official production release.
Essentially interactive components are not retaining scroll position when swapped, specifically when nested inside other master component instances.
For instance, I have a horizontally scrolling list of tiles that have switch toggles on them, nested within a section that also includes a heading and summary. The entire section is a component instance, the list itself is a component instance (with horizontal scrolling enabled), and the tiles within are interactive component instances. If I scroll right and swap the interactive component instance, the list snaps back to the L, but if I detach all parent component instances (the section and the list) and make them regular frames, the issue does not occur.
Happy to share examples with support, project is under NDA and cannot share publicly.