Hey, just wanted to bump this thread, as it’s been 2+ years and this issue still persists. It’s annoyin as hell and requires to create unnecessary wrappers just to eliminate this problem.
Solution: I’d expect the swap component property to only affect the component itself, not the particular variant of it. Therefore I could set multiple Slots to be of a single component type (eg Button), then fine-tune their appearances slightly via that component variants (eg Button: Primary | Secondary | Tertiary etc.).