Swap libraries: How do I make Figma detects library styles automatically when using components from that library?

I have 3 libraries:

1. Light (only color styles)
2. Dark (only color styles)
3. Components (has a button component that uses color styles from light).

When I insert the button in a file, it doesn’t show the colors as “used in this file”.

Here’s a video showing the issue:

Does anyone else experience this? Is there a work around? Because this is the first glimpse of making a theme-able design system and I’m thrilled.