When I create a set of components for a set of icons and take an icon from them to put it in a another components I need to change it to another variant but icon name is not enough, I think if I can see the icon it self next to the name it would be great.

I understand it may not working for all components, but you can make preview variants like an option in the parent component and users can active it if they its needed.