The color variant of the icon in the button component created using variables is not retaining

We have these icon colors set up for different button types. 

But when I switch the size of the button(XS, S, M, L), these icon colors are retaining for the two of the sizes but for the other two sizes the colors are not retaining for the icons.